Introducing v0.5 of the AI Safety Benchmark from MLCommons.

Vin Sharma

Bertie Vidgen Adarsh Agrawal Ahmed M. Ahmed 0004 Victor Akinwande Namir Al-Nuaimi Najla Alfaraj Elie Alhajjar Lora Aroyo Trupti Bavalatti Borhane Blili-Hamelin Kurt Bollacker Rishi Bomassani Marisa Ferrara Boston Siméon Campos Kal Chakra Canyu Chen Cody Coleman Zacharie Delpierre Coudert Leon Derczynski Debojyoti Dutta Ian Eisenberg James Ezick Heather Frase Brian Fuller Ram Gandikota Agasthya Gangavarapu Ananya Gangavarapu James Gealy Rajat Ghosh James Goel Usman Gohar Subhra S. Goswami Scott A. Hale Wiebke Hutiri Joseph Marvin Imperial Surgan Jandial Nick Judd Felix Juefei-Xu Foutse Khomh Bhavya Kailkhura Hannah Rose Kirk Kevin Klyman Chris Knotz Michael Kuchnik Shachi H. Kumar Chris Lengerich Bo Li 0026 Zeyi Liao Eileen Peters Long Victor Lu Yifan Mai 0001 Priyanka Mary Mammen Kelvin N. Manyeki Sean McGregor Virendra Mehta Shafee Mohammed Emanuel Moss Lama Nachman Dinesh Jinenhally Naganna Amin Nikanjam Besmira Nushi Luis Oala Iftach Orr Alicia Parrish Cigdem Patlak William Pietri Forough Poursabzi-Sangdeh Eleonora Presani Fabrizio Puletti Paul Röttger Saurav Sahay Tim Santos Nino Scherrer Alice Schoenauer Sebag Patrick Schramowski Abolfazl Shahbazi Vin Sharma Xudong Shen Vamsi Sistla Leonard Tang Davide Testuggine Vithursan Thangarasa Elizabeth Anne Watkins Rebecca Weiss Chris Welty Tyler Wilbers Adina Williams Carole-Jean Wu Poonam Yadav Xianjun Yang Yi Zeng 0005 Wenhui Zhang Fedor Zhdanov Jiacheng Zhu Percy Liang Peter Mattson Joaquin Vanschoren Introducing v0.5 of the AI Safety Benchmark from MLCommons. 2024 abs/2404.12241 CoRR https://doi.org/10.48550/arXiv.2404.12241 db/journals/corr/corr2404.html#abs-2404-12241

Haichen Shen Jared Roesch Zhi Chen 0030 Wei Chen Yong Wu Mu Li 0003 Vin Sharma Zachary Tatlock Yida Wang 0003 Nimble: Efficiently Compiling Dynamic Neural Networks for Model Inference. 2021 MLSys https://proceedings.mlsys.org/paper_files/paper/2021/hash/5b47430e24a5a1f9fe21f0e8eb814131-Abstract.html conf/mlsys/2021 db/conf/mlsys/mlsys2021.html#ShenRCCW0STW21

Yao Wang Xingyu Zhou Yanming Wang Rui Li 0033 Yong Wu Vin Sharma Tuna: A Static Analysis Approach to Optimizing Deep Neural Networks. 2021 abs/2104.14641 CoRR https://arxiv.org/abs/2104.14641 db/journals/corr/corr2104.html#abs-2104-14641

Zhi Chen 0030 Cody Hao Yu Trevor Morris Jorn Tuyls Yi-Hsiang Lai Jared Roesch Elliott Delaye Vin Sharma Yida Wang 0003 Bring Your Own Codegen to Deep Learning Compiler. 2021 abs/2105.03215 CoRR https://arxiv.org/abs/2105.03215 db/journals/corr/corr2105.html#abs-2105-03215

Haichen Shen Jared Roesch Zhi Chen 0030 Wei Chen Yong Wu Mu Li 0003 Vin Sharma Zachary Tatlock Yida Wang 0003 Nimble: Efficiently Compiling Dynamic Neural Networks for Model Inference. 2020 abs/2006.03031 CoRR https://arxiv.org/abs/2006.03031 db/journals/corr/corr2006.html#abs-2006-03031

Animesh Jain Shoubhik Bhattacharya Masahiro Masuda Vin Sharma Yida Wang 0003 Efficient Execution of Quantized Deep Learning Models: A Compiler Approach. 2020 abs/2006.10226 CoRR https://arxiv.org/abs/2006.10226 db/journals/corr/corr2006.html#abs-2006-10226

Yizhi Liu Yao Wang Ruofei Yu Mu Li 0003 Vin Sharma Yida Wang 0003 Optimizing CNN Model Inference on CPUs. 1025-1040 2019 USENIX ATC https://www.usenix.org/conference/atc19/presentation/liu-yizhi conf/usenix/2019 db/conf/usenix/usenix2019.html#LiuWYLSW19

Yizhi Liu Yao Wang Ruofei Yu Mu Li 0003 Vin Sharma Yida Wang 0003 Optimizing CNN Model Inference on CPUs. 2018 abs/1809.02697 CoRR http://arxiv.org/abs/1809.02697 db/journals/corr/corr1809.html#abs-1809-02697

Adarsh Agrawal Ahmed M. Ahmed 0004 Victor Akinwande Namir Al-Nuaimi Najla Alfaraj Elie Alhajjar Lora Aroyo Trupti Bavalatti Shoubhik Bhattacharya Borhane Blili-Hamelin Kurt Bollacker Rishi Bomassani Marisa Ferrara Boston Siméon Campos Kal Chakra Canyu Chen Wei Chen Zhi Chen 0030 Cody Coleman Zacharie Delpierre Coudert Elliott Delaye Leon Derczynski Debojyoti Dutta Ian Eisenberg James Ezick Heather Frase Brian Fuller Ram Gandikota Agasthya Gangavarapu Ananya Gangavarapu James Gealy Rajat Ghosh James Goel Usman Gohar Subhra S. Goswami Scott A. Hale Wiebke Hutiri Joseph Marvin Imperial Animesh Jain Surgan Jandial Nick Judd Felix Juefei-Xu Bhavya Kailkhura Foutse Khomh Hannah KirkHannah Rose Kirk Kevin Klyman Chris Knotz Michael Kuchnik Shachi H. Kumar Yi-Hsiang Lai Christopher T. LengerichChris Lengerich Bo Li 0026 Mu Li 0003 Rui Li 0033 Percy Liang Zeyi Liao Yizhi Liu Eileen Peters Long Victor Lu Yifan Mai 0001 Priyanka Mary Mammen Kelvin N. Manyeki Masahiro Masuda Peter Mattson Sean McGregor Virendra Mehta Shafee Mohammed Trevor Morris Emanuel Moss Lama Nachman Dinesh Jinenhally Naganna Amin Nikanjam Besmira Nushi Luis Oala Iftach Orr Alicia Parrish Cigdem Patlak William Pietri Forough Poursabzi-Sangdeh Eleonora Presani Fabrizio Puletti Jared Roesch Paul Röttger Saurav Sahay Tim Santos Nino Scherrer Patrick Schramowski Alice Schoenauer Sebag Abolfazl Shahbazi Haichen Shen Xudong Shen Vamsi Sistla Leonard Tang Zachary Tatlock Davide Testuggine Vithursan Thangarasa Jorn Tuyls Joaquin Vanschoren Bertie Vidgen Yanming Wang Yao Wang Yida Wang 0003 Elizabeth Anne Watkins Rebecca Weiss Christopher A. WeltyChris Welty Tyler Wilbers Adina Williams Carole-Jean Wu Yong Wu Poonam Yadav Xianjun Yang Cody Hao Yu Ruofei Yu Yi Zeng 0005 Wenhui Zhang Fedor Zhdanov Xingyu Zhou Jiacheng Zhu