--- title: "Gemini 1.5: Unlocking multimodal understanding — Team 2024" description: "This Google technical report presents the Gemini 1.5 family of multimodal models, built to handle very long inputs." authors: ["Gemini Team", "Petko Georgiev", "Ving Ian Lei", "Ryan Burnell", "Libin Bai", "Anmol Gulati", "Garrett Tanzer", "Damien Vincent", "Zhufeng Pan", "Shibo Wang", "Soroosh Mariooryad", "Yifan Ding", "Xinyang Geng", "Fred Alcober", "Roy Frostig", "Mark Omernick", "Lexi Walker", "Cosmin Paduraru", "Christina Sorokin", "Andrea Tacchetti", "Colin Gaffney", "Samira Daruki", "Olcan Sercinoglu", "Zach Gleicher", "Juliette Love", "Paul Voigtlaender", "Rohan Jain", "Gabriela Surita", "Kareem Mohamed", "Rory Blevins", "Junwhan Ahn", "Tao Zhu", "Kornraphop Kawintiranon", "Orhan Firat", "Yiming Gu", "Yujing Zhang", "Matthew Rahtz", "Manaal Faruqui", "Natalie Clay", "Justin Gilmer", "JD Co-Reyes", "Ivo Penchev", "Rui Zhu", "Nobuyuki Morioka", "Kevin Hui", "Krishna Haridasan", "Victor Campos", "Mahdis Mahdieh", "Mandy Guo", "Samer Hassan", "Kevin Kilgour", "Arpi Vezer", "Heng-Tze Cheng", "Raoul de Liedekerke", "Siddharth Goyal", "Paul Barham", "DJ Strouse", "Seb Noury", "Jonas Adler", "Mukund Sundararajan", "Sharad Vikram", "Dmitry Lepikhin", "Michela Paganini", "Xavier Garcia", "Fan Yang", "Dasha Valter", "Maja Trebacz", "Kiran Vodrahalli", "Chulayuth Asawaroengchai", "Roman Ring", "Norbert Kalb", "Livio Baldini Soares", "Siddhartha Brahma", "David Steiner", "Tianhe Yu", "Fabian Mentzer", "Antoine He", "Lucas Gonzalez", "Bibo Xu", "Raphael Lopez Kaufman", "Laurent El Shafey", "Junhyuk Oh", "Tom Hennigan", "George van den Driessche", "Seth Odoom", "Mario Lucic", "Becca Roelofs", "Sid Lall", "Amit Marathe", "Betty Chan", "Santiago Ontanon", "Luheng He", "Denis Teplyashin", "Jonathan Lai", "Phil Crone", "Bogdan Damoc", "Lewis Ho", "Sebastian Riedel", "Karel Lenc", "Chih-Kuan Yeh", "Aakanksha Chowdhery", "Yang Xu", "Mehran Kazemi", "Ehsan Amid", "Anastasia Petrushkina", "Kevin Swersky", "Ali Khodaei", "Gowoon Chen", "Chris Larkin", "Mario Pinto", "Geng Yan", "Adria Puigdomenech Badia", "Piyush Patil", "Steven Hansen", "Dave Orr", "Sebastien M. R. Arnold", "Jordan Grimstad", "Andrew Dai", "Sholto Douglas", "Rishika Sinha", "Vikas Yadav", "Xi Chen", "Elena Gribovskaya", "Jacob Austin", "Jeffrey Zhao", "Kaushal Patel", "Paul Komarek", "Sophia Austin", "Sebastian Borgeaud", "Linda Friso", "Abhimanyu Goyal", "Ben Caine", "Kris Cao", "Da-Woon Chung", "Matthew Lamm", "Gabe Barth-Maron", "Thais Kagohara", "Kate Olszewska", "Mia Chen", "Kaushik Shivakumar", "Rishabh Agarwal", "Harshal Godhia", "Ravi Rajwar", "Javier Snaider", "Xerxes Dotiwalla", "Yuan Liu", "Aditya Barua", "Victor Ungureanu", "Yuan Zhang", "Bat-Orgil Batsaikhan", "Mateo Wirth", "James Qin", "Ivo Danihelka", "Tulsee Doshi", "Martin Chadwick", "Jilin Chen", "Sanil Jain", "Quoc Le", "Arjun Kar", "Madhu Gurumurthy", "Cheng Li", "Ruoxin Sang", "Fangyu Liu", "Lampros Lamprou", "Rich Munoz", "Nathan Lintz", "Harsh Mehta", "Heidi Howard", "Malcolm Reynolds", "Lora Aroyo", "Quan Wang", "Lorenzo Blanco", "Albin Cassirer", "Jordan Griffith", "Dipanjan Das", "Stephan Lee", "Jakub Sygnowski", "Zach Fisher", "James Besley", "Richard Powell", "Zafarali Ahmed", "Dominik Paulus", "David Reitter", "Zalan Borsos", "Rishabh Joshi", "Aedan Pope", "Steven Hand", "Vittorio Selo", "Vihan Jain", "Nikhil Sethi", "Megha Goel", "Takaki Makino", "Rhys May", "Zhen Yang", "Johan Schalkwyk", "Christina Butterfield", "Anja Hauth", "Alex Goldin", "Will Hawkins", "Evan Senter", "Sergey Brin", "Oliver Woodman", "Marvin Ritter", "Eric Noland", "Minh Giang", "Vijay Bolina", "Lisa Lee", "Tim Blyth", "Ian Mackinnon", "Machel Reid", "Obaid Sarvana", "David Silver", "Alexander Chen", "Lily Wang", "Loren Maggiore", "Oscar Chang", "Nithya Attaluri", "Gregory Thornton", "Chung-Cheng Chiu", "Oskar Bunyan", "Nir Levine", "Timothy Chung", "Evgenii Eltyshev", "Xiance Si", "Timothy Lillicrap", "Demetra Brady", "Vaibhav Aggarwal", "Boxi Wu", "Yuanzhong Xu", "Ross McIlroy", "Kartikeya Badola", "Paramjit Sandhu", "Erica Moreira", "Wojciech Stokowiec", "Ross Hemsley", "Dong Li", "Alex Tudor", "Pranav Shyam", "Elahe Rahimtoroghi", "Salem Haykal", "Pablo Sprechmann", "Xiang Zhou", "Diana Mincu", "Yujia Li", "Ravi Addanki", "Kalpesh Krishna", "Xiao Wu", "Alexandre Frechette", "Matan Eyal", "Allan Dafoe", "Dave Lacey", "Jay Whang", "Thi Avrahami", "Ye Zhang", "Emanuel Taropa", "Hanzhao Lin", "Daniel Toyama", "Eliza Rutherford", "Motoki Sano", "HyunJeong Choe", "Alex Tomala", "Chalence Safranek-Shrader", "Nora Kassner", "Mantas Pajarskas", "Matt Harvey", "Sean Sechrist", "Meire Fortunato", "Christina Lyu", "Gamaleldin Elsayed", "Chenkai Kuang", "James Lottes", "Eric Chu", "Chao Jia", "Chih-Wei Chen", "Peter Humphreys", "Kate Baumli", "Connie Tao", "Rajkumar Samuel", "Cicero Nogueira dos Santos", "Anders Andreassen", "Nemanja Rakićević", "Dominik Grewe", "Aviral Kumar", "Stephanie Winkler", "Jonathan Caton", "Andrew Brock", "Sid Dalmia", "Hannah Sheahan", "Iain Barr", "Yingjie Miao", "Paul Natsev", "Jacob Devlin", "Feryal Behbahani", "Flavien Prost", "Yanhua Sun", "Artiom Myaskovsky", "Thanumalayan Sankaranarayana Pillai", "Dan Hurt", "Angeliki Lazaridou", "Xi Xiong", "Ce Zheng", "Fabio Pardo", "Xiaowei Li", "Dan Horgan", "Joe Stanton", "Moran Ambar", "Fei Xia", "Alejandro Lince", "Mingqiu Wang", "Basil Mustafa", "Albert Webson", "Hyo Lee", "Rohan Anil", "Martin Wicke", "Timothy Dozat", "Abhishek Sinha", "Enrique Piqueras", "Elahe Dabir", "Shyam Upadhyay", "Anudhyan Boral", "Lisa Anne Hendricks", "Corey Fry", "Josip Djolonga", "Yi Su", "Jake Walker", "Jane Labanowski", "Ronny Huang", "Vedant Misra", "Jeremy Chen", "RJ Skerry-Ryan", "Avi Singh", "Shruti Rijhwani", "Dian Yu", "Alex Castro-Ros", "Beer Changpinyo", "Romina Datta", "Sumit Bagri", "Arnar Mar Hrafnkelsson", "Marcello Maggioni", "Daniel Zheng", "Yury Sulsky", "Shaobo Hou", "Tom Le Paine", "Antoine Yang", "Jason Riesa", "Dominika Rogozinska", "Dror Marcus", "Dalia El Badawy", "Qiao Zhang", "Luyu Wang", "Helen Miller", "Jeremy Greer", "Lars Lowe Sjos", "Azade Nova", "Heiga Zen", "Rahma Chaabouni", "Mihaela Rosca", "Jiepu Jiang", "Charlie Chen", "Ruibo Liu", "Tara Sainath", "Maxim Krikun", "Alex Polozov", "Jean-Baptiste Lespiau", "Josh Newlan", "Zeyncep Cankara", "Soo Kwak", "Yunhan Xu", "Phil Chen", "Andy Coenen", "Clemens Meyer", "Katerina Tsihlas", "Ada Ma", "Juraj Gottweis", "Jinwei Xing", "Chenjie Gu", "Jin Miao", "Christian Frank", "Zeynep Cankara", "Sanjay Ganapathy", "Ishita Dasgupta", "Steph Hughes-Fitt", "Heng Chen", "David Reid", "Keran Rong", "Hongmin Fan", "Joost van Amersfoort", "Vincent Zhuang", "Aaron Cohen", "Shixiang Shane Gu", "Anhad Mohananey", "Anastasija Ilic", "Taylor Tobin", "John Wieting", "Anna Bortsova", "Phoebe Thacker", "Emma Wang", "Emily Caveness", "Justin Chiu", "Eren Sezener", "Alex Kaskasoli", "Steven Baker", "Katie Millican", "Mohamed Elhawaty", "Kostas Aisopos", "Carl Lebsack", "Nathan Byrd", "Hanjun Dai", "Wenhao Jia", "Matthew Wiethoff", "Elnaz Davoodi", "Albert Weston", "Lakshman Yagati", "Arun Ahuja", "Isabel Gao", "Golan Pundak", "Susan Zhang", "Michael Azzam", "Khe Chai Sim", "Sergi Caelles", "James Keeling", "Abhanshu Sharma", "Andy Swing", "YaGuang Li", "Chenxi Liu", "Carrie Grimes Bostock", "Yamini Bansal", "Zachary Nado", "Ankesh Anand", "Josh Lipschultz", "Abhijit Karmarkar", "Lev Proleev", "Abe Ittycheriah", "Soheil Hassas Yeganeh", "George Polovets", "Aleksandra Faust", "Jiao Sun", "Alban Rrustemi", "Pen Li", "Rakesh Shivanna", "Jeremiah Liu", "Chris Welty", "Federico Lebron", "Anirudh Baddepudi", "Sebastian Krause", "Emilio Parisotto", "Radu Soricut", "Zheng Xu", "Dawn Bloxwich", "Melvin Johnson", "Behnam Neyshabur", "Justin Mao-Jones", "Renshen Wang", "Vinay Ramasesh", "Zaheer Abbas", "Arthur Guez", "Constant Segal", "Duc Dung Nguyen", "James Svensson", "Le Hou", "Sarah York", "Kieran Milan", "Sophie Bridgers", "Wiktor Gworek", "Marco Tagliasacchi", "James Lee-Thorp", "Michael Chang", "Alexey Guseynov", "Ale Jakse Hartman", "Michael Kwong", "Ruizhe Zhao", "Sheleem Kashem", "Elizabeth Cole", "Antoine Miech", "Richard Tanburn", "Mary Phuong", "Filip Pavetic", "Sebastien Cevey", "Ramona Comanescu", "Richard Ives", "Sherry Yang", "Cosmo Du", "Bo Li", "Zizhao Zhang", "Mariko Iinuma", "Clara Huiyi Hu", "Aurko Roy", "Shaan Bijwadia", "Zhenkai Zhu", "Danilo Martins", "Rachel Saputro", "Anita Gergely", "Steven Zheng", "Dawei Jia", "Ioannis Antonoglou", "Adam Sadovsky", "Shane Gu", "Yingying Bi", "Alek Andreev", "Sina Samangooei", "Mina Khan", "Tomas Kocisky", "Angelos Filos", "Chintu Kumar", "Colton Bishop", "Adams Yu", "Sarah Hodkinson", "Sid Mittal", "Premal Shah", "Alexandre Moufarek", "Yong Cheng", "Adam Bloniarz", "Jaehoon Lee", "Pedram Pejman", "Paul Michel", "Stephen Spencer", "Vladimir Feinberg", "Xuehan Xiong", "Nikolay Savinov", "Charlotte Smith", "Siamak Shakeri", "Dustin Tran", "Mary Chesus", "Bernd Bohnet", "George Tucker", "Tamara von Glehn", "Carrie Muir", "Yiran Mao", "Hideto Kazawa", "Ambrose Slone", "Kedar Soparkar", "Disha Shrivastava", "James Cobon-Kerr", "Michael Sharman", "Jay Pavagadhi", "Carlos Araya", "Karolis Misiunas", "Nimesh Ghelani", "Michael Laskin", "David Barker", "Qiujia Li", "Anton Briukhov", "Neil Houlsby", "Mia Glaese", "Balaji Lakshminarayanan", "Nathan Schucher", "Yunhao Tang", "Eli Collins", "Hyeontaek Lim", "Fangxiaoyu Feng", "Adria Recasens", "Guangda Lai", "Alberto Magni", "Nicola De Cao", "Aditya Siddhant", "Zoe Ashwood", "Jordi Orbay", "Mostafa Dehghani", "Jenny Brennan", "Yifan He", "Kelvin Xu", "Yang Gao", "Carl Saroufim", "James Molloy", "Xinyi Wu", "Seb Arnold", "Solomon Chang", "Julian Schrittwieser", "Elena Buchatskaya", "Soroush Radpour", "Martin Polacek", "Skye Giordano", "Ankur Bapna", "Simon Tokumine", "Vincent Hellendoorn", "Thibault Sottiaux", "Sarah Cogan", "Aliaksei Severyn", "Mohammad Saleh", "Shantanu Thakoor", "Laurent Shefey", "Siyuan Qiao", "Meenu Gaba", "Shuo-yiin Chang", "Craig Swanson", "Biao Zhang", "Benjamin Lee", "Paul Kishan Rubenstein", "Gan Song", "Tom Kwiatkowski", "Anna Koop", "Ajay Kannan", "David Kao", "Parker Schuh", "Axel Stjerngren", "Golnaz Ghiasi", "Gena Gibson", "Luke Vilnis", "Ye Yuan", "Felipe Tiengo Ferreira", "Aishwarya Kamath", "Ted Klimenko", "Ken Franko", "Kefan Xiao", "Indro Bhattacharya", "Miteyan Patel", "Rui Wang", "Alex Morris", "Robin Strudel", "Vivek Sharma", "Peter Choy", "Sayed Hadi Hashemi", "Jessica Landon", "Mara Finkelstein", "Priya Jhakra", "Justin Frye", "Megan Barnes", "Matthew Mauger", "Dennis Daun", "Khuslen Baatarsukh", "Matthew Tung", "Wael Farhan", "Henryk Michalewski", "Fabio Viola", "Felix de Chaumont Quitry", "Charline Le Lan", "Tom Hudson", "Qingze Wang", "Felix Fischer", "Ivy Zheng", "Elspeth White", "Anca Dragan", "Jean-baptiste Alayrac", "Eric Ni", "Alexander Pritzel", "Adam Iwanicki", "Michael Isard", "Anna Bulanova", "Lukas Zilka", "Ethan Dyer", "Devendra Sachan", "Srivatsan Srinivasan", "Hannah Muckenhirn", "Honglong Cai", "Amol Mandhane", "Mukarram Tariq", "Jack W. Rae", "Gary Wang", "Kareem Ayoub", "Nicholas FitzGerald", "Yao Zhao", "Woohyun Han", "Chris Alberti", "Dan Garrette", "Kashyap Krishnakumar", "Mai Gimenez", "Anselm Levskaya", "Daniel Sohn", "Josip Matak", "Inaki Iturrate", "Michael B. Chang", "Jackie Xiang", "Yuan Cao", "Nishant Ranka", "Geoff Brown", "Adrian Hutter", "Vahab Mirrokni", "Nanxin Chen", "Kaisheng Yao", "Zoltan Egyed", "Francois Galilee", "Tyler Liechty", "Praveen Kallakuri", "Evan Palmer", "Sanjay Ghemawat", "Jasmine Liu", "David Tao", "Chloe Thornton", "Tim Green", "Mimi Jasarevic", "Sharon Lin", "Victor Cotruta", "Yi-Xuan Tan", "Noah Fiedel", "Hongkun Yu", "Ed Chi", "Alexander Neitz", "Jens Heitkaemper", "Anu Sinha", "Denny Zhou", "Yi Sun", "Charbel Kaed", "Brice Hulse", "Swaroop Mishra", "Maria Georgaki", "Sneha Kudugunta", "Clement Farabet", "Izhak Shafran", "Daniel Vlasic", "Anton Tsitsulin", "Rajagopal Ananthanarayanan", "Alen Carin", "Guolong Su", "Pei Sun", "Shashank V", "Gabriel Carvajal", "Josef Broder", "Iulia Comsa", "Alena Repina", "William Wong", "Warren Weilun Chen", "Peter Hawkins", "Egor Filonov", "Lucia Loher", "Christoph Hirnschall", "Weiyi Wang", "Jingchen Ye", "Andrea Burns", "Hardie Cate", "Diana Gage Wright", "Federico Piccinini", "Lei Zhang", "Chu-Cheng Lin", "Ionel Gog", "Yana Kulizhskaya", "Ashwin Sreevatsa", "Shuang Song", "Luis C. Cobo", "Anand Iyer", "Chetan Tekur", "Guillermo Garrido", "Zhuyun Xiao", "Rupert Kemp", "Huaixiu Steven Zheng", "Hui Li", "Ananth Agarwal", "Christel Ngani", "Kati Goshvadi", "Rebeca Santamaria-Fernandez", "Wojciech Fica", "Xinyun Chen", "Chris Gorgolewski", "Sean Sun", "Roopal Garg", "Xinyu Ye", "S. M. Ali Eslami", "Nan Hua", "Jon Simon", "Pratik Joshi", "Yelin Kim", "Ian Tenney", "Sahitya Potluri", "Lam Nguyen Thiet", "Quan Yuan", "Florian Luisier", "Alexandra Chronopoulou", "Salvatore Scellato", "Praveen Srinivasan", "Minmin Chen", "Vinod Koverkathu", "Valentin Dalibard", "Yaming Xu", "Brennan Saeta", "Keith Anderson", "Thibault Sellam", "Nick Fernando", "Fantine Huot", "Junehyuk Jung", "Mani Varadarajan", "Michael Quinn", "Amit Raul", "Maigo Le", "Ruslan Habalov", "Jon Clark", "Komal Jalan", "Kalesha Bullard", "Achintya Singhal", "Thang Luong", "Boyu Wang", "Sujeevan Rajayogam", "Julian Eisenschlos", "Johnson Jia", "Daniel Finchelstein", "Alex Yakubovich", "Daniel Balle", "Michael Fink", "Sameer Agarwal", "Jing Li", "Dj Dvijotham", "Shalini Pal", "Kai Kang", "Jaclyn Konzelmann", "Jennifer Beattie", "Olivier Dousse", "Diane Wu", "Remi Crocker", "Chen Elkind", "Siddhartha Reddy Jonnalagadda", "Jong Lee", "Dan Holtmann-Rice", "Krystal Kallarackal", "Rosanne Liu", "Denis Vnukov", "Neera Vats", "Luca Invernizzi", "Mohsen Jafari", "Huanjie Zhou", "Lilly Taylor", "Jennifer Prendki", "Marcus Wu", "Tom Eccles", "Tianqi Liu", "Kavya Kopparapu", "Francoise Beaufays", "Christof Angermueller", "Andreea Marzoca", "Shourya Sarcar", "Hilal Dib", "Jeff Stanway", "Frank Perbet", "Nejc Trdin", "Rachel Sterneck", "Andrey Khorlin", "Dinghua Li", "Xihui Wu", "Sonam Goenka", "David Madras", "Sasha Goldshtein", "Willi Gierke", "Tong Zhou", "Yaxin Liu", "Yannie Liang", "Anais White", "Yunjie Li", "Shreya Singh", "Sanaz Bahargam", "Mark Epstein", "Sujoy Basu", "Li Lao", "Adnan Ozturel", "Carl Crous", "Alex Zhai", "Han Lu", "Zora Tung", "Neeraj Gaur", "Alanna Walton", "Lucas Dixon", "Ming Zhang", "Amir Globerson", "Grant Uy", "Andrew Bolt", "Olivia Wiles", "Milad Nasr", "Ilia Shumailov", "Marco Selvi", "Francesco Piccinno", "Ricardo Aguilar", "Sara McCarthy", "Misha Khalman", "Mrinal Shukla", "Vlado Galic", "John Carpenter", "Kevin Villela", "Haibin Zhang", "Harry Richardson", "James Martens", "Matko Bosnjak", "Shreyas Rammohan Belle", "Jeff Seibert", "Mahmoud Alnahlawi", "Brian McWilliams", "Sankalp Singh", "Annie Louis", "Wen Ding", "Dan Popovici", "Lenin Simicich", "Laura Knight", "Pulkit Mehta", "Nishesh Gupta", "Chongyang Shi", "Saaber Fatehi", "Jovana Mitrovic", "Alex Grills", "Joseph Pagadora", "Tsendsuren Munkhdalai", "Dessie Petrova", "Danielle Eisenbud", "Zhishuai Zhang", "Damion Yates", "Bhavishya Mittal", "Nilesh Tripuraneni", "Yannis Assael", "Thomas Brovelli", "Prateek Jain", "Mihajlo Velimirovic", "Canfer Akbulut", "Jiaqi Mu", "Wolfgang Macherey", "Ravin Kumar", "Jun Xu", "Haroon Qureshi", "Gheorghe Comanici", "Jeremy Wiesner", "Zhitao Gong", "Anton Ruddock", "Matthias Bauer", "Nick Felt", "Anirudh GP", "Anurag Arnab", "Dustin Zelle", "Jonas Rothfuss", "Bill Rosgen", "Ashish Shenoy", "Bryan Seybold", "Xinjian Li", "Jayaram Mudigonda", "Goker Erdogan", "Jiawei Xia", "Jiri Simsa", "Andrea Michi", "Yi Yao", "Christopher Yew", "Steven Kan", "Isaac Caswell", "Carey Radebaugh", "Andre Elisseeff", "Pedro Valenzuela", "Kay McKinney", "Kim Paterson", "Albert Cui", "Eri Latorre-Chimoto", "Solomon Kim", "William Zeng", "Ken Durden", "Priya Ponnapalli", "Tiberiu Sosea", "Christopher A. Choquette-Choo", "James Manyika", "Brona Robenek", "Harsha Vashisht", "Sebastien Pereira", "Hoi Lam", "Marko Velic", "Denese Owusu-Afriyie", "Katherine Lee", "Tolga Bolukbasi", "Alicia Parrish", "Shawn Lu", "Jane Park", "Balaji Venkatraman", "Alice Talbert", "Lambert Rosique", "Yuchung Cheng", "Andrei Sozanschi", "Adam Paszke", "Praveen Kumar", "Jessica Austin", "Lu Li", "Khalid Salama", "Bartek Perz", "Wooyeol Kim", "Nandita Dukkipati", "Anthony Baryshnikov", "Christos Kaplanis", "XiangHai Sheng", "Yuri Chervonyi", "Caglar Unlu", "Diego de Las Casas", "Harry Askham", "Kathryn Tunyasuvunakool", "Felix Gimeno", "Siim Poder", "Chester Kwak", "Matt Miecnikowski", "Vahab Mirrokni", "Alek Dimitriev", "Aaron Parisi", "Dangyi Liu", "Tomy Tsai", "Toby Shevlane", "Christina Kouridi", "Drew Garmon", "Adrian Goedeckemeyer", "Adam R. Brown", "Anitha Vijayakumar", "Ali Elqursh", "Sadegh Jazayeri", "Jin Huang", "Sara Mc Carthy", "Jay Hoover", "Lucy Kim", "Sandeep Kumar", "Wei Chen", "Courtney Biles", "Garrett Bingham", "Evan Rosen", "Lisa Wang", "Qijun Tan", "David Engel", "Francesco Pongetti", "Dario de Cesare", "Dongseong Hwang", "Lily Yu", "Jennifer Pullman", "Srini Narayanan", "Kyle Levin", "Siddharth Gopal", "Megan Li", "Asaf Aharoni", "Trieu Trinh", "Jessica Lo", "Norman Casagrande", "Roopali Vij", "Loic Matthey", "Bramandia Ramadhana", "Austin Matthews", "CJ Carey", "Matthew Johnson", "Kremena Goranova", "Rohin Shah", "Shereen Ashraf", "Kingshuk Dasgupta", "Rasmus Larsen", "Yicheng Wang", "Manish Reddy Vuyyuru", "Chong Jiang", "Joana Ijazi", "Kazuki Osawa", "Celine Smith", "Ramya Sree Boppana", "Taylan Bilal", "Yuma Koizumi", "Ying Xu", "Yasemin Altun", "Nir Shabat", "Ben Bariach", "Alex Korchemniy", "Kiam Choo", "Olaf Ronneberger", "Chimezie Iwuanyanwu", "Shubin Zhao", "David Soergel", "Cho-Jui Hsieh", "Irene Cai", "Shariq Iqbal", "Martin Sundermeyer", "Zhe Chen", "Elie Bursztein", "Chaitanya Malaviya", "Fadi Biadsy", "Prakash Shroff", "Inderjit Dhillon", "Tejasi Latkar", "Chris Dyer", "Hannah Forbes", "Massimo Nicosia", "Vitaly Nikolaev", "Somer Greene", "Marin Georgiev", "Pidong Wang", "Nina Martin", "Hanie Sedghi", "John Zhang", "Praseem Banzal", "Doug Fritz", "Vikram Rao", "Xuezhi Wang", "Jiageng Zhang", "Viorica Patraucean", "Dayou Du", "Igor Mordatch", "Ivan Jurin", "Lewis Liu", "Ayush Dubey", "Abhi Mohan", "Janek Nowakowski", "Vlad-Doru Ion", "Nan Wei", "Reiko Tojo", "Maria Abi Raad", "Drew A. Hudson", "Vaishakh Keshava", "Shubham Agrawal", "Kevin Ramirez", "Zhichun Wu", "Hoang Nguyen", "Ji Liu", "Madhavi Sewak", "Bryce Petrini", "DongHyun Choi", "Ivan Philips", "Ziyue Wang", "Ioana Bica", "Ankush Garg", "Jarek Wilkiewicz", "Priyanka Agrawal", "Xiaowei Li", "Danhao Guo", "Emily Xue", "Naseer Shaik", "Andrew Leach", "Sadh MNM Khan", "Julia Wiesinger", "Sammy Jerome", "Abhishek Chakladar", "Alek Wenjiao Wang", "Tina Ornduff", "Folake Abu", "Alireza Ghaffarkhah", "Marcus Wainwright", "Mario Cortes", "Frederick Liu", "Joshua Maynez", "Andreas Terzis", "Pouya Samangouei", "Riham Mansour", "Tomasz Kępa", "François-Xavier Aubet", "Anton Algymr", "Dan Banica", "Agoston Weisz", "Andras Orban", "Alexandre Senges", "Ewa Andrejczuk", "Mark Geller", "Niccolo Dal Santo", "Valentin Anklin", "Majd Al Merey", "Martin Baeuml", "Trevor Strohman", "Junwen Bai", "Slav Petrov", "Yonghui Wu", "Demis Hassabis", "Koray Kavukcuoglu", "Jeff Dean", "Oriol Vinyals"] year: 2024 venue: "arXiv:2403.05530" source: "https://arxiv.org/abs/2403.05530" doi: "10.48550/arxiv.2403.05530" arxiv: "2403.05530" licence: "CC BY 4.0 (arXiv)" licence_url: "http://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/gemini-2024-team-gemini-1-5-unlocking-multimodal/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/gemini-2024-team-gemini-1-5-unlocking-multimodal/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2024](https://md.research.elamur.ai/free/en/papers/2024/page/2/) / Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context # Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context **Authors:** [Gemini Team](https://md.research.elamur.ai/free/en/authors/gemini-team/), Petko Georgiev, Ving Ian Lei, Ryan Burnell, Libin Bai, [Anmol Gulati](https://md.research.elamur.ai/free/en/authors/anmol-gulati/), Garrett Tanzer, [Damien Vincent](https://md.research.elamur.ai/free/en/authors/damien-vincent/), Zhufeng Pan, [Shibo Wang](https://md.research.elamur.ai/free/en/authors/shibo-wang/), Soroosh Mariooryad, Yifan Ding et al. (1137 authors) · **Year:** 2024 · **Venue:** arXiv:2403.05530 · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://arxiv.org/abs/2403.05530) · [PDF](https://arxiv.org/pdf/2403.05530) · [DOI 10.48550/arxiv.2403.05530](https://doi.org/10.48550/arxiv.2403.05530) · [arXiv 2403.05530](https://arxiv.org/abs/2403.05530) · [OpenAlex](https://openalex.org/W4392679398) **Citations:** 301 citations (openalex-snapshot · 2026-10-14) · [1221](#cited-by) in our library, of the 140673 papers whose bibliographies we read ## Summary This Google technical report presents the Gemini 1.5 family of multimodal models, built to handle very long inputs. Contemporaries such as GPT-4 Turbo (128k) and Claude 3.0 (200k) have much shorter context windows. Two models are described: Gemini 1.5 Flash, a lighter and faster variant, and a May 2024 update to Gemini 1.5 Pro. They rely on sparse and dense scaling plus improved training, distillation and serving infrastructure, and they accept text, audio and video contexts of millions of tokens. Evaluation combines synthetic needle-in-a-haystack retrieval with realistic tasks: long-document and long-video QA, long-context ASR, in-context planning, and standard benchmarks for math, code, vision and multilinguality. Retrieval stays above 99% up to 10M tokens, and the long context does not weaken core skills. Gemini 1.5 Pro beats Gemini 1.0 Ultra on most benchmarks while needing less training compute. A striking demonstration is learning English–Kalamang translation purely from documentation placed in the prompt. For low-resource language work, this suggests that long context can partly substitute for training data. ## Key points - Needle recall exceeds 99.7% up to 1M tokens in all modalities. Recall holds at about 10M tokens of text (≈7M words), 9.7M tokens of audio (≈107 h) and 9.9M tokens of video (≈10.5 h). - Kalamang has fewer than 200 speakers. Given a ~500-page grammar, a dictionary and ~400 parallel sentences in context, the models translate English→Kalamang about as well as a human who studied the same materials. Adding 45 minutes of transcribed speech enables in-context speech recognition for the language. - Win rates: 1.5 Pro outperforms 1.0 Pro on 44/50 benchmarks and 1.0 Ultra on 35/45. 1.5 Flash outperforms 1.0 Pro on 41/50. - The May update improves on the February version by over 10% relative on average. Examples include MATH (58.5→67.7%), GPQA (41.5→46.2%) and MathVista (52.1→63.9%). - In real-world tests, professionals saved 26–75% of task time across 10 job categories. The authors also recommend multiple-needle setups for harder long-context evaluation. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* Fields: [Other](https://md.research.elamur.ai/free/en/shelves/other/) ## Cited by Cited by 1221 papers of our library cite it (of the 140673 whose bibliographies we read); 55 of them have a page here, 1166 not yet. - [Many-Shot In-Context Learning](https://md.research.elamur.ai/free/en/papers/agarwal-2024-many-shot-context-learning/) - [LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitasks](https://md.research.elamur.ai/free/en/papers/bai-2024-longbench-v2-deeper-understanding/) - [LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks](https://md.research.elamur.ai/free/en/papers/bavaresco-2024-llms-instead-human-judges-large/) - [Translating Step-by-Step: Decomposing the Translation Process for Improved Translation Quality of Long-Form Texts](https://md.research.elamur.ai/free/en/papers/briakou-2024-translating-step-step-decomposing-translation/) - [Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling](https://md.research.elamur.ai/free/en/papers/chen-2024-expanding-performance-boundaries-open/) - [How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suites](https://md.research.elamur.ai/free/en/papers/chen-2024-far-gpt-4v-closing/) - [Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models](https://md.research.elamur.ai/free/en/papers/chen-2025-towards-reasoning-era-survey-long/) - [Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory](https://md.research.elamur.ai/free/en/papers/chhikara-2025-mem0-building-production-ready-ai/) - [Qwen2-Audio Technical Report](https://md.research.elamur.ai/free/en/papers/chu-2024-qwen2-audio-technical-report/) - [Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities](https://md.research.elamur.ai/free/en/papers/comanici-2025-gemini-2-5-pushing-frontier/) - [DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence](https://md.research.elamur.ai/free/en/papers/deepseek-2024-ai-deepseek-coder-v2-breaking-barrier/) - [Moshi: a speech-text foundation model for real-time dialogue](https://md.research.elamur.ai/free/en/papers/defossez-2024-moshi-speech-text-foundation-model/) - [Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Models](https://md.research.elamur.ai/free/en/papers/deitke-2024-molmo-pixmo-open-weights-open/) - [Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis](https://md.research.elamur.ai/free/en/papers/fu-2024-video-mme-first-ever-comprehensive/) - [HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models](https://md.research.elamur.ai/free/en/papers/gutierrez-2024-hipporag-neurobiologically-inspired-long-term/) - [WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs](https://md.research.elamur.ai/free/en/papers/han-2024-wildguard-open-one-stop-moderation/) - [RULER: What's the Real Context Size of Your Long-Context Language Models?](https://md.research.elamur.ai/free/en/papers/hsieh-2024-ruler-s-real-context-size/) - [A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions](https://md.research.elamur.ai/free/en/papers/huang-2023-survey-hallucination-large-language-models/) - [LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code](https://md.research.elamur.ai/free/en/papers/jain-2024-livecodebench-holistic-contamination-free-evaluation/) - [MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention](https://md.research.elamur.ai/free/en/papers/jiang-2024-minference-1-0-accelerating-pre/) - [A Survey on Large Language Models for Code Generation](https://md.research.elamur.ai/free/en/papers/jiang-2024-survey-large-language-models-code/) - [Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning](https://md.research.elamur.ai/free/en/papers/jin-2025-search-r1-training-llms-reason/) - [Comparative Study of Multilingual Idioms and Similes in Large Language Models](https://md.research.elamur.ai/free/en/papers/khoshtab-2025-comparative-study-multilingual-idioms-similes/) - [Tulu 3: Pushing Frontiers in Open Language Model Post-Training](https://md.research.elamur.ai/free/en/papers/lambert-2024-tulu-3-pushing-frontiers-open/) - [What matters when building vision-language models?](https://md.research.elamur.ai/free/en/papers/lauren-2024-ccon-matters-building-vision-language-models/) - [From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline](https://md.research.elamur.ai/free/en/papers/li-2024-crowdsourced-data-high-quality-benchmarks/) - [LLaVA-OneVision: Easy Visual Task Transfer](https://md.research.elamur.ai/free/en/papers/li-2024-llava-onevision-easy-visual-task/) - [Long-context LLMs Struggle with Long In-context Learning](https://md.research.elamur.ai/free/en/papers/li-2024-long-context-llms-struggle-long/) - [SnapKV: LLM Knows What You are Looking for Before Generation](https://md.research.elamur.ai/free/en/papers/li-2024-snapkv-llm-knows-looking-before/) - [KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache](https://md.research.elamur.ai/free/en/papers/liu-2024-kivi-tuning-free-asymmetric-2bit/) - [Skywork-Reward: Bag of Tricks for Reward Modeling in LLMs](https://md.research.elamur.ai/free/en/papers/liu-2024-skywork-reward-bag-tricks/) - [Improve Mathematical Reasoning in Language Models by Automated Process Supervision](https://md.research.elamur.ai/free/en/papers/luo-2024-improve-mathematical-reasoning-language-models/) - [A Large-Scale Instruction-Tuning Dataset and Models for Slovenian Vision-Language Tasks](https://md.research.elamur.ai/free/en/papers/martinc-2026-large-scale-instruction-tuning-dataset/) - [Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs](https://md.research.elamur.ai/free/en/papers/microsoft-2025-phi-4-mini-technical-report/) - [A Comprehensive Overview of Large Language Models](https://md.research.elamur.ai/free/en/papers/naveed-2023-comprehensive-overview-large-language-models/) - [Humanity's Last Exam](https://md.research.elamur.ai/free/en/papers/phan-2025-humanity-s-last-exam/) - [UI-TARS: Pioneering Automated GUI Interaction with Native Agents](https://md.research.elamur.ai/free/en/papers/qin-2025-ui-tars-pioneering-automated/) - [Culturally-Aware Image Captioning for Guaraní with Multimodal Prompting: IUHoosiers at AmericasNLP 2026](https://md.research.elamur.ai/free/en/papers/shi-2026-culturally-aware-image-captioning-guarani/) - [MultiWikiQA: A Reading Comprehension Benchmark in 300+ Languages](https://md.research.elamur.ai/free/en/papers/smart-2026-multiwikiqa-reading-comprehension-benchmark-300/) - [Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters](https://md.research.elamur.ai/free/en/papers/snell-2024-scaling-llm-test-time-compute/) - [To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoning](https://md.research.elamur.ai/free/en/papers/sprague-2024-cot-cot-chain-thought-helps/) - [MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark](https://md.research.elamur.ai/free/en/papers/wang-2024-mmlu-pro-more-robust-challenging/) - [基于大模型的具身智能系统综述](https://md.research.elamur.ai/free/en/papers/wang-2025-embodied-intelligence-systems/) - [InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency](https://md.research.elamur.ai/free/en/papers/wang-2025-internvl3-5-advancing-open/) - [DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding](https://md.research.elamur.ai/free/en/papers/wu-2024-deepseek-vl2-mixture-experts/) - [OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments](https://md.research.elamur.ai/free/en/papers/xie-2024-osworld-benchmarking-multimodal-agents-open/) - [Qwen2.5-Omni Technical Report](https://md.research.elamur.ai/free/en/papers/xu-2025-qwen2-5-omni-technical/) - [Qwen3-Omni Technical Report](https://md.research.elamur.ai/free/en/papers/xu-2025-qwen3-omni-technical-report/) - [MiniCPM-V: A GPT-4V Level MLLM on Your Phone](https://md.research.elamur.ai/free/en/papers/yao-2024-minicpm-v-gpt-4v/) - [Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention](https://md.research.elamur.ai/free/en/papers/yuan-2025-native-sparse-attention-hardware/) - [MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI](https://md.research.elamur.ai/free/en/papers/yue-2023-mmmu-massive-multi-discipline-multimodal/) - [Multimodal Chain-of-Thought Reasoning in Language Models](https://md.research.elamur.ai/free/en/papers/zhang-2023-multimodal-chain-thought-reasoning-language/) - [Generative Verifiers: Reward Modeling as Next-Token Prediction](https://md.research.elamur.ai/free/en/papers/zhang-2024-generative-verifiers-reward-modeling-as/) - [大语言模型的工具使用综述](https://md.research.elamur.ai/free/en/papers/zheng-2025-tool-use-large/) - [InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models](https://md.research.elamur.ai/free/en/papers/zhu-2025-internvl3-exploring-advanced-training/) ## Cite The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @misc{team2024gemini, title = {{Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context}}, author = {Team, Gemini and Georgiev, Petko and Lei, Ving Ian and Burnell, Ryan and Bai, Libin and Gulati, Anmol and Tanzer, Garrett and Vincent, Damien and Pan, Zhufeng and Wang, Shibo and Mariooryad, Soroosh and Ding, Yifan and Geng, Xinyang and Alcober, Fred and Frostig, Roy and Omernick, Mark and Walker, Lexi and Paduraru, Cosmin and Sorokin, Christina and Tacchetti, Andrea and Gaffney, Colin and Daruki, Samira and Sercinoglu, Olcan and Gleicher, Zach and Love, Juliette and Voigtlaender, Paul and Jain, Rohan and Surita, Gabriela and Mohamed, Kareem and Blevins, Rory and Ahn, Junwhan and Zhu, Tao and Kawintiranon, Kornraphop and Firat, Orhan and Gu, Yiming and Zhang, Yujing and Rahtz, Matthew and Faruqui, Manaal and Clay, Natalie and Gilmer, Justin and Co-Reyes, JD and Penchev, Ivo and Zhu, Rui and Morioka, Nobuyuki and Hui, Kevin and Haridasan, Krishna and Campos, Victor and Mahdieh, Mahdis and Guo, Mandy and Hassan, Samer and Kilgour, Kevin and Vezer, Arpi and Cheng, Heng-Tze and Liedekerke, Raoul de and Goyal, Siddharth and Barham, Paul and Strouse, DJ and Noury, Seb and Adler, Jonas and Sundararajan, Mukund and Vikram, Sharad and Lepikhin, Dmitry and Paganini, Michela and Garcia, Xavier and Yang, Fan and Valter, Dasha and Trebacz, Maja and Vodrahalli, Kiran and Asawaroengchai, Chulayuth and Ring, Roman and Kalb, Norbert and Soares, Livio Baldini and Brahma, Siddhartha and Steiner, David and Yu, Tianhe and Mentzer, Fabian and He, Antoine and Gonzalez, Lucas and Xu, Bibo and Kaufman, Raphael Lopez and Shafey, Laurent El and Oh, Junhyuk and Hennigan, Tom and Driessche, George van den and Odoom, Seth and Lucic, Mario and Roelofs, Becca and Lall, Sid and Marathe, Amit and Chan, Betty and Ontanon, Santiago and He, Luheng and Teplyashin, Denis and Lai, Jonathan and Crone, Phil and Damoc, Bogdan and Ho, Lewis and Riedel, Sebastian and Lenc, Karel and Yeh, Chih-Kuan and Chowdhery, Aakanksha and Xu, Yang and Kazemi, Mehran and Amid, Ehsan and Petrushkina, Anastasia and Swersky, Kevin and Khodaei, Ali and Chen, Gowoon and Larkin, Chris and Pinto, Mario and Yan, Geng and Badia, Adria Puigdomenech and Patil, Piyush and Hansen, Steven and Orr, Dave and Arnold, Sebastien M. R. and Grimstad, Jordan and Dai, Andrew and Douglas, Sholto and Sinha, Rishika and Yadav, Vikas and Chen, Xi and Gribovskaya, Elena and Austin, Jacob and Zhao, Jeffrey and Patel, Kaushal and Komarek, Paul and Austin, Sophia and Borgeaud, Sebastian and Friso, Linda and Goyal, Abhimanyu and Caine, Ben and Cao, Kris and Chung, Da-Woon and Lamm, Matthew and Barth-Maron, Gabe and Kagohara, Thais and Olszewska, Kate and Chen, Mia and Shivakumar, Kaushik and Agarwal, Rishabh and Godhia, Harshal and Rajwar, Ravi and Snaider, Javier and Dotiwalla, Xerxes and Liu, Yuan and Barua, Aditya and Ungureanu, Victor and Zhang, Yuan and Batsaikhan, Bat-Orgil and Wirth, Mateo and Qin, James and Danihelka, Ivo and Doshi, Tulsee and Chadwick, Martin and Chen, Jilin and Jain, Sanil and Le, Quoc and Kar, Arjun and Gurumurthy, Madhu and Li, Cheng and Sang, Ruoxin and Liu, Fangyu and Lamprou, Lampros and Munoz, Rich and Lintz, Nathan and Mehta, Harsh and Howard, Heidi and Reynolds, Malcolm and Aroyo, Lora and Wang, Quan and Blanco, Lorenzo and Cassirer, Albin and Griffith, Jordan and Das, Dipanjan and Lee, Stephan and Sygnowski, Jakub and Fisher, Zach and Besley, James and Powell, Richard and Ahmed, Zafarali and Paulus, Dominik and Reitter, David and Borsos, Zalan and Joshi, Rishabh and Pope, Aedan and Hand, Steven and Selo, Vittorio and Jain, Vihan and Sethi, Nikhil and Goel, Megha and Makino, Takaki and May, Rhys and Yang, Zhen and Schalkwyk, Johan and Butterfield, Christina and Hauth, Anja and Goldin, Alex and Hawkins, Will and Senter, Evan and Brin, Sergey and Woodman, Oliver and Ritter, Marvin and Noland, Eric and Giang, Minh and Bolina, Vijay and Lee, Lisa and Blyth, Tim and Mackinnon, Ian and Reid, Machel and Sarvana, Obaid and Silver, David and Chen, Alexander and Wang, Lily and Maggiore, Loren and Chang, Oscar and Attaluri, Nithya and Thornton, Gregory and Chiu, Chung-Cheng and Bunyan, Oskar and Levine, Nir and Chung, Timothy and Eltyshev, Evgenii and Si, Xiance and Lillicrap, Timothy and Brady, Demetra and Aggarwal, Vaibhav and Wu, Boxi and Xu, Yuanzhong and McIlroy, Ross and Badola, Kartikeya and Sandhu, Paramjit and Moreira, Erica and Stokowiec, Wojciech and Hemsley, Ross and Li, Dong and Tudor, Alex and Shyam, Pranav and Rahimtoroghi, Elahe and Haykal, Salem and Sprechmann, Pablo and Zhou, Xiang and Mincu, Diana and Li, Yujia and Addanki, Ravi and Krishna, Kalpesh and Wu, Xiao and Frechette, Alexandre and Eyal, Matan and Dafoe, Allan and Lacey, Dave and Whang, Jay and Avrahami, Thi and Zhang, Ye and Taropa, Emanuel and Lin, Hanzhao and Toyama, Daniel and Rutherford, Eliza and Sano, Motoki and Choe, HyunJeong and Tomala, Alex and Safranek-Shrader, Chalence and Kassner, Nora and Pajarskas, Mantas and Harvey, Matt and Sechrist, Sean and Fortunato, Meire and Lyu, Christina and Elsayed, Gamaleldin and Kuang, Chenkai and Lottes, James and Chu, Eric and Jia, Chao and Chen, Chih-Wei and Humphreys, Peter and Baumli, Kate and Tao, Connie and Samuel, Rajkumar and Santos, Cicero Nogueira dos and Andreassen, Anders and Rakićević, Nemanja and Grewe, Dominik and Kumar, Aviral and Winkler, Stephanie and Caton, Jonathan and Brock, Andrew and Dalmia, Sid and Sheahan, Hannah and Barr, Iain and Miao, Yingjie and Natsev, Paul and Devlin, Jacob and Behbahani, Feryal and Prost, Flavien and Sun, Yanhua and Myaskovsky, Artiom and Pillai, Thanumalayan Sankaranarayana and Hurt, Dan and Lazaridou, Angeliki and Xiong, Xi and Zheng, Ce and Pardo, Fabio and Li, Xiaowei and Horgan, Dan and Stanton, Joe and Ambar, Moran and Xia, Fei and Lince, Alejandro and Wang, Mingqiu and Mustafa, Basil and Webson, Albert and Lee, Hyo and Anil, Rohan and Wicke, Martin and Dozat, Timothy and Sinha, Abhishek and Piqueras, Enrique and Dabir, Elahe and Upadhyay, Shyam and Boral, Anudhyan and Hendricks, Lisa Anne and Fry, Corey and Djolonga, Josip and Su, Yi and Walker, Jake and Labanowski, Jane and Huang, Ronny and Misra, Vedant and Chen, Jeremy and Skerry-Ryan, RJ and Singh, Avi and Rijhwani, Shruti and Yu, Dian and Castro-Ros, Alex and Changpinyo, Beer and Datta, Romina and Bagri, Sumit and Hrafnkelsson, Arnar Mar and Maggioni, Marcello and Zheng, Daniel and Sulsky, Yury and Hou, Shaobo and Paine, Tom Le and Yang, Antoine and Riesa, Jason and Rogozinska, Dominika and Marcus, Dror and Badawy, Dalia El and Zhang, Qiao and Wang, Luyu and Miller, Helen and Greer, Jeremy and Sjos, Lars Lowe and Nova, Azade and Zen, Heiga and Chaabouni, Rahma and Rosca, Mihaela and Jiang, Jiepu and Chen, Charlie and Liu, Ruibo and Sainath, Tara and Krikun, Maxim and Polozov, Alex and Lespiau, Jean-Baptiste and Newlan, Josh and Cankara, Zeyncep and Kwak, Soo and Xu, Yunhan and Chen, Phil and Coenen, Andy and Meyer, Clemens and Tsihlas, Katerina and Ma, Ada and Gottweis, Juraj and Xing, Jinwei and Gu, Chenjie and Miao, Jin and Frank, Christian and Cankara, Zeynep and Ganapathy, Sanjay and Dasgupta, Ishita and Hughes-Fitt, Steph and Chen, Heng and Reid, David and Rong, Keran and Fan, Hongmin and Amersfoort, Joost van and Zhuang, Vincent and Cohen, Aaron and Gu, Shixiang Shane and Mohananey, Anhad and Ilic, Anastasija and Tobin, Taylor and Wieting, John and Bortsova, Anna and Thacker, Phoebe and Wang, Emma and Caveness, Emily and Chiu, Justin and Sezener, Eren and Kaskasoli, Alex and Baker, Steven and Millican, Katie and Elhawaty, Mohamed and Aisopos, Kostas and Lebsack, Carl and Byrd, Nathan and Dai, Hanjun and Jia, Wenhao and Wiethoff, Matthew and Davoodi, Elnaz and Weston, Albert and Yagati, Lakshman and Ahuja, Arun and Gao, Isabel and Pundak, Golan and Zhang, Susan and Azzam, Michael and Sim, Khe Chai and Caelles, Sergi and Keeling, James and Sharma, Abhanshu and Swing, Andy and Li, YaGuang and Liu, Chenxi and Bostock, Carrie Grimes and Bansal, Yamini and Nado, Zachary and Anand, Ankesh and Lipschultz, Josh and Karmarkar, Abhijit and Proleev, Lev and Ittycheriah, Abe and Yeganeh, Soheil Hassas and Polovets, George and Faust, Aleksandra and Sun, Jiao and Rrustemi, Alban and Li, Pen and Shivanna, Rakesh and Liu, Jeremiah and Welty, Chris and Lebron, Federico and Baddepudi, Anirudh and Krause, Sebastian and Parisotto, Emilio and Soricut, Radu and Xu, Zheng and Bloxwich, Dawn and Johnson, Melvin and Neyshabur, Behnam and Mao-Jones, Justin and Wang, Renshen and Ramasesh, Vinay and Abbas, Zaheer and Guez, Arthur and Segal, Constant and Nguyen, Duc Dung and Svensson, James and Hou, Le and York, Sarah and Milan, Kieran and Bridgers, Sophie and Gworek, Wiktor and Tagliasacchi, Marco and Lee-Thorp, James and Chang, Michael and Guseynov, Alexey and Hartman, Ale Jakse and Kwong, Michael and Zhao, Ruizhe and Kashem, Sheleem and Cole, Elizabeth and Miech, Antoine and Tanburn, Richard and Phuong, Mary and Pavetic, Filip and Cevey, Sebastien and Comanescu, Ramona and Ives, Richard and Yang, Sherry and Du, Cosmo and Li, Bo and Zhang, Zizhao and Iinuma, Mariko and Hu, Clara Huiyi and Roy, Aurko and Bijwadia, Shaan and Zhu, Zhenkai and Martins, Danilo and Saputro, Rachel and Gergely, Anita and Zheng, Steven and Jia, Dawei and Antonoglou, Ioannis and Sadovsky, Adam and Gu, Shane and Bi, Yingying and Andreev, Alek and Samangooei, Sina and Khan, Mina and Kocisky, Tomas and Filos, Angelos and Kumar, Chintu and Bishop, Colton and Yu, Adams and Hodkinson, Sarah and Mittal, Sid and Shah, Premal and Moufarek, Alexandre and Cheng, Yong and Bloniarz, Adam and Lee, Jaehoon and Pejman, Pedram and Michel, Paul and Spencer, Stephen and Feinberg, Vladimir and Xiong, Xuehan and Savinov, Nikolay and Smith, Charlotte and Shakeri, Siamak and Tran, Dustin and Chesus, Mary and Bohnet, Bernd and Tucker, George and Glehn, Tamara von and Muir, Carrie and Mao, Yiran and Kazawa, Hideto and Slone, Ambrose and Soparkar, Kedar and Shrivastava, Disha and Cobon-Kerr, James and Sharman, Michael and Pavagadhi, Jay and Araya, Carlos and Misiunas, Karolis and Ghelani, Nimesh and Laskin, Michael and Barker, David and Li, Qiujia and Briukhov, Anton and Houlsby, Neil and Glaese, Mia and Lakshminarayanan, Balaji and Schucher, Nathan and Tang, Yunhao and Collins, Eli and Lim, Hyeontaek and Feng, Fangxiaoyu and Recasens, Adria and Lai, Guangda and Magni, Alberto and Cao, Nicola De and Siddhant, Aditya and Ashwood, Zoe and Orbay, Jordi and Dehghani, Mostafa and Brennan, Jenny and He, Yifan and Xu, Kelvin and Gao, Yang and Saroufim, Carl and Molloy, James and Wu, Xinyi and Arnold, Seb and Chang, Solomon and Schrittwieser, Julian and Buchatskaya, Elena and Radpour, Soroush and Polacek, Martin and Giordano, Skye and Bapna, Ankur and Tokumine, Simon and Hellendoorn, Vincent and Sottiaux, Thibault and Cogan, Sarah and Severyn, Aliaksei and Saleh, Mohammad and Thakoor, Shantanu and Shefey, Laurent and Qiao, Siyuan and Gaba, Meenu and Chang, Shuo-yiin and Swanson, Craig and Zhang, Biao and Lee, Benjamin and Rubenstein, Paul Kishan and Song, Gan and Kwiatkowski, Tom and Koop, Anna and Kannan, Ajay and Kao, David and Schuh, Parker and Stjerngren, Axel and Ghiasi, Golnaz and Gibson, Gena and Vilnis, Luke and Yuan, Ye and Ferreira, Felipe Tiengo and Kamath, Aishwarya and Klimenko, Ted and Franko, Ken and Xiao, Kefan and Bhattacharya, Indro and Patel, Miteyan and Wang, Rui and Morris, Alex and Strudel, Robin and Sharma, Vivek and Choy, Peter and Hashemi, Sayed Hadi and Landon, Jessica and Finkelstein, Mara and Jhakra, Priya and Frye, Justin and Barnes, Megan and Mauger, Matthew and Daun, Dennis and Baatarsukh, Khuslen and Tung, Matthew and Farhan, Wael and Michalewski, Henryk and Viola, Fabio and Quitry, Felix de Chaumont and Lan, Charline Le and Hudson, Tom and Wang, Qingze and Fischer, Felix and Zheng, Ivy and White, Elspeth and Dragan, Anca and Alayrac, Jean-baptiste and Ni, Eric and Pritzel, Alexander and Iwanicki, Adam and Isard, Michael and Bulanova, Anna and Zilka, Lukas and Dyer, Ethan and Sachan, Devendra and Srinivasan, Srivatsan and Muckenhirn, Hannah and Cai, Honglong and Mandhane, Amol and Tariq, Mukarram and Rae, Jack W. and Wang, Gary and Ayoub, Kareem and FitzGerald, Nicholas and Zhao, Yao and Han, Woohyun and Alberti, Chris and Garrette, Dan and Krishnakumar, Kashyap and Gimenez, Mai and Levskaya, Anselm and Sohn, Daniel and Matak, Josip and Iturrate, Inaki and Chang, Michael B. and Xiang, Jackie and Cao, Yuan and Ranka, Nishant and Brown, Geoff and Hutter, Adrian and Mirrokni, Vahab and Chen, Nanxin and Yao, Kaisheng and Egyed, Zoltan and Galilee, Francois and Liechty, Tyler and Kallakuri, Praveen and Palmer, Evan and Ghemawat, Sanjay and Liu, Jasmine and Tao, David and Thornton, Chloe and Green, Tim and Jasarevic, Mimi and Lin, Sharon and Cotruta, Victor and Tan, Yi-Xuan and Fiedel, Noah and Yu, Hongkun and Chi, Ed and Neitz, Alexander and Heitkaemper, Jens and Sinha, Anu and Zhou, Denny and Sun, Yi and Kaed, Charbel and Hulse, Brice and Mishra, Swaroop and Georgaki, Maria and Kudugunta, Sneha and Farabet, Clement and Shafran, Izhak and Vlasic, Daniel and Tsitsulin, Anton and Ananthanarayanan, Rajagopal and Carin, Alen and Su, Guolong and Sun, Pei and V, Shashank and Carvajal, Gabriel and Broder, Josef and Comsa, Iulia and Repina, Alena and Wong, William and Chen, Warren Weilun and Hawkins, Peter and Filonov, Egor and Loher, Lucia and Hirnschall, Christoph and Wang, Weiyi and Ye, Jingchen and Burns, Andrea and Cate, Hardie and Wright, Diana Gage and Piccinini, Federico and Zhang, Lei and Lin, Chu-Cheng and Gog, Ionel and Kulizhskaya, Yana and Sreevatsa, Ashwin and Song, Shuang and Cobo, Luis C. and Iyer, Anand and Tekur, Chetan and Garrido, Guillermo and Xiao, Zhuyun and Kemp, Rupert and Zheng, Huaixiu Steven and Li, Hui and Agarwal, Ananth and Ngani, Christel and Goshvadi, Kati and Santamaria-Fernandez, Rebeca and Fica, Wojciech and Chen, Xinyun and Gorgolewski, Chris and Sun, Sean and Garg, Roopal and Ye, Xinyu and Eslami, S. M. Ali and Hua, Nan and Simon, Jon and Joshi, Pratik and Kim, Yelin and Tenney, Ian and Potluri, Sahitya and Thiet, Lam Nguyen and Yuan, Quan and Luisier, Florian and Chronopoulou, Alexandra and Scellato, Salvatore and Srinivasan, Praveen and Chen, Minmin and Koverkathu, Vinod and Dalibard, Valentin and Xu, Yaming and Saeta, Brennan and Anderson, Keith and Sellam, Thibault and Fernando, Nick and Huot, Fantine and Jung, Junehyuk and Varadarajan, Mani and Quinn, Michael and Raul, Amit and Le, Maigo and Habalov, Ruslan and Clark, Jon and Jalan, Komal and Bullard, Kalesha and Singhal, Achintya and Luong, Thang and Wang, Boyu and Rajayogam, Sujeevan and Eisenschlos, Julian and Jia, Johnson and Finchelstein, Daniel and Yakubovich, Alex and Balle, Daniel and Fink, Michael and Agarwal, Sameer and Li, Jing and Dvijotham, Dj and Pal, Shalini and Kang, Kai and Konzelmann, Jaclyn and Beattie, Jennifer and Dousse, Olivier and Wu, Diane and Crocker, Remi and Elkind, Chen and Jonnalagadda, Siddhartha Reddy and Lee, Jong and Holtmann-Rice, Dan and Kallarackal, Krystal and Liu, Rosanne and Vnukov, Denis and Vats, Neera and Invernizzi, Luca and Jafari, Mohsen and Zhou, Huanjie and Taylor, Lilly and Prendki, Jennifer and Wu, Marcus and Eccles, Tom and Liu, Tianqi and Kopparapu, Kavya and Beaufays, Francoise and Angermueller, Christof and Marzoca, Andreea and Sarcar, Shourya and Dib, Hilal and Stanway, Jeff and Perbet, Frank and Trdin, Nejc and Sterneck, Rachel and Khorlin, Andrey and Li, Dinghua and Wu, Xihui and Goenka, Sonam and Madras, David and Goldshtein, Sasha and Gierke, Willi and Zhou, Tong and Liu, Yaxin and Liang, Yannie and White, Anais and Li, Yunjie and Singh, Shreya and Bahargam, Sanaz and Epstein, Mark and Basu, Sujoy and Lao, Li and Ozturel, Adnan and Crous, Carl and Zhai, Alex and Lu, Han and Tung, Zora and Gaur, Neeraj and Walton, Alanna and Dixon, Lucas and Zhang, Ming and Globerson, Amir and Uy, Grant and Bolt, Andrew and Wiles, Olivia and Nasr, Milad and Shumailov, Ilia and Selvi, Marco and Piccinno, Francesco and Aguilar, Ricardo and McCarthy, Sara and Khalman, Misha and Shukla, Mrinal and Galic, Vlado and Carpenter, John and Villela, Kevin and Zhang, Haibin and Richardson, Harry and Martens, James and Bosnjak, Matko and Belle, Shreyas Rammohan and Seibert, Jeff and Alnahlawi, Mahmoud and McWilliams, Brian and Singh, Sankalp and Louis, Annie and Ding, Wen and Popovici, Dan and Simicich, Lenin and Knight, Laura and Mehta, Pulkit and Gupta, Nishesh and Shi, Chongyang and Fatehi, Saaber and Mitrovic, Jovana and Grills, Alex and Pagadora, Joseph and Munkhdalai, Tsendsuren and Petrova, Dessie and Eisenbud, Danielle and Zhang, Zhishuai and Yates, Damion and Mittal, Bhavishya and Tripuraneni, Nilesh and Assael, Yannis and Brovelli, Thomas and Jain, Prateek and Velimirovic, Mihajlo and Akbulut, Canfer and Mu, Jiaqi and Macherey, Wolfgang and Kumar, Ravin and Xu, Jun and Qureshi, Haroon and Comanici, Gheorghe and Wiesner, Jeremy and Gong, Zhitao and Ruddock, Anton and Bauer, Matthias and Felt, Nick and GP, Anirudh and Arnab, Anurag and Zelle, Dustin and Rothfuss, Jonas and Rosgen, Bill and Shenoy, Ashish and Seybold, Bryan and Li, Xinjian and Mudigonda, Jayaram and Erdogan, Goker and Xia, Jiawei and Simsa, Jiri and Michi, Andrea and Yao, Yi and Yew, Christopher and Kan, Steven and Caswell, Isaac and Radebaugh, Carey and Elisseeff, Andre and Valenzuela, Pedro and McKinney, Kay and Paterson, Kim and Cui, Albert and Latorre-Chimoto, Eri and Kim, Solomon and Zeng, William and Durden, Ken and Ponnapalli, Priya and Sosea, Tiberiu and Choquette-Choo, Christopher A. and Manyika, James and Robenek, Brona and Vashisht, Harsha and Pereira, Sebastien and Lam, Hoi and Velic, Marko and Owusu-Afriyie, Denese and Lee, Katherine and Bolukbasi, Tolga and Parrish, Alicia and Lu, Shawn and Park, Jane and Venkatraman, Balaji and Talbert, Alice and Rosique, Lambert and Cheng, Yuchung and Sozanschi, Andrei and Paszke, Adam and Kumar, Praveen and Austin, Jessica and Li, Lu and Salama, Khalid and Perz, Bartek and Kim, Wooyeol and Dukkipati, Nandita and Baryshnikov, Anthony and Kaplanis, Christos and Sheng, XiangHai and Chervonyi, Yuri and Unlu, Caglar and Casas, Diego de Las and Askham, Harry and Tunyasuvunakool, Kathryn and Gimeno, Felix and Poder, Siim and Kwak, Chester and Miecnikowski, Matt and Mirrokni, Vahab and Dimitriev, Alek and Parisi, Aaron and Liu, Dangyi and Tsai, Tomy and Shevlane, Toby and Kouridi, Christina and Garmon, Drew and Goedeckemeyer, Adrian and Brown, Adam R. and Vijayakumar, Anitha and Elqursh, Ali and Jazayeri, Sadegh and Huang, Jin and Carthy, Sara Mc and Hoover, Jay and Kim, Lucy and Kumar, Sandeep and Chen, Wei and Biles, Courtney and Bingham, Garrett and Rosen, Evan and Wang, Lisa and Tan, Qijun and Engel, David and Pongetti, Francesco and Cesare, Dario de and Hwang, Dongseong and Yu, Lily and Pullman, Jennifer and Narayanan, Srini and Levin, Kyle and Gopal, Siddharth and Li, Megan and Aharoni, Asaf and Trinh, Trieu and Lo, Jessica and Casagrande, Norman and Vij, Roopali and Matthey, Loic and Ramadhana, Bramandia and Matthews, Austin and Carey, CJ and Johnson, Matthew and Goranova, Kremena and Shah, Rohin and Ashraf, Shereen and Dasgupta, Kingshuk and Larsen, Rasmus and Wang, Yicheng and Vuyyuru, Manish Reddy and Jiang, Chong and Ijazi, Joana and Osawa, Kazuki and Smith, Celine and Boppana, Ramya Sree and Bilal, Taylan and Koizumi, Yuma and Xu, Ying and Altun, Yasemin and Shabat, Nir and Bariach, Ben and Korchemniy, Alex and Choo, Kiam and Ronneberger, Olaf and Iwuanyanwu, Chimezie and Zhao, Shubin and Soergel, David and Hsieh, Cho-Jui and Cai, Irene and Iqbal, Shariq and Sundermeyer, Martin and Chen, Zhe and Bursztein, Elie and Malaviya, Chaitanya and Biadsy, Fadi and Shroff, Prakash and Dhillon, Inderjit and Latkar, Tejasi and Dyer, Chris and Forbes, Hannah and Nicosia, Massimo and Nikolaev, Vitaly and Greene, Somer and Georgiev, Marin and Wang, Pidong and Martin, Nina and Sedghi, Hanie and Zhang, John and Banzal, Praseem and Fritz, Doug and Rao, Vikram and Wang, Xuezhi and Zhang, Jiageng and Patraucean, Viorica and Du, Dayou and Mordatch, Igor and Jurin, Ivan and Liu, Lewis and Dubey, Ayush and Mohan, Abhi and Nowakowski, Janek and Ion, Vlad-Doru and Wei, Nan and Tojo, Reiko and Raad, Maria Abi and Hudson, Drew A. and Keshava, Vaishakh and Agrawal, Shubham and Ramirez, Kevin and Wu, Zhichun and Nguyen, Hoang and Liu, Ji and Sewak, Madhavi and Petrini, Bryce and Choi, DongHyun and Philips, Ivan and Wang, Ziyue and Bica, Ioana and Garg, Ankush and Wilkiewicz, Jarek and Agrawal, Priyanka and Li, Xiaowei and Guo, Danhao and Xue, Emily and Shaik, Naseer and Leach, Andrew and Khan, Sadh MNM and Wiesinger, Julia and Jerome, Sammy and Chakladar, Abhishek and Wang, Alek Wenjiao and Ornduff, Tina and Abu, Folake and Ghaffarkhah, Alireza and Wainwright, Marcus and Cortes, Mario and Liu, Frederick and Maynez, Joshua and Terzis, Andreas and Samangouei, Pouya and Mansour, Riham and Kępa, Tomasz and Aubet, François-Xavier and Algymr, Anton and Banica, Dan and Weisz, Agoston and Orban, Andras and Senges, Alexandre and Andrejczuk, Ewa and Geller, Mark and Santo, Niccolo Dal and Anklin, Valentin and Merey, Majd Al and Baeuml, Martin and Strohman, Trevor and Bai, Junwen and Petrov, Slav and Wu, Yonghui and Hassabis, Demis and Kavukcuoglu, Koray and Dean, Jeff and Vinyals, Oriol}, year = {2024}, doi = {10.48550/arxiv.2403.05530}, eprint = {2403.05530}, archivePrefix = {arXiv}, url = {https://doi.org/10.48550/arxiv.2403.05530} } ``` - [← previous GDTB: Genre Diverse Data for English Shallow Discourse Parsing across Modalities, Text Types, and Domains](https://md.research.elamur.ai/free/en/papers/liu-2024-gdtb-genre-diverse-data-english/) - [next → Generalizable Sarcasm Detection is Just Around the Corner, of Course!](https://md.research.elamur.ai/free/en/papers/jang-2024-generalizable-sarcasm-detection-is-just/) - [↑ back to papers of 2024](https://md.research.elamur.ai/free/en/papers/2024/page/2/) ## References 199 references, 57 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Rishabh Agarwal, Avi Singh, Lei M. Zhang, Bernd Bohnet, Stephanie Chan, Ankesh Anand, Zaheer Abbas, Azade Nova, John D. Co-Reyes, Eric Chu, Feryal Behbahani, Aleksandra Faust, and Hugo Larochelle. Many-shot in-context learning. CoRR, abs/2404.11018, 2024a. [find](https://scholar.google.com/scholar?q=Rishabh+Agarwal%2C+Avi+Singh%2C+Lei+M%2E+Zhang%2C+Bernd+Bohnet%2C+Stephanie+Chan%2C+Ankesh+Anand%2C+Zaheer+Abbas%2C+Azade+Nova%2C+John+D%2E+Co%2DReyes%2C+Eric+Chu%2C+Feryal+Behbahani%2C+Aleksandra+Faust%2C+and+Hugo+Larochelle%2E+Man) [our card](https://md.research.elamur.ai/free/en/papers/agarwal-2024-many-shot-context-learning/) 2. Rishabh Agarwal, Nino Vieillard, Yongchao Zhou, Piotr Stanczyk, Sabela Ramos Garea, Matthieu Geist, and Olivier Bachem. On-policy distillation of language models: Learning from self-generated mistakes. In The Twelfth International Conference on Learning Representations, 2024b. [find](https://scholar.google.com/scholar?q=Rishabh+Agarwal%2C+Nino+Vieillard%2C+Yongchao+Zhou%2C+Piotr+Stanczyk%2C+Sabela+Ramos+Garea%2C+Matthieu+Geist%2C+and+Olivier+Bachem%2E+On%2Dpolicy+distillation+of+language+models%3A+Learning+from+self%2Dgenerated+mistakes) [our card](https://md.research.elamur.ai/free/en/papers/agarwal-2023-policy-distillation-language-models-learning/) 3. Joshua Ainslie, Tao Lei, Michiel de Jong, Santiago Ontañón, Siddhartha Brahma, Yury Zemlyanskiy, David Uthus, Mandy Guo, James Lee-Thorp, Yi Tay, et al. Colt5: Faster long-range transformers with conditional computation. arXiv preprint arXiv:2303.09752, 2023. [find](https://scholar.google.com/scholar?q=Joshua+Ainslie%2C+Tao+Lei%2C+Michiel+de+Jong%2C+Santiago+Onta%C3%B1%C3%B3n%2C+Siddhartha+Brahma%2C+Yury+Zemlyanskiy%2C+David+Uthus%2C+Mandy+Guo%2C+James+Lee%2DThorp%2C+Yi+Tay%2C+et+al%2E+Colt5%3A+Faster+long%2Drange+transformers+with+cond) 4. Maksym Andriushchenko, Francesco Croce, and Nicolas Flammarion. Jailbreaking leading safety-aligned llms with simple adaptive attacks. arXiv preprint arXiv:2404.02151, 2024. [find](https://scholar.google.com/scholar?q=Maksym+Andriushchenko%2C+Francesco+Croce%2C+and+Nicolas+Flammarion%2E+Jailbreaking+leading+safety%2Daligned+llms+with+simple+adaptive+attacks%2E+arXiv+preprint+arXiv%3A2404%2E02151%2C+2024%2E) 5. Rohan Anil, Gabriel Pereyra, Alexandre Passos, Robert Ormandi, George E. Dahl, and Geoffrey E. Hinton. Large scale distributed neural network training through online distillation, 2018. [find](https://scholar.google.com/scholar?q=Rohan+Anil%2C+Gabriel+Pereyra%2C+Alexandre+Passos%2C+Robert+Ormandi%2C+George+E%2E+Dahl%2C+and+Geoffrey+E%2E+Hinton%2E+Large+scale+distributed+neural+network+training+through+online+distillation%2C+2018%2E) 6. Rohan Anil, Andrew M Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, et al. Palm 2 technical report. arXiv preprint arXiv:2305.10403, 2023a. [find](https://scholar.google.com/scholar?q=Rohan+Anil%2C+Andrew+M+Dai%2C+Orhan+Firat%2C+Melvin+Johnson%2C+Dmitry+Lepikhin%2C+Alexandre+Passos%2C+Siamak+Shakeri%2C+Emanuel+Taropa%2C+Paige+Bailey%2C+Zhifeng+Chen%2C+et+al%2E+Palm+2+technical+report%2E+arXiv+preprint+arX) [our card](https://md.research.elamur.ai/free/en/papers/anil-2023-palm-2-technical-report/) 7. Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, et al. PaLM 2 Technical Report, 2023b. [find](https://scholar.google.com/scholar?q=Rohan+Anil%2C+Andrew+M%2E+Dai%2C+Orhan+Firat%2C+Melvin+Johnson%2C+Dmitry+Lepikhin%2C+Alexandre+Passos%2C+Siamak+Shakeri%2C+Emanuel+Taropa%2C+Paige+Bailey%2C+Zhifeng+Chen%2C+et+al%2E+PaLM+2+Technical+Report%2C+2023b%2E) [our card](https://md.research.elamur.ai/free/en/papers/anil-2023-palm-2-technical-report/) 8. Anthropic. Model Card and Evaluations for Claude Models, 2023a. [find](https://scholar.google.com/scholar?q=Anthropic%2E+Model+Card+and+Evaluations+for+Claude+Models%2C+2023a%2E) 9. Anthropic. Long context prompting for Claude 2.1, 2023b. [find](https://scholar.google.com/scholar?q=Anthropic%2E+Long+context+prompting+for+Claude+2%2E1%2C+2023b%2E) 10. Rosana Ardila, Megan Branson, Kelly Davis, Michael Henretty, Michael Kohler, Josh Meyer, Reuben Morais, Lindsay Saunders, Francis M Tyers, and Gregor Weber. Common voice: A massively-multilingual speech corpus. arXiv preprint arXiv:1912.06670, 2019. [find](https://scholar.google.com/scholar?q=Rosana+Ardila%2C+Megan+Branson%2C+Kelly+Davis%2C+Michael+Henretty%2C+Michael+Kohler%2C+Josh+Meyer%2C+Reuben+Morais%2C+Lindsay+Saunders%2C+Francis+M+Tyers%2C+and+Gregor+Weber%2E+Common+voice%3A+A+massively%2Dmultilingual+spee) [our card](https://md.research.elamur.ai/free/en/papers/ardila-2019-common-voice-massively-multilingual-speech/) 11. Yuntao Bai, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion, Andy Jones, Anna Chen, Anna Goldie, Azalia Mirhoseini, Cameron McKinnon, Carol Chen, Catherine Olsson, Christopher Olah, Danny Hernandez, Dawn Drain, Deep Ganguli, Dustin Li, Eli Tran-Johnson, Ethan Perez, Jamie Kerr, Jared… [find](https://scholar.google.com/scholar?q=Yuntao+Bai%2C+Saurav+Kadavath%2C+Sandipan+Kundu%2C+Amanda+Askell%2C+Jackson+Kernion%2C+Andy+Jones%2C+Anna+Chen%2C+Anna+Goldie%2C+Azalia+Mirhoseini%2C+Cameron+McKinnon%2C+Carol+Chen%2C+Catherine+Olsson%2C+Christopher+Olah%2C+Da) [our card](https://md.research.elamur.ai/free/en/papers/bai-2022-constitutional-ai-harmlessness-ai-feedback/) 12. Ivana Balažević, Yuge Shi, Pinelopi Papalampidi, Rahma Chaabouni, Skanda Koppula, and Olivier J Hénaff. Memory consolidation enables long-context video understanding. arXiv preprint arXiv:2402.05861, 2024. — [arXiv:2402.05861](https://arxiv.org/abs/2402.05861) [find](https://scholar.google.com/scholar?q=Ivana+Bala%C5%BEevi%C4%87%2C+Yuge+Shi%2C+Pinelopi+Papalampidi%2C+Rahma+Chaabouni%2C+Skanda+Koppula%2C+and+Olivier+J+H%C3%A9naff%2E+Memory+consolidation+enables+long%2Dcontext+video+understanding%2E+arXiv+preprint+arXiv%3A2402%2E05861%2C+) 13. Suzanna Becker and Yann LeCun. Improving the convergence of back-propagation learning with second-order methods. 1989. URL [https://api.semanticscholar.org/CorpusID:](https://api.semanticscholar.org/CorpusID:) 59695337 . [↗](https://api.semanticscholar.org/CorpusID:) 14. Yoshua Bengio, Nicholas Léonard, and Aaron Courville. Estimating or propagating gradients through stochastic neurons for conditional computation, 2013. [find](https://scholar.google.com/scholar?q=Yoshua+Bengio%2C+Nicholas+L%C3%A9onard%2C+and+Aaron+Courville%2E+Estimating+or+propagating+gradients+through+stochastic+neurons+for+conditional+computation%2C+2013%2E) 15. Amanda Bertsch, Uri Alon, Graham Neubig, and Matthew R Gormley. Unlimiformer: Long-range transformers with unlimited length input. arXiv preprint arXiv:2305.01625, 2023. [find](https://scholar.google.com/scholar?q=Amanda+Bertsch%2C+Uri+Alon%2C+Graham+Neubig%2C+and+Matthew+R+Gormley%2E+Unlimiformer%3A+Long%2Drange+transformers+with+unlimited+length+input%2E+arXiv+preprint+arXiv%3A2305%2E01625%2C+2023%2E) 16. Amanda Bertsch, Maor Ivgi, Uri Alon, Jonathan Berant, Matthew R Gormley, and Graham Neubig. In-context learning with long-context models: An in-depth exploration. arXiv preprint arXiv:2405.00200, 2024. [find](https://scholar.google.com/scholar?q=Amanda+Bertsch%2C+Maor+Ivgi%2C+Uri+Alon%2C+Jonathan+Berant%2C+Matthew+R+Gormley%2C+and+Graham+Neubig%2E+In%2Dcontext+learning+with+long%2Dcontext+models%3A+An+in%2Ddepth+exploration%2E+arXiv+preprint+arXiv%3A2405%2E00200%2C+2024) 17. Lucas Beyer, Xiaohua Zhai, Amélie Royer, Larisa Markeeva, Rohan Anil, and Alexander Kolesnikov. Knowledge distillation: A good teacher is patient and consistent, 2021. [find](https://scholar.google.com/scholar?q=Lucas+Beyer%2C+Xiaohua+Zhai%2C+Am%C3%A9lie+Royer%2C+Larisa+Markeeva%2C+Rohan+Anil%2C+and+Alexander+Kolesnikov%2E+Knowledge+distillation%3A+A+good+teacher+is+patient+and+consistent%2C+2021%2E) 18. Stella Biderman, USVSN PRASHANTH, Lintang Sutawika, Hailey Schoelkopf, Quentin Anthony, Shivanshu Purohit, and Edward Raff. Emergent and predictable memorization in large language models. Advances in Neural Information Processing Systems, 36, 2024. [find](https://scholar.google.com/scholar?q=Stella+Biderman%2C+USVSN+PRASHANTH%2C+Lintang+Sutawika%2C+Hailey+Schoelkopf%2C+Quentin+Anthony%2C+Shivanshu+Purohit%2C+and+Edward+Raff%2E+Emergent+and+predictable+memorization+in+large+language+models%2E+Advances+in+) 19. Steven Bird. Decolonising speech and language technology. In Donia Scott, Nuria Bel, and Chengqing Zong, editors, Proceedings of the 28th International Conference on Computational Linguistics, pages 3504–3519, Barcelona, Spain (Online), December 2020. International Committee on Computational Linguis… [find](https://scholar.google.com/scholar?q=Steven+Bird%2E+Decolonising+speech+and+language+technology%2E+In+Donia+Scott%2C+Nuria+Bel%2C+and+Chengqing+Zong%2C+editors%2C+Proceedings+of+the+28th+International+Conference+on+Computational+Linguistics%2C+pages+3) 20. Ali Furkan Biten, Rubèn Tito, Andrés Mafla, Lluis Gomez, Marçal Rusiñol, C.V. Jawahar, Ernest Valveny, and Dimosthenis Karatzas. Scene text visual question answering. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pages 4290–4300, 2019. doi: 10.1109/ICCV.2019.00439. — [doi:10.1109/iccv.2019.00439](https://doi.org/10.1109/iccv.2019.00439) [find](https://scholar.google.com/scholar?q=Ali+Furkan+Biten%2C+Rub%C3%A8n+Tito%2C+Andr%C3%A9s+Mafla%2C+Lluis+Gomez%2C+Mar%C3%A7al+Rusi%C3%B1ol%2C+C%2EV%2E+Jawahar%2C+Ernest+Valveny%2C+and+Dimosthenis+Karatzas%2E+Scene+text+visual+question+answering%2E+In+2019+IEEE%2FCVF+International+Co) 21. Bernd Bohnet, Kevin Swersky, Rosanne Liu, Pranjal Awasthi, Azade Nova, Javier Snaider, Hanie Sedghi, Aaron T Parisi, Michael Collins, Angeliki Lazaridou, Orhan Firat, and Noah Fiedel. Long-span question-answering: Automatic question generation and qa-system ranking via side-by-side evaluation, 2024. [find](https://scholar.google.com/scholar?q=Bernd+Bohnet%2C+Kevin+Swersky%2C+Rosanne+Liu%2C+Pranjal+Awasthi%2C+Azade+Nova%2C+Javier+Snaider%2C+Hanie+Sedghi%2C+Aaron+T+Parisi%2C+Michael+Collins%2C+Angeliki+Lazaridou%2C+Orhan+Firat%2C+and+Noah+Fiedel%2E+Long%2Dspan+questi) 22. James Bradbury, Roy Frostig, Peter Hawkins, Matthew James Johnson, Chris Leary, Dougal Maclaurin, George Necula, Adam Paszke, Jake VanderPlas, Skye Wanderman-Milne, and Qiao Zhang. JAX: composable transformations of Python+NumPy programs, 2018. URL [http://github.com/](http://github.com/) google/jax . [↗](http://github.com/) 23. Ralph A. Bradley and Milton E. Terry. The rank analysis of incomplete block designs — I. The method of paired comparisons. Biometrika, 39:324–345, 1952. [find](https://scholar.google.com/scholar?q=Ralph+A%2E+Bradley+and+Milton+E%2E+Terry%2E+The+rank+analysis+of+incomplete+block+designs+%E2%80%94+I%2E+The+method+of+paired+comparisons%2E+Biometrika%2C+39%3A324%E2%80%93345%2C+1952%2E) 24. Thorsten Brants, Ashok Popat, Peng Xu, Franz Och, and Jeffrey Dean. Large language models in machine translation. pages 858–867, 01 2007. [find](https://scholar.google.com/scholar?q=Thorsten+Brants%2C+Ashok+Popat%2C+Peng+Xu%2C+Franz+Och%2C+and+Jeffrey+Dean%2E+Large+language+models+in+machine+translation%2E+pages+858%E2%80%93867%2C+01+2007%2E) [our card](https://md.research.elamur.ai/free/en/papers/brants-2007-large-language-models-machine-translation/) 25. Andrei Broder. A taxonomy of web search. SIGIR Forum, 36(2):3–10, sep 2002. ISSN 0163-5840. doi: 10.1145/792550.792552. URL https://doi.org/10.1145/792550.792552 . — [doi:10.1145/792550.792552](https://doi.org/10.1145/792550.792552) [↗](https://doi.org/10.1145/792550.792552) 26. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chri… [find](https://scholar.google.com/scholar?q=Tom+Brown%2C+Benjamin+Mann%2C+Nick+Ryder%2C+Melanie+Subbiah%2C+Jared+D+Kaplan%2C+Prafulla+Dhariwal%2C+Arvind+Neelakantan%2C+Pranav+Shyam%2C+Girish+Sastry%2C+Amanda+Askell%2C+Sandhini+Agarwal%2C+Ariel+Herbert%2DVoss%2C+Gretchen) 27. Curran Associates, Inc., 2020. URL [https://proceedings.neurips.cc/paper_](https://proceedings.neurips.cc/paper_) files/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf . [↗](https://proceedings.neurips.cc/paper_) 28. Cristian Bucila, Rich Caruana, and Alexandru Niculescu-Mizil. Model compression. In Knowledge Discovery and Data Mining, 2006. URL [https://api.semanticscholar.org/CorpusID:](https://api.semanticscholar.org/CorpusID:) 11253972 . [↗](https://api.semanticscholar.org/CorpusID:) 29. Aydar Bulatov, Yury Kuratov, and Mikhail Burtsev. Recurrent memory transformer. In S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, editors, Advances in Neural Information Processing Systems, volume 35, pages 11079–11091. Curran Associates, Inc., 2022. URL [https://proceedings.neuri…](https://proceedings.neuri…) [↗](https://proceedings.neuri…) 30. Aydar Bulatov, Yuri Kuratov, and Mikhail S Burtsev. Scaling transformer to 1m tokens and beyond with rmt. arXiv preprint arXiv:2304.11062, 2023. — [arXiv:2304.11062](https://arxiv.org/abs/2304.11062) [find](https://scholar.google.com/scholar?q=Aydar+Bulatov%2C+Yuri+Kuratov%2C+and+Mikhail+S+Burtsev%2E+Scaling+transformer+to+1m+tokens+and+beyond+with+rmt%2E+arXiv+preprint+arXiv%3A2304%2E11062%2C+2023%2E+%E2%80%94+%5BarXiv%3A2304%2E11062%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2304%2E11062%29) 31. Joy Buolamwini and Timnit Gebru. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency, pages 77–91. PMLR, 2018. [find](https://scholar.google.com/scholar?q=Joy+Buolamwini+and+Timnit+Gebru%2E+Gender+shades%3A+Intersectional+accuracy+disparities+in+commercial+gender+classification%2E+In+Conference+on+fairness%2C+accountability+and+transparency%2C+pages+77%E2%80%9391%2E+PMLR%2C+) 32. Nicholas Carlini, Daphne Ippolito, Matthew Jagielski, Katherine Lee, Florian Tramer, and Chiyuan Zhang. Quantifying memorization across neural language models. arXiv preprint arXiv:2202.07646, 2022. URL https://arxiv.org/abs/2202.07646 . [↗](https://arxiv.org/abs/2202.07646) 33. Nicholas Carlini, Milad Nasr, Christopher A. Choquette-Choo, Matthew Jagielski, Irena Gao, Anas Awadalla, Pang Wei Koh, Daphne Ippolito, Katherine Lee, Florian Tramer, and Ludwig Schmidt. Are aligned neural networks adversarially aligned?, 2024. [find](https://scholar.google.com/scholar?q=Nicholas+Carlini%2C+Milad+Nasr%2C+Christopher+A%2E+Choquette%2DChoo%2C+Matthew+Jagielski%2C+Irena+Gao%2C+Anas+Awadalla%2C+Pang+Wei+Koh%2C+Daphne+Ippolito%2C+Katherine+Lee%2C+Florian+Tramer%2C+and+Ludwig+Schmidt%2E+Are+aligned+) 34. Ben Carterette, Paul Clough, Mark Hall, Evangelos Kanoulas, and Mark Sanderson. Evaluating retrieval over sessions: The TREC session track 2011-2014. In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR ’16, page 685–688, New York,… — [doi:10.1145/2911451.2914675](https://doi.org/10.1145/2911451.2914675) [find](https://scholar.google.com/scholar?q=Ben+Carterette%2C+Paul+Clough%2C+Mark+Hall%2C+Evangelos+Kanoulas%2C+and+Mark+Sanderson%2E+Evaluating+retrieval+over+sessions%3A+The+TREC+session+track+2011%2D2014%2E+In+Proceedings+of+the+39th+International+ACM+SIGIR) 35. Patrick Chao, Edoardo Debenedetti, Alexander Robey, Maksym Andriushchenko, Francesco Croce, Vikash Sehwag, Edgar Dobriban, Nicolas Flammarion, George J. Pappas, Florian Tramèr, Hamed Hassani, and Eric Wong. Jailbreakbench: An open robustness benchmark for jailbreaking large language models, 2024. [find](https://scholar.google.com/scholar?q=Patrick+Chao%2C+Edoardo+Debenedetti%2C+Alexander+Robey%2C+Maksym+Andriushchenko%2C+Francesco+Croce%2C+Vikash+Sehwag%2C+Edgar+Dobriban%2C+Nicolas+Flammarion%2C+George+J%2E+Pappas%2C+Florian+Tram%C3%A8r%2C+Hamed+Hassani%2C+and+Eric) [our card](https://md.research.elamur.ai/free/en/papers/chao-2024-jailbreakbench-open-robustness-benchmark-jailbreaking/) 36. Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhai… [find](https://scholar.google.com/scholar?q=Mark+Chen%2C+Jerry+Tworek%2C+Heewoo+Jun%2C+Qiming+Yuan%2C+Henrique+Ponde+de+Oliveira+Pinto%2C+Jared+Kaplan%2C+Harri+Edwards%2C+Yuri+Burda%2C+Nicholas+Joseph%2C+Greg+Brockman%2C+Alex+Ray%2C+Raul+Puri%2C+Gretchen+Krueger%2C+Mich) [our card](https://md.research.elamur.ai/free/en/papers/chen-2021-evaluating-large-language-models-trained/) 37. Stanley F Chen and Joshua Goodman. An empirical study of smoothing techniques for language modeling. Computer Speech & Language, 13(4):359–394, 1999. [find](https://scholar.google.com/scholar?q=Stanley+F+Chen+and+Joshua+Goodman%2E+An+empirical+study+of+smoothing+techniques+for+language+modeling%2E+Computer+Speech+%26+Language%2C+13%284%29%3A359%E2%80%93394%2C+1999%2E) 38. Yizheng Chen, Zhoujie Ding, Lamya Alowain, Xinyun Chen, and David Wagner. DiverseVul: A new vulnerable source code dataset for deep learning based vulnerability detection. In International Symposium on Research in Attacks, Intrusions and Defenses, pages 654–668, April 2023a. URL [https://arxiv.org/ab…](https://arxiv.org/ab…) — [arXiv:2304.00409](https://arxiv.org/abs/2304.00409) [↗](https://arxiv.org/ab…) 39. Yukang Chen, Shengju Qian, Haotian Tang, Xin Lai, Zhijian Liu, Song Han, and Jiaya Jia. Longlora: Efficient fine-tuning of long-context large language models. arXiv preprint arXiv:2309.12307, 2023b. URL https://arxiv.org/abs/2309.12307 . [↗](https://arxiv.org/abs/2309.12307) [our card](https://md.research.elamur.ai/free/en/papers/chen-2023-longlora-efficient-fine-tuning-long/) 40. Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, et al. Palm: Scaling language modeling with pathways. Journal of Machine Learning Research, 24(240):1–113, 2023a. [find](https://scholar.google.com/scholar?q=Aakanksha+Chowdhery%2C+Sharan+Narang%2C+Jacob+Devlin%2C+Maarten+Bosma%2C+Gaurav+Mishra%2C+Adam+Roberts%2C+Paul+Barham%2C+Hyung+Won+Chung%2C+Charles+Sutton%2C+Sebastian+Gehrmann%2C+et+al%2E+Palm%3A+Scaling+language+modeling+w) 41. Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, et al. PaLM: Scaling Language Modeling with Pathways. Journal of Machine Learning Research, 24(240):1–113, 2023b. URL [http://jmlr.org/papers…](http://jmlr.org/papers…) [↗](http://jmlr.org/papers…) 42. Aidan Clark, Diego de las Casas, Aurelia Guy, Arthur Mensch, Michela Paganini, Jordan Hoffmann, Bogdan Damoc, Blake Hechtman, Trevor Cai, Sebastian Borgeaud, George van den Driessche, Eliza Rutherford, Tom Hennigan, Matthew Johnson, Katie Millican, Albin Cassirer, Chris Jones, Elena Buchatskaya, Dav… — [arXiv:2202.01169](https://arxiv.org/abs/2202.01169) [find](https://scholar.google.com/scholar?q=Aidan+Clark%2C+Diego+de+las+Casas%2C+Aurelia+Guy%2C+Arthur+Mensch%2C+Michela+Paganini%2C+Jordan+Hoffmann%2C+Bogdan+Damoc%2C+Blake+Hechtman%2C+Trevor+Cai%2C+Sebastian+Borgeaud%2C+George+van+den+Driessche%2C+Eliza+Rutherford) 43. Peter Clark, Oyvind Tafjord, and Kyle Richardson. Transformers as soft reasoners over language. IJCAI, 2020. URL [https://www.ijcai.org/proceedings/2020/0537.pdf](https://www.ijcai.org/proceedings/2020/0537.pdf) . [↗](https://www.ijcai.org/proceedings/2020/0537.pdf) [our card](https://md.research.elamur.ai/free/en/papers/clark-2020-transformers-soft-reasoners-over-language/) 44. Charles LA Clarke, Saira Rizvi, Mark D Smucker, Maria Maistro, and Guido Zuccon. Overview of the TREC 2020 health misinformation track. In Proceedings of the Twenty-Ninth Text REtrieval Conference (TREC 2020), 2020. URL [https://trec.nist.gov/pubs/trec29/papers/OVERVIEW.HM](https://trec.nist.gov/pubs/trec29/papers/OVERVIEW.HM). pdf . [↗](https://trec.nist.gov/pubs/trec29/papers/OVERVIEW.HM) 45. Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman. Training verifiers to solve math word problems. arXiv preprint arXiv:2110.14168, 2021. URL https://arxiv.org/abs/2110.14168 . [↗](https://arxiv.org/abs/2110.14168) [our card](https://md.research.elamur.ai/free/en/papers/cobbe-2021-training-verifiers-solve-math-word/) 46. Kevyn Collins-Thompson, Craig Macdonald, Paul N. Bennett, Fernando Diaz, and Ellen M. Voorhees. TREC 2014 web track overview. In Proceedings of the Twenty-Third Text REtrieval Conference (TREC 2014), 2014. URL [https://trec.nist.gov/pubs/trec23/papers/overview-web.pdf](https://trec.nist.gov/pubs/trec23/papers/overview-web.pdf) . [↗](https://trec.nist.gov/pubs/trec23/papers/overview-web.pdf) 47. Alexis Conneau, Min Ma, Simran Khanuja, Yu Zhang, Vera Axelrod, Siddharth Dalmia, Jason Riesa, Clara Rivera, and Ankur Bapna. Fleurs: Few-shot learning evaluation of universal representations of speech. In 2022 IEEE Spoken Language Technology Workshop (SLT), pages 798–805. [find](https://scholar.google.com/scholar?q=Alexis+Conneau%2C+Min+Ma%2C+Simran+Khanuja%2C+Yu+Zhang%2C+Vera+Axelrod%2C+Siddharth+Dalmia%2C+Jason+Riesa%2C+Clara+Rivera%2C+and+Ankur+Bapna%2E+Fleurs%3A+Few%2Dshot+learning+evaluation+of+universal+representations+of+speec) [our card](https://md.research.elamur.ai/free/en/papers/conneau-2022-fleurs-few-shot-learning-evaluation/) 48. Pradeep Dasigi, Kyle Lo, Iz Beltagy, Arman Cohan, Noah A. Smith, and Matt Gardner. A dataset of information-seeking questions and answers anchored in research papers. In Kristina Toutanova, Anna Rumshisky, Luke Zettlemoyer, Dilek Hakkani-Tur, Iz Beltagy, Steven Bethard, Ryan Cotterell, Tanmoy Chakra… [find](https://scholar.google.com/scholar?q=Pradeep+Dasigi%2C+Kyle+Lo%2C+Iz+Beltagy%2C+Arman+Cohan%2C+Noah+A%2E+Smith%2C+and+Matt+Gardner%2E+A+dataset+of+information%2Dseeking+questions+and+answers+anchored+in+research+papers%2E+In+Kristina+Toutanova%2C+Anna+Rumsh) [our card](https://md.research.elamur.ai/free/en/papers/dasigi-2021-dataset-information-seeking-questions-answers/) 49. Andrew Davis and Itamar Arel. Low-rank approximations for conditional feedforward computation in deep neural networks, 2014. [find](https://scholar.google.com/scholar?q=Andrew+Davis+and+Itamar+Arel%2E+Low%2Drank+approximations+for+conditional+feedforward+computation+in+deep+neural+networks%2C+2014%2E) 50. Jeff Dean. tecture, Introducing Pathways: A next-generation AI archi-2021. URL [https://blog.google/technology/ai/](https://blog.google/technology/ai/) introducing-pathways-next-generation-ai-architecture/ . [↗](https://blog.google/technology/ai/) 51. Dhinakaran, URL [https://twitter.com/aparnadhinak/status/1744771295940669689](https://twitter.com/aparnadhinak/status/1744771295940669689) . Yan Ding, Xiaohan Zhang, Chris Paxton, and Shiqi Zhang. Task and motion planning with large language models for object rearrangement. In 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), page… [↗](https://twitter.com/aparnadhinak/status/1744771295940669689) 52. Yangruibo Ding, Yanjun Fu, Omniyyah Ibrahim, Chawin Sitawarin, Xinyun Chen, Basel Alomair, David Wagner, Baishakhi Ray, and Yizheng Chen. Vulnerability detection with code language models: How far are we? arXiv preprint:2403.18624, 2024. — [arXiv:2403.18624](https://arxiv.org/abs/2403.18624) [find](https://scholar.google.com/scholar?q=Yangruibo+Ding%2C+Yanjun+Fu%2C+Omniyyah+Ibrahim%2C+Chawin+Sitawarin%2C+Xinyun+Chen%2C+Basel+Alomair%2C+David+Wagner%2C+Baishakhi+Ray%2C+and+Yizheng+Chen%2E+Vulnerability+detection+with+code+language+models%3A+How+far+are) 53. Nan Du, Yanping Huang, Andrew M. Dai, Simon Tong, Dmitry Lepikhin, Yuanzhong Xu, Maxim Krikun, Yanqi Zhou, Adams Wei Yu, Orhan Firat, Barret Zoph, Liam Fedus, Maarten Bosma, Zongwei Zhou, Tao Wang, Yu Emma Wang, Kellie Webster, Marie Pellat, Kevin Robinson, Kathleen Meier-Hellstern, Toju Duke, Lucas… [find](https://scholar.google.com/scholar?q=Nan+Du%2C+Yanping+Huang%2C+Andrew+M%2E+Dai%2C+Simon+Tong%2C+Dmitry+Lepikhin%2C+Yuanzhong+Xu%2C+Maxim+Krikun%2C+Yanqi+Zhou%2C+Adams+Wei+Yu%2C+Orhan+Firat%2C+Barret+Zoph%2C+Liam+Fedus%2C+Maarten+Bosma%2C+Zongwei+Zhou%2C+Tao+Wang%2C+Yu) [our card](https://md.research.elamur.ai/free/en/papers/du-2021-glam-efficient-scaling-language-models/) 54. Dheeru Dua, Yizhong Wang, Pradeep Dasigi, Gabriel Stanovsky, Sameer Singh, and Matt Gardner. DROP: A reading comprehension benchmark requiring discrete reasoning over paragraphs. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Hum… [find](https://scholar.google.com/scholar?q=Dheeru+Dua%2C+Yizhong+Wang%2C+Pradeep+Dasigi%2C+Gabriel+Stanovsky%2C+Sameer+Singh%2C+and+Matt+Gardner%2E+DROP%3A+A+reading+comprehension+benchmark+requiring+discrete+reasoning+over+paragraphs%2E+In+Proceedings+of+the) [our card](https://md.research.elamur.ai/free/en/papers/dua-2019-drop-reading-comprehension-benchmark-requiring/) 55. John Duchi, Elad Hazan, and Yoram Singer. Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research, 12(61):2121–2159, 2011. URL [http://jmlr.org/papers/v12/duchi11a.html](http://jmlr.org/papers/v12/duchi11a.html) . [↗](http://jmlr.org/papers/v12/duchi11a.html) 56. Tyna Eloundou, Sam Manning, Pamela Mishkin, and Daniel Rock. Gpts are gpts: An early look at the labor market impact potential of large language models. arXiv preprint arXiv:2303.10130, 2023. — [arXiv:2303.10130](https://arxiv.org/abs/2303.10130) [find](https://scholar.google.com/scholar?q=Tyna+Eloundou%2C+Sam+Manning%2C+Pamela+Mishkin%2C+and+Daniel+Rock%2E+Gpts+are+gpts%3A+An+early+look+at+the+labor+market+impact+potential+of+large+language+models%2E+arXiv+preprint+arXiv%3A2303%2E10130%2C+2023%2E+%E2%80%94+%5BarXiv) 57. Meng Fang, Xiangpeng Wan, Fei Lu, Fei Xing, and Kai Zou. Mathodyssey: Benchmarking mathematical problem-solving skills in large language models using odyssey math data. arXiv preprint arXiv:2406.18321, 2024. [find](https://scholar.google.com/scholar?q=Meng+Fang%2C+Xiangpeng+Wan%2C+Fei+Lu%2C+Fei+Xing%2C+and+Kai+Zou%2E+Mathodyssey%3A+Benchmarking+mathematical+problem%2Dsolving+skills+in+large+language+models+using+odyssey+math+data%2E+arXiv+preprint+arXiv%3A2406%2E18321) 58. William Fedus, Barret Zoph, and Noam Shazeer. Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity. arXiv preprint arXiv:2101.03961, 2021. URL https://arxiv.org/abs/2101.03961 . [↗](https://arxiv.org/abs/2101.03961) 59. Edward W Felten, Manav Raj, and Robert Seamans. A method to link advances in artificial intelligence to occupational abilities. In AEA Papers and Proceedings, volume 108, pages 54–57. American Economic Association 2014 Broadway, Suite 305, Nashville, TN 37203, 2018. [find](https://scholar.google.com/scholar?q=Edward+W+Felten%2C+Manav+Raj%2C+and+Robert+Seamans%2E+A+method+to+link+advances+in+artificial+intelligence+to+occupational+abilities%2E+In+AEA+Papers+and+Proceedings%2C+volume+108%2C+pages+54%E2%80%9357%2E+American+Economi) 60. Chrisantha Fernando, Dylan Banarse, Henryk Michalewski, Simon Osindero, and Tim Rocktäschel. Promptbreeder: Self-referential self-improvement via prompt evolution, 2023. [find](https://scholar.google.com/scholar?q=Chrisantha+Fernando%2C+Dylan+Banarse%2C+Henryk+Michalewski%2C+Simon+Osindero%2C+and+Tim+Rockt%C3%A4schel%2E+Promptbreeder%3A+Self%2Dreferential+self%2Dimprovement+via+prompt+evolution%2C+2023%2E) [our card](https://md.research.elamur.ai/free/en/papers/fernando-2023-promptbreeder-self-referential-self-improvement/) 61. Xingyu Fu, Yushi Hu, Bangzheng Li, Yu Feng, Haoyu Wang, Xudong Lin, Dan Roth, Noah A Smith, Wei-Chiu Ma, and Ranjay Krishna. Blink: Multimodal large language models can see but not perceive. arXiv preprint arXiv:2404.12390, 2024. [find](https://scholar.google.com/scholar?q=Xingyu+Fu%2C+Yushi+Hu%2C+Bangzheng+Li%2C+Yu+Feng%2C+Haoyu+Wang%2C+Xudong+Lin%2C+Dan+Roth%2C+Noah+A+Smith%2C+Wei%2DChiu+Ma%2C+and+Ranjay+Krishna%2E+Blink%3A+Multimodal+large+language+models+can+see+but+not+perceive%2E+arXiv+pre) 62. Xavier Garcia, Yamini Bansal, Colin Cherry, George Foster, Maxim Krikun, Fangxiaoyu Feng, Melvin Johnson, and Orhan Firat. The unreasonable effectiveness of few-shot learning for machine translation, 2023. [find](https://scholar.google.com/scholar?q=Xavier+Garcia%2C+Yamini+Bansal%2C+Colin+Cherry%2C+George+Foster%2C+Maxim+Krikun%2C+Fangxiaoyu+Feng%2C+Melvin+Johnson%2C+and+Orhan+Firat%2E+The+unreasonable+effectiveness+of+few%2Dshot+learning+for+machine+translation%2C+) 63. Samuel Gehman, Suchin Gururangan, Maarten Sap, Yejin Choi, and Noah A. Smith. RealToxicityPrompts: Evaluating neural toxic degeneration in language models. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 3356–3369, Online, November 2020. Association for Computational… [find](https://scholar.google.com/scholar?q=Samuel+Gehman%2C+Suchin+Gururangan%2C+Maarten+Sap%2C+Yejin+Choi%2C+and+Noah+A%2E+Smith%2E+RealToxicityPrompts%3A+Evaluating+neural+toxic+degeneration+in+language+models%2E+In+Findings+of+the+Association+for+Computati) [our card](https://md.research.elamur.ai/free/en/papers/gehman-2020-realtoxicityprompts-evaluating-neural-toxic-degeneration/) 64. Gemini-Team, Rohan Anil, Sebastian Borgeaud, Yonghui Wu, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M Dai, Anja Hauth, et al. Gemini: a family of highly capable multimodal models. arXiv preprint arXiv:2312.11805, 2023. URL https://storage. googleapis.com/deepmind-media/g… [find](https://scholar.google.com/scholar?q=Gemini%2DTeam%2C+Rohan+Anil%2C+Sebastian+Borgeaud%2C+Yonghui+Wu%2C+Jean%2DBaptiste+Alayrac%2C+Jiahui+Yu%2C+Radu+Soricut%2C+Johan+Schalkwyk%2C+Andrew+M+Dai%2C+Anja+Hauth%2C+et+al%2E+Gemini%3A+a+family+of+highly+capable+multimodal) [our card](https://md.research.elamur.ai/free/en/papers/gemini-2023-team-gemini-family-highly-capable-multimodal/) 65. Gemma-Team, Thomas Mesnard, Cassidy Hardin, Robert Dadashi, Surya Bhupatiraju, Shreya Pathak, Laurent Sifre, Morgane Rivière, Mihir Sanjay Kale, Juliette Love, et al. Gemma: Open models based on gemini research and technology. arXiv preprint arXiv:2403.08295, 2024. [find](https://scholar.google.com/scholar?q=Gemma%2DTeam%2C+Thomas+Mesnard%2C+Cassidy+Hardin%2C+Robert+Dadashi%2C+Surya+Bhupatiraju%2C+Shreya+Pathak%2C+Laurent+Sifre%2C+Morgane+Rivi%C3%A8re%2C+Mihir+Sanjay+Kale%2C+Juliette+Love%2C+et+al%2E+Gemma%3A+Open+models+based+on+gemin) 66. Google. Google’s AI Principles. 2023. [find](https://scholar.google.com/scholar?q=Google%2E+Google%E2%80%99s+AI+Principles%2E+2023%2E) 67. URL [https://ai.google/responsibility/principles/](https://ai.google/responsibility/principles/) . Yash Goyal, Tejas Khot, Douglas Summers-Stay, Dhruv Batra, and Devi Parikh. Making the V in VQA matter: Elevating the role of image understanding in visual question answering. In Proceedings of the IEEE conference on computer vision and pattern reco… [↗](https://ai.google/responsibility/principles/) [our card](https://md.research.elamur.ai/free/en/papers/goyal-2016-making-v-vqa-matter-elevating/) 68. Albert Gu and Tri Dao. Mamba: Linear-time sequence modeling with selective state spaces. arXiv preprint arXiv:2312.00752, 2023. URL https://arxiv.org/abs/2312.00752 . [↗](https://arxiv.org/abs/2312.00752) 69. Lin Guan, Karthik Valmeekam, Sarath Sreedharan, and Subbarao Kambhampati. Leveraging pre-trained large language models to construct and utilize world models for model-based task planning. Advances in Neural Information Processing Systems, 36, 2024. [find](https://scholar.google.com/scholar?q=Lin+Guan%2C+Karthik+Valmeekam%2C+Sarath+Sreedharan%2C+and+Subbarao+Kambhampati%2E+Leveraging+pre%2Dtrained+large+language+models+to+construct+and+utilize+world+models+for+model%2Dbased+task+planning%2E+Advances+in+) 70. Mandy Guo, Joshua Ainslie, David Uthus, Santiago Ontanon, Jianmo Ni, Yun-Hsuan Sung, and Yinfei Yang. Longt5: Efficient text-to-text transformer for long sequences. arXiv preprint arXiv:2112.07916, 2021. URL https://arxiv.org/abs/2112.07916 . [↗](https://arxiv.org/abs/2112.07916) [our card](https://md.research.elamur.ai/free/en/papers/guo-2022-longt5-efficient-text-text-transformer/) 71. Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, and Mingwei Chang. Retrieval augmented language model pre-training. In Hal Daumé III and Aarti Singh, editors, Proceedings of the 37th International Conference on Machine Learning, volume 119 of Proceedings of Machine Learning Research, pages 3929… [find](https://scholar.google.com/scholar?q=Kelvin+Guu%2C+Kenton+Lee%2C+Zora+Tung%2C+Panupong+Pasupat%2C+and+Mingwei+Chang%2E+Retrieval+augmented+language+model+pre%2Dtraining%2E+In+Hal+Daum%C3%A9+III+and+Aarti+Singh%2C+editors%2C+Proceedings+of+the+37th+Internationa) 72. Shibo Hao, Yi Gu, Haodi Ma, Joshua Jiahua Hong, Zhen Wang, Daisy Zhe Wang, and Zhiting Hu. Reasoning with language model is planning with world model. arXiv preprint arXiv:2305.14992, 2023. [find](https://scholar.google.com/scholar?q=Shibo+Hao%2C+Yi+Gu%2C+Haodi+Ma%2C+Joshua+Jiahua+Hong%2C+Zhen+Wang%2C+Daisy+Zhe+Wang%2C+and+Zhiting+Hu%2E+Reasoning+with+language+model+is+planning+with+world+model%2E+arXiv+preprint+arXiv%3A2305%2E14992%2C+2023%2E) 73. Jonathan Heek, Anselm Levskaya, Avital Oliver, Marvin Ritter, Bertrand Rondepierre, Andreas Steiner, and Marc van Zee. Flax: A neural network library and ecosystem for JAX, 2023. URL [http://github.com/google/flax](http://github.com/google/flax) . [↗](http://github.com/google/flax) 74. Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. Measuring massive multitask language understanding. Proceedings of the International Conference on Learning Representations (ICLR), 2021a. [find](https://scholar.google.com/scholar?q=Dan+Hendrycks%2C+Collin+Burns%2C+Steven+Basart%2C+Andy+Zou%2C+Mantas+Mazeika%2C+Dawn+Song%2C+and+Jacob+Steinhardt%2E+Measuring+massive+multitask+language+understanding%2E+Proceedings+of+the+International+Conference+o) [our card](https://md.research.elamur.ai/free/en/papers/hendrycks-2020-measuring-massive-multitask-language-understanding/) 75. Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. Measuring mathematical problem solving with the MATH dataset. arXiv preprint arXiv:2103.03874, 2021b. URL https://arxiv.org/abs/2103.03874 . [↗](https://arxiv.org/abs/2103.03874) [our card](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-measuring-mathematical-problem-solving-math/) 76. Tom Heskes. On “Natural” Learning and Pruning in Multilayered Perceptrons. Neural Computation, 12(4):881–901, 04 2000. ISSN 0899-7667. doi: 10.1162/089976600300015637. URL https://doi.org/10.1162/089976600300015637 . — [doi:10.1162/089976600300015637](https://doi.org/10.1162/089976600300015637) [↗](https://doi.org/10.1162/089976600300015637) 77. Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. Distilling the knowledge in a neural network, 2015. [find](https://scholar.google.com/scholar?q=Geoffrey+Hinton%2C+Oriol+Vinyals%2C+and+Jeff+Dean%2E+Distilling+the+knowledge+in+a+neural+network%2C+2015%2E) [our card](https://md.research.elamur.ai/free/en/papers/hinton-2015-distilling-knowledge-neural-network/) 78. Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, Tom Hennigan, Eric Noland, Katie Millican, George van den Driessche, Bogdan Damoc, Aurelia Guy, Simon Osindero, Karen Simonyan, E… [find](https://scholar.google.com/scholar?q=Jordan+Hoffmann%2C+Sebastian+Borgeaud%2C+Arthur+Mensch%2C+Elena+Buchatskaya%2C+Trevor+Cai%2C+Eliza+Rutherford%2C+Diego+de+Las+Casas%2C+Lisa+Anne+Hendricks%2C+Johannes+Welbl%2C+Aidan+Clark%2C+Tom+Hennigan%2C+Eric+Noland%2C+Ka) 79. Wenlong Huang, Fei Xia, Ted Xiao, Harris Chan, Jacky Liang, Pete Florence, Andy Zeng, Jonathan Tompson, Igor Mordatch, Yevgen Chebotar, et al. Inner monologue: Embodied reasoning through planning with language models. arXiv preprint arXiv:2207.05608, 2022. [find](https://scholar.google.com/scholar?q=Wenlong+Huang%2C+Fei+Xia%2C+Ted+Xiao%2C+Harris+Chan%2C+Jacky+Liang%2C+Pete+Florence%2C+Andy+Zeng%2C+Jonathan+Tompson%2C+Igor+Mordatch%2C+Yevgen+Chebotar%2C+et+al%2E+Inner+monologue%3A+Embodied+reasoning+through+planning+with) 80. Daphne Ippolito, Florian Tramèr, Milad Nasr, Chiyuan Zhang, Matthew Jagielski, Katherine Lee, Christopher A Choquette-Choo, and Nicholas Carlini. Preventing verbatim memorization in language models gives a false sense of privacy. arXiv preprint arXiv:2210.17546, 2022. URL https://arxiv.org/abs/210.… — [arXiv:2210.17546](https://arxiv.org/abs/2210.17546) [↗](https://arxiv.org/abs/210.…) 81. Gautier Izacard, Patrick Lewis, Maria Lomeli, Lucas Hosseini, Fabio Petroni, Timo Schick, Jane Dwivedi-Yu, Armand Joulin, Sebastian Riedel, and Edouard Grave. Few-shot learning with retrieval augmented language models. arXiv preprint arXiv:2208.03299, 2022. URL [https://arxiv.org/](https://arxiv.org/) abs/2208.03299 . [↗](https://arxiv.org/) 82. Robert A Jacobs, Michael I Jordan, Steven J Nowlan, and Geoffrey E Hinton. Adaptive mixtures of local experts. Neural computation, 3(1):79–87, 1991. [find](https://scholar.google.com/scholar?q=Robert+A+Jacobs%2C+Michael+I+Jordan%2C+Steven+J+Nowlan%2C+and+Geoffrey+E+Hinton%2E+Adaptive+mixtures+of+local+experts%2E+Neural+computation%2C+3%281%29%3A79%E2%80%9387%2C+1991%2E) 83. Frederick Jelinek. Statistical methods for speech recognition. MIT press, 1998. [find](https://scholar.google.com/scholar?q=Frederick+Jelinek%2E+Statistical+methods+for+speech+recognition%2E+MIT+press%2C+1998%2E) 84. Albert Q Jiang, Alexandre Sablayrolles, Antoine Roux, Arthur Mensch, Blanche Savary, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Emma Bou Hanna, Florian Bressand, et al. Mixtral of experts. arXiv preprint arXiv:2401.04088, 2024. [find](https://scholar.google.com/scholar?q=Albert+Q+Jiang%2C+Alexandre+Sablayrolles%2C+Antoine+Roux%2C+Arthur+Mensch%2C+Blanche+Savary%2C+Chris+Bamford%2C+Devendra+Singh+Chaplot%2C+Diego+de+las+Casas%2C+Emma+Bou+Hanna%2C+Florian+Bressand%2C+et+al%2E+Mixtral+of+expe) 85. Zhengbao Jiang, Luyu Gao, Zhiruo Wang, Jun Araki, Haibo Ding, Jamie Callan, and Graham Neubig. Retrieval as attention: End-to-end learning of retrieval and reading within a single transformer. In Yoav Goldberg, Zornitsa Kozareva, and Yue Zhang, editors, Proceedings of the 2022 Conference on Empirica… [find](https://scholar.google.com/scholar?q=Zhengbao+Jiang%2C+Luyu+Gao%2C+Zhiruo+Wang%2C+Jun+Araki%2C+Haibo+Ding%2C+Jamie+Callan%2C+and+Graham+Neubig%2E+Retrieval+as+attention%3A+End%2Dto%2Dend+learning+of+retrieval+and+reading+within+a+single+transformer%2E+In+Yoav) 86. Alex Jones, Isaac Caswell, Ishank Saxena, and Orhan Firat. Bilex rx: Lexical data augmentation for massively multilingual machine translation. arXiv preprint arXiv:2303.15265, 2023. [find](https://scholar.google.com/scholar?q=Alex+Jones%2C+Isaac+Caswell%2C+Ishank+Saxena%2C+and+Orhan+Firat%2E+Bilex+rx%3A+Lexical+data+augmentation+for+massively+multilingual+machine+translation%2E+arXiv+preprint+arXiv%3A2303%2E15265%2C+2023%2E) 87. Rafal Jozefowicz, Oriol Vinyals, Mike Schuster, Noam Shazeer, and Yonghui Wu. Exploring the limits of language modeling, 2016. URL https://arxiv.org/abs/1602.02410 . [↗](https://arxiv.org/abs/1602.02410) 88. URL [https://github.com/gkamradt/LLMTest_NeedleInAHaystack/blob/main/README.md](https://github.com/gkamradt/LLMTest_NeedleInAHaystack/blob/main/README.md) . Jared Kaplan, Sam McCandlish, Tom Henighan, Tom B Brown, Benjamin Chess, Rewon Child, Scott Gray, Alec Radford, Jeffrey Wu, and Dario Amodei. Scaling laws for neural language models. arXiv preprint arXiv:2001.08361, 2020… [↗](https://github.com/gkamradt/LLMTest_NeedleInAHaystack/blob/main/README.md) 89. Vladimir Karpukhin, Barlas Oguz, Sewon Min, Patrick Lewis, Ledell Wu, Sergey Edunov, Danqi Chen, and Wen-tau Yih. Dense passage retrieval for open-domain question answering. In Bonnie Webber, Trevor Cohn, Yulan He, and Yang Liu, editors, Proceedings of the 2020 Conference on Empirical Methods in Nat… [find](https://scholar.google.com/scholar?q=Vladimir+Karpukhin%2C+Barlas+Oguz%2C+Sewon+Min%2C+Patrick+Lewis%2C+Ledell+Wu%2C+Sergey+Edunov%2C+Danqi+Chen%2C+and+Wen%2Dtau+Yih%2E+Dense+passage+retrieval+for+open%2Ddomain+question+answering%2E+In+Bonnie+Webber%2C+Trevor+C) [our card](https://md.research.elamur.ai/free/en/papers/karpukhin-2020-dense-passage-retrieval-open-domain/) 90. Aniruddha Kembhavi, Mike Salvato, Eric Kolve, Minjoon Seo, Hannaneh Hajishirzi, and Ali Farhadi. A diagram is worth a dozen images. In ECCV, 2016. [find](https://scholar.google.com/scholar?q=Aniruddha+Kembhavi%2C+Mike+Salvato%2C+Eric+Kolve%2C+Minjoon+Seo%2C+Hannaneh+Hajishirzi%2C+and+Ali+Farhadi%2E+A+diagram+is+worth+a+dozen+images%2E+In+ECCV%2C+2016%2E) [our card](https://md.research.elamur.ai/free/en/papers/kembhavi-2016-diagram-worth-dozen-images/) 91. Young Jin Kim, Ammar Ahmad Awan, Alexandre Muzio, Andres Felipe Cruz Salinas, Liyang Lu, Amr Hendy, Samyam Rajbhandari, Yuxiong He, and Hany Hassan Awadalla. Scalable and efficient moe training for multitask multilingual models. arXiv preprint arXiv:2109.10465, 2021. — [arXiv:2109.10465](https://arxiv.org/abs/2109.10465) [find](https://scholar.google.com/scholar?q=Young+Jin+Kim%2C+Ammar+Ahmad+Awan%2C+Alexandre+Muzio%2C+Andres+Felipe+Cruz+Salinas%2C+Liyang+Lu%2C+Amr+Hendy%2C+Samyam+Rajbhandari%2C+Yuxiong+He%2C+and+Hany+Hassan+Awadalla%2E+Scalable+and+efficient+moe+training+for+mu) 92. Megan Kinniment, Lucas Jun Koba Sato, Haoxing Du, Brian Goodrich, Max Hasin, Lawrence Chan, Luke Harold Miles, Tao R Lin, Hjalmar Wijk, Joel Burget, et al. Evaluating language-model agents on realistic autonomous tasks. arXiv preprint arXiv:2312.11671, 2023. — [arXiv:2312.11671](https://arxiv.org/abs/2312.11671) [find](https://scholar.google.com/scholar?q=Megan+Kinniment%2C+Lucas+Jun+Koba+Sato%2C+Haoxing+Du%2C+Brian+Goodrich%2C+Max+Hasin%2C+Lawrence+Chan%2C+Luke+Harold+Miles%2C+Tao+R+Lin%2C+Hjalmar+Wijk%2C+Joel+Burget%2C+et+al%2E+Evaluating+language%2Dmodel+agents+on+realisti) 93. Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C Berg, Wan-Yen Lo, et al. Segment anything. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 4015–4026, 2023. [find](https://scholar.google.com/scholar?q=Alexander+Kirillov%2C+Eric+Mintun%2C+Nikhila+Ravi%2C+Hanzi+Mao%2C+Chloe+Rolland%2C+Laura+Gustafson%2C+Tete+Xiao%2C+Spencer+Whitehead%2C+Alexander+C+Berg%2C+Wan%2DYen+Lo%2C+et+al%2E+Segment+anything%2E+In+Proceedings+of+the+IEE) [our card](https://md.research.elamur.ai/free/en/papers/kirillov-2023-segment-anything/) 94. R. Kneser and H. Ney. Improved backing-off for m-gram language modeling. In 1995 International Conference on Acoustics, Speech, and Signal Processing, volume 1, pages 181–184 vol.1, 1995. doi: 10.1109/ICASSP.1995.479394. — [doi:10.1109/icassp.1995.479394](https://doi.org/10.1109/icassp.1995.479394) [find](https://scholar.google.com/scholar?q=R%2E+Kneser+and+H%2E+Ney%2E+Improved+backing%2Doff+for+m%2Dgram+language+modeling%2E+In+1995+International+Conference+on+Acoustics%2C+Speech%2C+and+Signal+Processing%2C+volume+1%2C+pages+181%E2%80%93184+vol%2E1%2C+1995%2E+doi%3A+10%2E1109) 95. Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondřej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Philipp Koehn, Benjamin Marie, Christof Monz, Makoto Morishita, Kenton Murray, Makoto Nagata, Toshiaki Nakazawa, Martin P… [find](https://scholar.google.com/scholar?q=Tom+Kocmi%2C+Eleftherios+Avramidis%2C+Rachel+Bawden%2C+Ond%C5%99ej+Bojar%2C+Anton+Dvorkovich%2C+Christian+Federmann%2C+Mark+Fishel%2C+Markus+Freitag%2C+Thamme+Gowda%2C+Roman+Grundkiewicz%2C+Barry+Haddow%2C+Philipp+Koehn%2C+Benjam) 96. Greg Kohs. Alphago. Motion Picture, 2017. Produced by DeepMind Technologies and distributed by Netflix. [find](https://scholar.google.com/scholar?q=Greg+Kohs%2E+Alphago%2E+Motion+Picture%2C+2017%2E+Produced+by+DeepMind+Technologies+and+distributed+by+Netflix%2E) 97. Sneha Kudugunta, Isaac Caswell, Biao Zhang, Xavier Garcia, Christopher A. Choquette-Choo, Katherine Lee, Derrick Xin, Aditya Kusupati, Romi Stella, Ankur Bapna, and Orhan Firat. Madlad-400: A multilingual and document-level large audited dataset, 2023. [find](https://scholar.google.com/scholar?q=Sneha+Kudugunta%2C+Isaac+Caswell%2C+Biao+Zhang%2C+Xavier+Garcia%2C+Christopher+A%2E+Choquette%2DChoo%2C+Katherine+Lee%2C+Derrick+Xin%2C+Aditya+Kusupati%2C+Romi+Stella%2C+Ankur+Bapna%2C+and+Orhan+Firat%2E+Madlad%2D400%3A+A+multilin) [our card](https://md.research.elamur.ai/free/en/papers/kudugunta-2023-madlad-400-multilingual-document-level/) 98. J. Landeghem, R. Powalski, R. Tito, D. Jurkiewicz, M. Blaschko, L. Borchmann, M. Coustaty, S. Moens, M. Pietruszka, B. Ackaert, T. Stanislawek, P. Joziak, and E. Valveny. Document understanding dataset and evaluation (dude). In 2023 IEEE/CVF International Conference on Computer Vision (ICCV), pages… [find](https://scholar.google.com/scholar?q=J%2E+Landeghem%2C+R%2E+Powalski%2C+R%2E+Tito%2C+D%2E+Jurkiewicz%2C+M%2E+Blaschko%2C+L%2E+Borchmann%2C+M%2E+Coustaty%2C+S%2E+Moens%2C+M%2E+Pietruszka%2C+B%2E+Ackaert%2C+T%2E+Stanislawek%2C+P%2E+Joziak%2C+and+E%2E+Valveny%2E+Document+understanding+datase) 99. Dmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen, Orhan Firat, Yanping Huang, Maxim Krikun, Noam Shazeer, and Zhifeng Chen. GShard: Scaling giant models with conditional computation and automatic sharding. In International Conference on Learning Representations, 2020. URL https://openreview… [find](https://scholar.google.com/scholar?q=Dmitry+Lepikhin%2C+HyoukJoong+Lee%2C+Yuanzhong+Xu%2C+Dehao+Chen%2C+Orhan+Firat%2C+Yanping+Huang%2C+Maxim+Krikun%2C+Noam+Shazeer%2C+and+Zhifeng+Chen%2E+GShard%3A+Scaling+giant+models+with+conditional+computation+and+autom) 100. Aitor Lewkowycz, Anders Andreassen, David Dohan, Ethan Dyer, Henryk Michalewski, Vinay Ramasesh, Ambrose Slone, Cem Anil, Imanol Schlag, Theo Gutman-Solo, et al. Solving quantitative reasoning problems with language models. arXiv preprint arXiv:2206.14858, 2022. URL https://arxiv.org/abs/2206.14858… [↗](https://arxiv.org/abs/2206.14858…) [our card](https://md.research.elamur.ai/free/en/papers/lewkowycz-2022-solving-quantitative-reasoning-problems-language/) 101. Fangyu Liu, Francesco Piccinno, Syrine Krichene, Chenxi Pang, Kenton Lee, Mandar Joshi, Yasemin Altun, Nigel Collier, and Julian Eisenschlos. MatCha: Enhancing visual language pretraining with math reasoning and chart derendering. In Anna Rogers, Jordan Boyd-Graber, and Naoaki Okazaki, editors, Proc… [find](https://scholar.google.com/scholar?q=Fangyu+Liu%2C+Francesco+Piccinno%2C+Syrine+Krichene%2C+Chenxi+Pang%2C+Kenton+Lee%2C+Mandar+Joshi%2C+Yasemin+Altun%2C+Nigel+Collier%2C+and+Julian+Eisenschlos%2E+MatCha%3A+Enhancing+visual+language+pretraining+with+math+re) 102. Hao Liu, Wilson Yan, Matei Zaharia, and Pieter Abbeel. World model on million-length video and language with ringattention, 2024. [find](https://scholar.google.com/scholar?q=Hao+Liu%2C+Wilson+Yan%2C+Matei+Zaharia%2C+and+Pieter+Abbeel%2E+World+model+on+million%2Dlength+video+and+language+with+ringattention%2C+2024%2E) 103. Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chunyuan Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, and Jianfeng Gao. Mathvista: Evaluating mathematical reasoning of foundation models in visual contexts. arXiv preprint arXiv:2310.02255, 2023. [find](https://scholar.google.com/scholar?q=Pan+Lu%2C+Hritik+Bansal%2C+Tony+Xia%2C+Jiacheng+Liu%2C+Chunyuan+Li%2C+Hannaneh+Hajishirzi%2C+Hao+Cheng%2C+Kai%2DWei+Chang%2C+Michel+Galley%2C+and+Jianfeng+Gao%2E+Mathvista%3A+Evaluating+mathematical+reasoning+of+foundation+m) [our card](https://md.research.elamur.ai/free/en/papers/lu-2023-mathvista-evaluating-mathematical-reasoning-foundation/) 104. MAA. American invitational mathematics examination - aime. In American Invitational Mathematics Examination - AIME 2024, February 2024. URL [https://maa.org/math-competitions/](https://maa.org/math-competitions/) american-invitational-mathematics-examination-aime . [↗](https://maa.org/math-competitions/) 105. Macknight, Aung, and Gomes. Personal Communication. Arjun Majumdar, Anurag Ajay, Xiaohan Zhang, Pranav Putta, Sriram Yenamandra, Mikael Henaff, Sneha Silwal, Paul Mcvay, Oleksandr Maksymets, Sergio Arnaud, et al. Openeqa: Embodied question answering in the era of foundation models. In 2nd Workshop o… [find](https://scholar.google.com/scholar?q=Macknight%2C+Aung%2C+and+Gomes%2E+Personal+Communication%2E+Arjun+Majumdar%2C+Anurag+Ajay%2C+Xiaohan+Zhang%2C+Pranav+Putta%2C+Sriram+Yenamandra%2C+Mikael+Henaff%2C+Sneha+Silwal%2C+Paul+Mcvay%2C+Oleksandr+Maksymets%2C+Sergio+Ar) 106. Chaitanya Malaviya, Priyanka Agrawal, Kuzman Ganchev, Pranesh Srinivasan, Fantine Huot, Jonathan Berant, Mark Yatskar, Dipanjan Das, Mirella Lapata, and Chris Alberti. Dolomites: Domain-specific long-form methodical tasks, 2024. [find](https://scholar.google.com/scholar?q=Chaitanya+Malaviya%2C+Priyanka+Agrawal%2C+Kuzman+Ganchev%2C+Pranesh+Srinivasan%2C+Fantine+Huot%2C+Jonathan+Berant%2C+Mark+Yatskar%2C+Dipanjan+Das%2C+Mirella+Lapata%2C+and+Chris+Alberti%2E+Dolomites%3A+Domain%2Dspecific+long%2D) 107. Karttikeya Mangalam, Raiymbek Akshulakov, and Jitendra Malik. EgoSchema: A diagnostic benchmark for very long-form video language understanding. In Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2023. [find](https://scholar.google.com/scholar?q=Karttikeya+Mangalam%2C+Raiymbek+Akshulakov%2C+and+Jitendra+Malik%2E+EgoSchema%3A+A+diagnostic+benchmark+for+very+long%2Dform+video+language+understanding%2E+In+Thirty%2Dseventh+Conference+on+Neural+Information+Proc) 108. Pedro Henrique Martins, Zita Marinho, and Andre Martins. ∞-former: Infinite memory transformer. In Smaranda Muresan, Preslav Nakov, and Aline Villavicencio, editors, Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 5468–5485, Dubl… [find](https://scholar.google.com/scholar?q=Pedro+Henrique+Martins%2C+Zita+Marinho%2C+and+Andre+Martins%2E+%E2%88%9E%2Dformer%3A+Infinite+memory+transformer%2E+In+Smaranda+Muresan%2C+Preslav+Nakov%2C+and+Aline+Villavicencio%2C+editors%2C+Proceedings+of+the+60th+Annual+Mee) 109. Ahmed Masry, Do Long, Jia Qing Tan, Shafiq Joty, and Enamul Hoque. ChartQA: A benchmark for question answering about charts with visual and logical reasoning. In Findings of ACL, 2022. [find](https://scholar.google.com/scholar?q=Ahmed+Masry%2C+Do+Long%2C+Jia+Qing+Tan%2C+Shafiq+Joty%2C+and+Enamul+Hoque%2E+ChartQA%3A+A+benchmark+for+question+answering+about+charts+with+visual+and+logical+reasoning%2E+In+Findings+of+ACL%2C+2022%2E) [our card](https://md.research.elamur.ai/free/en/papers/masry-2022-chartqa-benchmark-question-answering-about/) 110. MATH-AI-2023-Panel. Panel discussion. In MATH-AI Workshop at NeurIPS 2023, New Orleans, Louisiana, USA, December 2023. URL [https://mathai2023.github.io/](https://mathai2023.github.io/) . [↗](https://mathai2023.github.io/) 111. Minesh Mathew, Dimosthenis Karatzas, and CV Jawahar. Docvqa: A dataset for vqa on document images. In Proceedings of the IEEE/CVF winter conference on applications of computer vision, pages 2200–2209, 2021. [find](https://scholar.google.com/scholar?q=Minesh+Mathew%2C+Dimosthenis+Karatzas%2C+and+CV+Jawahar%2E+Docvqa%3A+A+dataset+for+vqa+on+document+images%2E+In+Proceedings+of+the+IEEE%2FCVF+winter+conference+on+applications+of+computer+vision%2C+pages+2200%E2%80%932209%2C) [our card](https://md.research.elamur.ai/free/en/papers/mathew-2020-docvqa-dataset-vqa-document-images/) 112. Minesh Mathew, Viraj Bagal, Rubèn Tito, Dimosthenis Karatzas, Ernest Valveny, and CV Jawahar. Infographicvqa. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 1697–1706, 2022. [find](https://scholar.google.com/scholar?q=Minesh+Mathew%2C+Viraj+Bagal%2C+Rub%C3%A8n+Tito%2C+Dimosthenis+Karatzas%2C+Ernest+Valveny%2C+and+CV+Jawahar%2E+Infographicvqa%2E+In+Proceedings+of+the+IEEE%2FCVF+Winter+Conference+on+Applications+of+Computer+Vision%2C+pages) 113. Mantas Mazeika, Andy Zou, Norman Mu, Long Phan, Zifan Wang, Chunru Yu, Adam Khoja, Fengqing Jiang, Aidan O’Gara, Ellie Sakhaee, Zhen Xiang, Arezoo Rajabi, Dan Hendrycks, Radha Poovendran, Bo Li, and David Forsyth. Tdc 2023 (llm edition): The trojan detection challenge. In NeurIPS Competition Track,… [find](https://scholar.google.com/scholar?q=Mantas+Mazeika%2C+Andy+Zou%2C+Norman+Mu%2C+Long+Phan%2C+Zifan+Wang%2C+Chunru+Yu%2C+Adam+Khoja%2C+Fengqing+Jiang%2C+Aidan+O%E2%80%99Gara%2C+Ellie+Sakhaee%2C+Zhen+Xiang%2C+Arezoo+Rajabi%2C+Dan+Hendrycks%2C+Radha+Poovendran%2C+Bo+Li%2C+and+D) 114. Mantas Mazeika, Long Phan, Xuwang Yin, Andy Zou, Zifan Wang, Norman Mu, Elham Sakhaee, Nathaniel Li, Steven Basart, Bo Li, David Forsyth, and Dan Hendrycks. Harmbench: A standardized evaluation framework for automated red teaming and robust refusal. arXiv preprint arXiv:2402.04249, 2024. [find](https://scholar.google.com/scholar?q=Mantas+Mazeika%2C+Long+Phan%2C+Xuwang+Yin%2C+Andy+Zou%2C+Zifan+Wang%2C+Norman+Mu%2C+Elham+Sakhaee%2C+Nathaniel+Li%2C+Steven+Basart%2C+Bo+Li%2C+David+Forsyth%2C+and+Dan+Hendrycks%2E+Harmbench%3A+A+standardized+evaluation+framew) [our card](https://md.research.elamur.ai/free/en/papers/mazeika-2024-harmbench-standardized-evaluation-framework-automated/) 115. J. McMurry. Organic Chemistry. International edition. Brooks/Cole Cengage Learning, 2012. ISBN 9780840054531. URL [https://books.google.at/books?id=oVv4Az7VJRYC](https://books.google.at/books?id=oVv4Az7VJRYC) . [↗](https://books.google.at/books?id=oVv4Az7VJRYC) 116. Tomas Mikolov, Martin Karafiát, Lukas Burget, Jan Cernockỳ, and Sanjeev Khudanpur. Recurrent neural network based language model. In INTERSPEECH, 2010. [find](https://scholar.google.com/scholar?q=Tomas+Mikolov%2C+Martin+Karafi%C3%A1t%2C+Lukas+Burget%2C+Jan+Cernocky%CC%80%2C+and+Sanjeev+Khudanpur%2E+Recurrent+neural+network+based+language+model%2E+In+INTERSPEECH%2C+2010%2E) 117. Sewon Min, Xinxi Lyu, Ari Holtzman, Mikel Artetxe, Mike Lewis, Hannaneh Hajishirzi, and Luke Zettlemoyer. Rethinking the role of demonstrations: What makes in-context learning work? In Yoav Goldberg, Zornitsa Kozareva, and Yue Zhang, editors, Proceedings of the 2022 Conference on Empirical Methods i… [find](https://scholar.google.com/scholar?q=Sewon+Min%2C+Xinxi+Lyu%2C+Ari+Holtzman%2C+Mikel+Artetxe%2C+Mike+Lewis%2C+Hannaneh+Hajishirzi%2C+and+Luke+Zettlemoyer%2E+Rethinking+the+role+of+demonstrations%3A+What+makes+in%2Dcontext+learning+work%3F+In+Yoav+Goldberg%2C+) [our card](https://md.research.elamur.ai/free/en/papers/min-2022-rethinking-role-demonstrations-what-makes/) 118. Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. Model cards for model reporting. In Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT* ’19, page 220–229, New York, NY,… [find](https://scholar.google.com/scholar?q=Margaret+Mitchell%2C+Simone+Wu%2C+Andrew+Zaldivar%2C+Parker+Barnes%2C+Lucy+Vasserman%2C+Ben+Hutchinson%2C+Elena+Spitzer%2C+Inioluwa+Deborah+Raji%2C+and+Timnit+Gebru%2E+Model+cards+for+model+reporting%2E+In+Proceedings+of) 119. Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. Model cards for model reporting. In Proceedings of the conference on Fairness, Accountability, and Transparency, pages 220–229, 2019b. [find](https://scholar.google.com/scholar?q=Margaret+Mitchell%2C+Simone+Wu%2C+Andrew+Zaldivar%2C+Parker+Barnes%2C+Lucy+Vasserman%2C+Ben+Hutchinson%2C+Elena+Spitzer%2C+Inioluwa+Deborah+Raji%2C+and+Timnit+Gebru%2E+Model+cards+for+model+reporting%2E+In+Proceedings+of) 120. Jesse Mu, Xiang Lisa Li, and Noah Goodman. Learning to compress prompts with gist tokens. arXiv preprint arXiv:2304.08467, 2023. [find](https://scholar.google.com/scholar?q=Jesse+Mu%2C+Xiang+Lisa+Li%2C+and+Noah+Goodman%2E+Learning+to+compress+prompts+with+gist+tokens%2E+arXiv+preprint+arXiv%3A2304%2E08467%2C+2023%2E) [our card](https://md.research.elamur.ai/free/en/papers/mu-2023-learning-compress-prompts-gist-tokens/) 121. Milad Nasr, Nicholas Carlini, Jonathan Hayase, Matthew Jagielski, A. Feder Cooper, Daphne Ippolito, Christopher A. Choquette-Choo, Eric Wallace, Florian Tramèr, and Katherine Lee. Scalable extraction of training data from (production) language models, 2023. [find](https://scholar.google.com/scholar?q=Milad+Nasr%2C+Nicholas+Carlini%2C+Jonathan+Hayase%2C+Matthew+Jagielski%2C+A%2E+Feder+Cooper%2C+Daphne+Ippolito%2C+Christopher+A%2E+Choquette%2DChoo%2C+Eric+Wallace%2C+Florian+Tram%C3%A8r%2C+and+Katherine+Lee%2E+Scalable+extraction+) [our card](https://md.research.elamur.ai/free/en/papers/nasr-2023-scalable-extraction-training-data-production/) 122. OpenAI. GPT-4 Technical Report. 2023a. [find](https://scholar.google.com/scholar?q=OpenAI%2E+GPT%2D4+Technical+Report%2E+2023a%2E) [our card](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/) 123. OpenAI. GPT-4V(ision) System Card, 2023b. [find](https://scholar.google.com/scholar?q=OpenAI%2E+GPT%2D4V%28ision%29+System+Card%2C+2023b%2E) 124. OpenAI. Whisper, 2023. URL [https://github.com/openai/whisper](https://github.com/openai/whisper) . [↗](https://github.com/openai/whisper) 125. Antonio Orvieto, Samuel L Smith, Albert Gu, Anushan Fernando, Caglar Gulcehre, Razvan Pascanu, and Soham De. Resurrecting recurrent neural networks for long sequences. arXiv preprint arXiv:2303.06349, 2023. [find](https://scholar.google.com/scholar?q=Antonio+Orvieto%2C+Samuel+L+Smith%2C+Albert+Gu%2C+Anushan+Fernando%2C+Caglar+Gulcehre%2C+Razvan+Pascanu%2C+and+Soham+De%2E+Resurrecting+recurrent+neural+networks+for+long+sequences%2E+arXiv+preprint+arXiv%3A2303%2E06349%2C) 126. Alicia Parrish, Angelica Chen, Nikita Nangia, Vishakh Padmakumar, Jason Phang, Jana Thompson, Phu Mon Htut, and Samuel R. Bowman. BBQ: A hand-built bias benchmark for question answering. CoRR, abs/2110.08193, 2021. URL https://arxiv.org/abs/2110.08193 . [↗](https://arxiv.org/abs/2110.08193) [our card](https://md.research.elamur.ai/free/en/papers/parrish-2022-bbq-hand-built-bias-benchmark/) 127. Mary Phuong, Matthew Aitchison, Elliot Catt, Sarah Cogan, Alexandre Kaskasoli, Victoria Krakovna, David Lindner, Matthew Rahtz, Yannis Assael, Sarah Hodkinson, Heidi Howard, Tom Lieberum, Ramana Kumar, Maria Abi Raad, Albert Webson, Lewis Ho, Sharon Lin, Sebastian Farquhar, Marcus Hutter, Gregoire D… [find](https://scholar.google.com/scholar?q=Mary+Phuong%2C+Matthew+Aitchison%2C+Elliot+Catt%2C+Sarah+Cogan%2C+Alexandre+Kaskasoli%2C+Victoria+Krakovna%2C+David+Lindner%2C+Matthew+Rahtz%2C+Yannis+Assael%2C+Sarah+Hodkinson%2C+Heidi+Howard%2C+Tom+Lieberum%2C+Ramana+Kumar) 128. Reiner Pope, Sholto Douglas, Aakanksha Chowdhery, Jacob Devlin, James Bradbury, Jonathan Heek, Kefan Xiao, Shivani Agrawal, and Jeff Dean. Efficiently scaling transformer inference. Proceedings of Machine Learning and Systems, 5, 2023. [find](https://scholar.google.com/scholar?q=Reiner+Pope%2C+Sholto+Douglas%2C+Aakanksha+Chowdhery%2C+Jacob+Devlin%2C+James+Bradbury%2C+Jonathan+Heek%2C+Kefan+Xiao%2C+Shivani+Agrawal%2C+and+Jeff+Dean%2E+Efficiently+scaling+transformer+inference%2E+Proceedings+of+Mac) 129. Maja Popović. chrF: character n-gram F-score for automatic MT evaluation. In Ondřej Bojar, Rajan Chatterjee, Christian Federmann, Barry Haddow, Chris Hokamp, Matthias Huck, Varvara Logacheva, and Pavel Pecina, editors, Proceedings of the Tenth Workshop on Statistical Machine Translation, pages 392–3… [find](https://scholar.google.com/scholar?q=Maja+Popovi%C4%87%2E+chrF%3A+character+n%2Dgram+F%2Dscore+for+automatic+MT+evaluation%2E+In+Ond%C5%99ej+Bojar%2C+Rajan+Chatterjee%2C+Christian+Federmann%2C+Barry+Haddow%2C+Chris+Hokamp%2C+Matthias+Huck%2C+Varvara+Logacheva%2C+and+Pave) [our card](https://md.research.elamur.ai/free/en/papers/popovic-2015-chrf-character-n-gram-f/) 130. Vineel Pratap, Qiantong Xu, Anuroop Sriram, Gabriel Synnaeve, and Ronan Collobert. Mls: A large-scale multilingual dataset for speech research. arXiv preprint arXiv:2012.03411, 2020. [find](https://scholar.google.com/scholar?q=Vineel+Pratap%2C+Qiantong+Xu%2C+Anuroop+Sriram%2C+Gabriel+Synnaeve%2C+and+Ronan+Collobert%2E+Mls%3A+A+large%2Dscale+multilingual+dataset+for+speech+research%2E+arXiv+preprint+arXiv%3A2012%2E03411%2C+2020%2E) [our card](https://md.research.elamur.ai/free/en/papers/pratap-2020-mls-large-scale-multilingual-dataset/) 131. Ofir Press, Noah A Smith, and Mike Lewis. Train short, test long: Attention with linear biases enables input length extrapolation. arXiv preprint arXiv:2108.12409, 2021. [find](https://scholar.google.com/scholar?q=Ofir+Press%2C+Noah+A+Smith%2C+and+Mike+Lewis%2E+Train+short%2C+test+long%3A+Attention+with+linear+biases+enables+input+length+extrapolation%2E+arXiv+preprint+arXiv%3A2108%2E12409%2C+2021%2E) 132. Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, H. Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-S… [find](https://scholar.google.com/scholar?q=Jack+W%2E+Rae%2C+Sebastian+Borgeaud%2C+Trevor+Cai%2C+Katie+Millican%2C+Jordan+Hoffmann%2C+H%2E+Francis+Song%2C+John+Aslanides%2C+Sarah+Henderson%2C+Roman+Ring%2C+Susannah+Young%2C+Eliza+Rutherford%2C+Tom+Hennigan%2C+Jacob+Menick) 133. Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21(140):1–67, 2020. URL [http://jmlr.org/papers/v21/2…](http://jmlr.org/papers/v21/2…) [↗](http://jmlr.org/papers/v21/2…) 134. David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, and Samuel R Bowman. Gpqa: A graduate-level google-proof q&a benchmark. arXiv preprint arXiv:2311.12022, 2023. [find](https://scholar.google.com/scholar?q=David+Rein%2C+Betty+Li+Hou%2C+Asa+Cooper+Stickland%2C+Jackson+Petty%2C+Richard+Yuanzhe+Pang%2C+Julien+Dirani%2C+Julian+Michael%2C+and+Samuel+R+Bowman%2E+Gpqa%3A+A+graduate%2Dlevel+google%2Dproof+q%26a+benchmark%2E+arXiv+prepri) [our card](https://md.research.elamur.ai/free/en/papers/rein-2023-gpqa-graduate-level-google-proof/) 135. Carlos Riquelme, Joan Puigcerver, Basil Mustafa, Maxim Neumann, Rodolphe Jenatton, André Susano Pinto, Daniel Keysers, and Neil Houlsby. Scaling vision with sparse mixture of experts, 2021. [find](https://scholar.google.com/scholar?q=Carlos+Riquelme%2C+Joan+Puigcerver%2C+Basil+Mustafa%2C+Maxim+Neumann%2C+Rodolphe+Jenatton%2C+Andr%C3%A9+Susano+Pinto%2C+Daniel+Keysers%2C+and+Neil+Houlsby%2E+Scaling+vision+with+sparse+mixture+of+experts%2C+2021%2E) 136. William A Gaviria Rojas, Sudnya Diamos, Keertan Ranjan Kini, David Kanter, Vijay Janapa Reddi, and Cody Coleman. The dollar street dataset: Images representing the geographic and socioeconomic diversity of the world. In Thirty-sixth Conference on Neural Information Processing Systems Datasets and Be… [find](https://scholar.google.com/scholar?q=William+A+Gaviria+Rojas%2C+Sudnya+Diamos%2C+Keertan+Ranjan+Kini%2C+David+Kanter%2C+Vijay+Janapa+Reddi%2C+and+Cody+Coleman%2E+The+dollar+street+dataset%3A+Images+representing+the+geographic+and+socioeconomic+diversi) 137. Stephen Roller, Sainbayar Sukhbaatar, Jason Weston, et al. Hash layers for large sparse models. Advances in Neural Information Processing Systems, 34:17555–17566, 2021. [find](https://scholar.google.com/scholar?q=Stephen+Roller%2C+Sainbayar+Sukhbaatar%2C+Jason+Weston%2C+et+al%2E+Hash+layers+for+large+sparse+models%2E+Advances+in+Neural+Information+Processing+Systems%2C+34%3A17555%E2%80%9317566%2C+2021%2E) 138. Stuart J Russell and Peter Norvig. Artificial intelligence: a modern approach. Pearson, 2016. [find](https://scholar.google.com/scholar?q=Stuart+J+Russell+and+Peter+Norvig%2E+Artificial+intelligence%3A+a+modern+approach%2E+Pearson%2C+2016%2E) 139. Khaled Saab, Tao Tu, Wei-Hung Weng, Ryutaro Tanno, David Stutz, Ellery Wulczyn, Fan Zhang, Tim Strother, Chunjong Park, Elahe Vedadi, et al. Capabilities of Gemini models in medicine. arXiv preprint arXiv:2404.18416, 2024. [find](https://scholar.google.com/scholar?q=Khaled+Saab%2C+Tao+Tu%2C+Wei%2DHung+Weng%2C+Ryutaro+Tanno%2C+David+Stutz%2C+Ellery+Wulczyn%2C+Fan+Zhang%2C+Tim+Strother%2C+Chunjong+Park%2C+Elahe+Vedadi%2C+et+al%2E+Capabilities+of+Gemini+models+in+medicine%2E+arXiv+preprint+a) 140. Keshav Santhanam, Omar Khattab, Jon Saad-Falcon, Christopher Potts, and Matei Zaharia. Colbertv2: Effective and efficient retrieval via lightweight late interaction. arXiv preprint arXiv:2112.01488, 2021. [find](https://scholar.google.com/scholar?q=Keshav+Santhanam%2C+Omar+Khattab%2C+Jon+Saad%2DFalcon%2C+Christopher+Potts%2C+and+Matei+Zaharia%2E+Colbertv2%3A+Effective+and+efficient+retrieval+via+lightweight+late+interaction%2E+arXiv+preprint+arXiv%3A2112%2E01488%2C+2) [our card](https://md.research.elamur.ai/free/en/papers/santhanam-2022-colbertv2-effective-efficient-retrieval-lightweight/) 141. Thibault Sellam, Dipanjan Das, and Ankur Parikh. BLEURT: Learning robust metrics for text generation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 7881–7892, Online, July 2020. Association for Computational Linguistics. doi: 10.18653/v1/2020. acl-… [find](https://scholar.google.com/scholar?q=Thibault+Sellam%2C+Dipanjan+Das%2C+and+Ankur+Parikh%2E+BLEURT%3A+Learning+robust+metrics+for+text+generation%2E+In+Proceedings+of+the+58th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C+pages+) 142. Claude Elwood Shannon. A mathematical theory of communication. The Bell System Technical Journal, 27:379–423, 1948. URL [http://plan9.bell-labs.com/cm/ms/what/shannonday/](http://plan9.bell-labs.com/cm/ms/what/shannonday/) shannon1948.pdf . [↗](http://plan9.bell-labs.com/cm/ms/what/shannonday/) 143. Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc Le, Geoffrey Hinton, and Jeff Dean. Outrageously large neural networks: The sparsely-gated mixture-of-experts layer. In ICLR (Poster). OpenReview.net, 2017. URL [http://dblp.uni-trier.de/db/conf/iclr/](http://dblp.uni-trier.de/db/conf/iclr/) iclr2017.html\#ShazeerMMDLHD17 . [↗](http://dblp.uni-trier.de/db/conf/iclr/) 144. Toby Shevlane, Sebastian Farquhar, Ben Garfinkel, Mary Phuong, Jess Whittlestone, Jade Leung, Daniel Kokotajlo, Nahema Marchal, Markus Anderljung, Noam Kolt, Lewis Ho, Divya Siddarth, Shahar Avin, Will Hawkins, Been Kim, Iason Gabriel, Vijay Bolina, Jack Clark, Yoshua Bengio, Paul Christiano, and Al… [find](https://scholar.google.com/scholar?q=Toby+Shevlane%2C+Sebastian+Farquhar%2C+Ben+Garfinkel%2C+Mary+Phuong%2C+Jess+Whittlestone%2C+Jade+Leung%2C+Daniel+Kokotajlo%2C+Nahema+Marchal%2C+Markus+Anderljung%2C+Noam+Kolt%2C+Lewis+Ho%2C+Divya+Siddarth%2C+Shahar+Avin%2C+Wil) 145. Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, and Jason Wei. Language Models are Multilingual Chain-of-Thought Reasoners. In Proceedings of ICLR 2023, 2023a. URL http://arxiv.org/abs/2210.03… [↗](http://arxiv.org/abs/2210.03…) [our card](https://md.research.elamur.ai/free/en/papers/shi-2022-language-models-multilingual-chain-thought/) 146. Weijia Shi, Sewon Min, Maria Lomeli, Chunting Zhou, Margaret Li, Victoria Lin, Noah A Smith, Luke Zettlemoyer, Scott Yih, and Mike Lewis. In-context pretraining: Language modeling beyond document boundaries. arXiv preprint arXiv:2310.10638, 2023b. [find](https://scholar.google.com/scholar?q=Weijia+Shi%2C+Sewon+Min%2C+Maria+Lomeli%2C+Chunting+Zhou%2C+Margaret+Li%2C+Victoria+Lin%2C+Noah+A+Smith%2C+Luke+Zettlemoyer%2C+Scott+Yih%2C+and+Mike+Lewis%2E+In%2Dcontext+pretraining%3A+Language+modeling+beyond+document+boun) 147. Amanpreet Singh, Vivek Natarajan, Meet Shah, Yu Jiang, Xinlei Chen, Dhruv Batra, Devi Parikh, and Marcus Rohrbach. Towards VQA models that can read. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 8317–8326, 2019. [find](https://scholar.google.com/scholar?q=Amanpreet+Singh%2C+Vivek+Natarajan%2C+Meet+Shah%2C+Yu+Jiang%2C+Xinlei+Chen%2C+Dhruv+Batra%2C+Devi+Parikh%2C+and+Marcus+Rohrbach%2E+Towards+VQA+models+that+can+read%2E+In+Proceedings+of+the+IEEE%2FCVF+conference+on+comput) 148. Ishika Singh, Valts Blukis, Arsalan Mousavian, Ankit Goyal, Danfei Xu, Jonathan Tremblay, Dieter Fox, Jesse Thomason, and Animesh Garg. Progprompt: Generating situated robot task plans using large language models. In 2023 IEEE International Conference on Robotics and Automation (ICRA), pages 11523–1… [find](https://scholar.google.com/scholar?q=Ishika+Singh%2C+Valts+Blukis%2C+Arsalan+Mousavian%2C+Ankit+Goyal%2C+Danfei+Xu%2C+Jonathan+Tremblay%2C+Dieter+Fox%2C+Jesse+Thomason%2C+and+Animesh+Garg%2E+Progprompt%3A+Generating+situated+robot+task+plans+using+large+lan) [our card](https://md.research.elamur.ai/free/en/papers/singh-2022-progprompt-generating-situated-robot-task/) 149. Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, et al. Beyond the imitation game: Quantifying and extrapolating the capabilities of language models. arXiv preprint arXiv:2206.04615, 2022. URL https://arxiv.org/abs/ 2206.04615 . [↗](https://arxiv.org/abs/) [our card](https://md.research.elamur.ai/free/en/papers/srivastava-2022-imitation-game-quantifying-extrapolating-capabilities/) 150. Saurabh Srivastava, Annarose M B, Anto P V au2, Shashank Menon, Ajay Sukumar, Adwaith Samod T, Alan Philipose, Stevin Prince, and Sooraj Thomas. Functional benchmarks for robust evaluation of reasoning performance, and the reasoning gap, 2024. [find](https://scholar.google.com/scholar?q=Saurabh+Srivastava%2C+Annarose+M+B%2C+Anto+P+V+au2%2C+Shashank+Menon%2C+Ajay+Sukumar%2C+Adwaith+Samod+T%2C+Alan+Philipose%2C+Stevin+Prince%2C+and+Sooraj+Thomas%2E+Functional+benchmarks+for+robust+evaluation+of+reasonin) 151. Konrad Staniszewski, Szymon Tworkowski, Sebastian Jaszczur, Henryk Michalewski, Łukasz Kuciński, and Piotr Miłoś. Structured packing in llm training improves long context utilization. arXiv preprint arXiv:2312.17296, 2023. — [arXiv:2312.17296](https://arxiv.org/abs/2312.17296) [find](https://scholar.google.com/scholar?q=Konrad+Staniszewski%2C+Szymon+Tworkowski%2C+Sebastian+Jaszczur%2C+Henryk+Michalewski%2C+%C5%81ukasz+Kuci%C5%84ski%2C+and+Piotr+Mi%C5%82o%C5%9B%2E+Structured+packing+in+llm+training+improves+long+context+utilization%2E+arXiv+preprint+a) 152. Mirac Suzgun, Nathan Scales, Nathanael Schärli, Sebastian Gehrmann, Yi Tay, Hyung Won Chung, Aakanksha Chowdhery, Quoc V Le, Ed H Chi, Denny Zhou, et al. Challenging big-bench tasks and whether chain-of-thought can solve them. arXiv preprint arXiv:2210.09261, 2022. [find](https://scholar.google.com/scholar?q=Mirac+Suzgun%2C+Nathan+Scales%2C+Nathanael+Sch%C3%A4rli%2C+Sebastian+Gehrmann%2C+Yi+Tay%2C+Hyung+Won+Chung%2C+Aakanksha+Chowdhery%2C+Quoc+V+Le%2C+Ed+H+Chi%2C+Denny+Zhou%2C+et+al%2E+Challenging+big%2Dbench+tasks+and+whether+chain%2D) [our card](https://md.research.elamur.ai/free/en/papers/suzgun-2023-challenging-big-bench-tasks-whether/) 153. Garrett Tanzer, Mirac Suzgun, Eline Visser, Dan Jurafsky, and Luke Melas-Kyriazi. A benchmark for learning to translate a new language from one grammar book. In Arxiv, 2023. [find](https://scholar.google.com/scholar?q=Garrett+Tanzer%2C+Mirac+Suzgun%2C+Eline+Visser%2C+Dan+Jurafsky%2C+and+Luke+Melas%2DKyriazi%2E+A+benchmark+for+learning+to+translate+a+new+language+from+one+grammar+book%2E+In+Arxiv%2C+2023%2E) 154. NLLB Team, Marta R. Costa-jussà, James Cross, Onur Çelebi, Maha Elbayad, Kenneth Heafield, Kevin Heffernan, Elahe Kalbassi, Janice Lam, Daniel Licht, Jean Maillard, Anna Sun, Skyler Wang, Guillaume Wenzek, Al Youngblood, Bapi Akula, Loic Barrault, Gabriel Mejia Gonzalez, Prangthip Hansanti, John Hof… [find](https://scholar.google.com/scholar?q=NLLB+Team%2C+Marta+R%2E+Costa%2Djuss%C3%A0%2C+James+Cross%2C+Onur+%C3%87elebi%2C+Maha+Elbayad%2C+Kenneth+Heafield%2C+Kevin+Heffernan%2C+Elahe+Kalbassi%2C+Janice+Lam%2C+Daniel+Licht%2C+Jean+Maillard%2C+Anna+Sun%2C+Skyler+Wang%2C+Guillaume+We) 155. Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, et al. LaMDA: Language models for dialog applications. arXiv preprint arXiv:2201.08239, 2022. URL https://arxiv.org/abs/2201.08239 . [↗](https://arxiv.org/abs/2201.08239) [our card](https://md.research.elamur.ai/free/en/papers/thoppilan-2022-lamda-language-models-dialog-applications/) 156. Kocmi Tom, Eleftherios Avramidis, Rachel Bawden, Ondřej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, et al. Findings of the 2023 conference on machine translation (wmt23): Llms are here but not quite there yet. In WMT23-Eighth Conferenc… [find](https://scholar.google.com/scholar?q=Kocmi+Tom%2C+Eleftherios+Avramidis%2C+Rachel+Bawden%2C+Ond%C5%99ej+Bojar%2C+Anton+Dvorkovich%2C+Christian+Federmann%2C+Mark+Fishel%2C+Markus+Freitag%2C+Thamme+Gowda%2C+Roman+Grundkiewicz%2C+et+al%2E+Findings+of+the+2023+confere) 157. Shubham Toshniwal, Ivan Moshkov, Sean Narenthiran, Daria Gitman, Fei Jia, and Igor Gitman. Openmathinstruct-1: A 1.8 million math instruction tuning dataset, 2024. [find](https://scholar.google.com/scholar?q=Shubham+Toshniwal%2C+Ivan+Moshkov%2C+Sean+Narenthiran%2C+Daria+Gitman%2C+Fei+Jia%2C+and+Igor+Gitman%2E+Openmathinstruct%2D1%3A+A+1%2E8+million+math+instruction+tuning+dataset%2C+2024%2E) 158. Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurelien Rodriguez, Armand Joulin, Edouard Grave, and Guillaume Lample. Llama: Open and efficient foundation language models. arXiv preprint… [find](https://scholar.google.com/scholar?q=Hugo+Touvron%2C+Thibaut+Lavril%2C+Gautier+Izacard%2C+Xavier+Martinet%2C+Marie%2DAnne+Lachaux%2C+Timoth%C3%A9e+Lacroix%2C+Baptiste+Rozi%C3%A8re%2C+Naman+Goyal%2C+Eric+Hambro%2C+Faisal+Azhar%2C+Aurelien+Rodriguez%2C+Armand+Joulin%2C+Edoua) 159. Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller,… [find](https://scholar.google.com/scholar?q=Hugo+Touvron%2C+Louis+Martin%2C+Kevin+Stone%2C+Peter+Albert%2C+Amjad+Almahairi%2C+Yasmine+Babaei%2C+Nikolay+Bashlykov%2C+Soumya+Batra%2C+Prajjwal+Bhargava%2C+Shruti+Bhosale%2C+Dan+Bikel%2C+Lukas+Blecher%2C+Cristian+Canton+Fe) 160. Karthik Valmeekam, Matthew Marquez, Sarath Sreedharan, and Subbarao Kambhampati. On the planning abilities of large language models-a critical investigation. Advances in Neural Information Processing Systems, 36, 2024. [find](https://scholar.google.com/scholar?q=Karthik+Valmeekam%2C+Matthew+Marquez%2C+Sarath+Sreedharan%2C+and+Subbarao+Kambhampati%2E+On+the+planning+abilities+of+large+language+models%2Da+critical+investigation%2E+Advances+in+Neural+Information+Processing+) 161. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. Attention is all you need. CoRR, abs/1706.03762, 2017. URL http://arxiv.org/abs/1706.03762 . [↗](http://arxiv.org/abs/1706.03762) 162. Ramakrishna Vedantam, C Lawrence Zitnick, and Devi Parikh. Cider: Consensus-based image description evaluation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 4566–4575, 2015. [find](https://scholar.google.com/scholar?q=Ramakrishna+Vedantam%2C+C+Lawrence+Zitnick%2C+and+Devi+Parikh%2E+Cider%3A+Consensus%2Dbased+image+description+evaluation%2E+In+Proceedings+of+the+IEEE+conference+on+computer+vision+and+pattern+recognition%2C+pages+) [our card](https://md.research.elamur.ai/free/en/papers/vedantam-2014-cider-consensus-based-image-description/) 163. Eline Visser. Kalamang dictionary. Dictionaria, (13):1–2737, 2020a. URL [https://dictionaria.clld.org/contributions/kalamang](https://dictionaria.clld.org/contributions/kalamang) . [↗](https://dictionaria.clld.org/contributions/kalamang) 164. Eline Visser. A grammar of kalamang: The papuan language of the karas islands. 2020b. [find](https://scholar.google.com/scholar?q=Eline+Visser%2E+A+grammar+of+kalamang%3A+The+papuan+language+of+the+karas+islands%2E+2020b%2E) 165. Eline Visser. The Kalamang collection: an archive of linguistic and cultural material from Karas. Lund: Humlab, Lund University Humanities Lab, 2020c. URL [http://hdl.handle.net/10050/](http://hdl.handle.net/10050/) 00-0000-0000-0003-C3E8-1 . [↗](http://hdl.handle.net/10050/) 166. Changhan Wang, Anne Wu, and Juan Pino. Covost 2 and massively multilingual speech-to-text translation. arXiv preprint arXiv:2007.10310, 2020. [find](https://scholar.google.com/scholar?q=Changhan+Wang%2C+Anne+Wu%2C+and+Juan+Pino%2E+Covost+2+and+massively+multilingual+speech%2Dto%2Dtext+translation%2E+arXiv+preprint+arXiv%3A2007%2E10310%2C+2020%2E) 167. Changhan Wang, Morgane Riviere, Ann Lee, Anne Wu, Chaitanya Talnikar, Daniel Haziza, Mary Williamson, Juan Pino, and Emmanuel Dupoux. Voxpopuli: A large-scale multilingual speech corpus for representation learning, semi-supervised learning and interpretation. arXiv preprint arXiv:2101.00390, 2021. [find](https://scholar.google.com/scholar?q=Changhan+Wang%2C+Morgane+Riviere%2C+Ann+Lee%2C+Anne+Wu%2C+Chaitanya+Talnikar%2C+Daniel+Haziza%2C+Mary+Williamson%2C+Juan+Pino%2C+and+Emmanuel+Dupoux%2E+Voxpopuli%3A+A+large%2Dscale+multilingual+speech+corpus+for+representa) [our card](https://md.research.elamur.ai/free/en/papers/wang-2021-voxpopuli-large-scale-multilingual-speech/) 168. Xin Wang, Jiawei Wu, Junkun Chen, Lei Li, Yuan-Fang Wang, and William Yang Wang. VATEX: A large-scale, high-quality multilingual dataset for video-and-language research. In ICCV, 2019a. [find](https://scholar.google.com/scholar?q=Xin+Wang%2C+Jiawei+Wu%2C+Junkun+Chen%2C+Lei+Li%2C+Yuan%2DFang+Wang%2C+and+William+Yang+Wang%2E+VATEX%3A+A+large%2Dscale%2C+high%2Dquality+multilingual+dataset+for+video%2Dand%2Dlanguage+research%2E+In+ICCV%2C+2019a%2E) 169. Xinda Wang, Kun Sun, Archer Batcheller, and Sushil Jajodia. Detecting "0-day" vulnerability: An empirical study of secret security patch in OSS. In IEEE/IFIP International Conference on Dependable Systems and Networks, pages 485–492. IEEE, 2019b. URL [https://csis.gmu.edu/ksun/](https://csis.gmu.edu/ksun/) publications/secretpat… [↗](https://csis.gmu.edu/ksun/) 170. Laura Weidinger, John Mellor, Maribeth Rauh, Conor Griffin, Jonathan Uesato, Po-Sen Huang, Myra Cheng, Mia Glaese, Borja Balle, Atoosa Kasirzadeh, et al. Ethical and social risks of harm from language models. arXiv preprint arXiv:2112.04359, 2021. [find](https://scholar.google.com/scholar?q=Laura+Weidinger%2C+John+Mellor%2C+Maribeth+Rauh%2C+Conor+Griffin%2C+Jonathan+Uesato%2C+Po%2DSen+Huang%2C+Myra+Cheng%2C+Mia+Glaese%2C+Borja+Balle%2C+Atoosa+Kasirzadeh%2C+et+al%2E+Ethical+and+social+risks+of+harm+from+language) [our card](https://md.research.elamur.ai/free/en/papers/weidinger-2021-ethical-social-risks-harm-language/) 171. Laura Weidinger, Joslyn Barnhart, Jenny Brennan, Christina Butterfield, Susie Young, Will Hawkins, Lisa Anne Hendricks, Ramona Comanescu, Oscar Chang, Mikel Rodriguez, et al. Holistic safety and responsibility evaluations of advanced ai models. arXiv preprint arXiv:2404.14068, 2024. — [arXiv:2404.14068](https://arxiv.org/abs/2404.14068) [find](https://scholar.google.com/scholar?q=Laura+Weidinger%2C+Joslyn+Barnhart%2C+Jenny+Brennan%2C+Christina+Butterfield%2C+Susie+Young%2C+Will+Hawkins%2C+Lisa+Anne+Hendricks%2C+Ramona+Comanescu%2C+Oscar+Chang%2C+Mikel+Rodriguez%2C+et+al%2E+Holistic+safety+and+respo) 172. Wikipedia contributors. Skeletal formula — Wikipedia, the free encyclopedia, 2024. URL [https://en.wikipedia.org/w/index.php?title=Skeletal_formula&oldid=1221781655](https://en.wikipedia.org/w/index.php?title=Skeletal_formula&oldid=1221781655) . [Online; accessed 7-May-2024]. [↗](https://en.wikipedia.org/w/index.php?title=Skeletal_formula&oldid=1221781655) 173. World Economic Forum. Jobs of Tomorrow: Large Language Models and Jobs. 2023. URL [https://www3.weforum.org/docs/WEF_Jobs_of_Tomorrow_Generative_AI_2023.pdf](https://www3.weforum.org/docs/WEF_Jobs_of_Tomorrow_Generative_AI_2023.pdf) . [↗](https://www3.weforum.org/docs/WEF_Jobs_of_Tomorrow_Generative_AI_2023.pdf) 174. Penghao Wu and Saining Xie. V*: Guided visual search as a core mechanism in multimodal llms. arXiv preprint arXiv:2312.14135, 2023. [find](https://scholar.google.com/scholar?q=Penghao+Wu+and+Saining+Xie%2E+V%2A%3A+Guided+visual+search+as+a+core+mechanism+in+multimodal+llms%2E+arXiv+preprint+arXiv%3A2312%2E14135%2C+2023%2E) 175. Qingyang Wu, Zhenzhong Lan, Kun Qian, Jing Gu, Alborz Geramifard, and Zhou Yu. Memformer: A memory-augmented transformer for sequence modeling. In Yulan He, Heng Ji, Sujian Li, Yang Liu, and Chua-Hui Chang, editors, Findings of the Association for Computational Linguistics: AACL-IJCNLP 2022, pages 3… [find](https://scholar.google.com/scholar?q=Qingyang+Wu%2C+Zhenzhong+Lan%2C+Kun+Qian%2C+Jing+Gu%2C+Alborz+Geramifard%2C+and+Zhou+Yu%2E+Memformer%3A+A+memory%2Daugmented+transformer+for+sequence+modeling%2E+In+Yulan+He%2C+Heng+Ji%2C+Sujian+Li%2C+Yang+Liu%2C+and+Chua%2DHui+) 176. Yuhuai Wu, Markus N Rabe, DeLesley Hutchins, and Christian Szegedy. Memorizing transformers. arXiv preprint arXiv:2203.08913, 2022b. wunderwuzzi. Hacking Google Bard - From Prompt Injection to Data Exfiltration. [https://embracethered.com/blog/posts/2023/google-bard-data-exfiltration/](https://embracethered.com/blog/posts/2023/google-bard-data-exfiltration/), 2023. x.ai. Gr… [↗](https://embracethered.com/blog/posts/2023/google-bard-data-exfiltration/) 177. Wenhan Xiong, Jingyu Liu, Igor Molybog, Hejia Zhang, Prajjwal Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, et al. Effective long-context scaling of foundation models. arXiv preprint arXiv:2309.16039, 2023. [find](https://scholar.google.com/scholar?q=Wenhan+Xiong%2C+Jingyu+Liu%2C+Igor+Molybog%2C+Hejia+Zhang%2C+Prajjwal+Bhargava%2C+Rui+Hou%2C+Louis+Martin%2C+Rashi+Rungta%2C+Karthik+Abinav+Sankararaman%2C+Barlas+Oguz%2C+et+al%2E+Effective+long%2Dcontext+scaling+of+foundati) [our card](https://md.research.elamur.ai/free/en/papers/xiong-2023-effective-long-context-scaling-foundation/) 178. XLA. XLA: Optimizing compiler for TensorFlow. [https://www.tensorflow.org/xla](https://www.tensorflow.org/xla) , 2019. [Online; accessed December-2023]. [↗](https://www.tensorflow.org/xla) 179. Yuanzhong Xu, HyoukJoong Lee, Dehao Chen, Blake Hechtman, Yanping Huang, Rahul Joshi, Maxim Krikun, Dmitry Lepikhin, Andy Ly, Marcello Maggioni, et al. Gspmd: general and scalable parallelization for ml computation graphs. arXiv preprint arXiv:2105.04663, 2021. — [arXiv:2105.04663](https://arxiv.org/abs/2105.04663) [find](https://scholar.google.com/scholar?q=Yuanzhong+Xu%2C+HyoukJoong+Lee%2C+Dehao+Chen%2C+Blake+Hechtman%2C+Yanping+Huang%2C+Rahul+Joshi%2C+Maxim+Krikun%2C+Dmitry+Lepikhin%2C+Andy+Ly%2C+Marcello+Maggioni%2C+et+al%2E+Gspmd%3A+general+and+scalable+parallelization+for+) 180. Fanjia Yan, Huanzhi Mao, Charlie Cheng-Jie Ji, Tianjun Zhang, Shishir G. Patil, Ion Stoica, and Joseph E. Gonzalez. Berkeley function calling leaderboard. 2024. [find](https://scholar.google.com/scholar?q=Fanjia+Yan%2C+Huanzhi+Mao%2C+Charlie+Cheng%2DJie+Ji%2C+Tianjun+Zhang%2C+Shishir+G%2E+Patil%2C+Ion+Stoica%2C+and+Joseph+E%2E+Gonzalez%2E+Berkeley+function+calling+leaderboard%2E+2024%2E) 181. Chengrun Yang, Xuezhi Wang, Yifeng Lu, Hanxiao Liu, Quoc V. Le, Denny Zhou, and Xinyun Chen. Large language models as optimizers, 2023a. [find](https://scholar.google.com/scholar?q=Chengrun+Yang%2C+Xuezhi+Wang%2C+Yifeng+Lu%2C+Hanxiao+Liu%2C+Quoc+V%2E+Le%2C+Denny+Zhou%2C+and+Xinyun+Chen%2E+Large+language+models+as+optimizers%2C+2023a%2E) [our card](https://md.research.elamur.ai/free/en/papers/yang-2023-large-language-models-optimizers/) 182. John Yang, Akshara Prabhakar, Karthik Narasimhan, and Shunyu Yao. InterCode: Standardizing and benchmarking interactive coding with execution feedback. ArXiv, June 2023b. URL https://arxiv.org/abs/2306.14898 . [↗](https://arxiv.org/abs/2306.14898) 183. Kenneth found Yeung. misuse. New google 2024. gemini URL vulnerability enabling pro-https://hiddenlayer.com/ research/new-google-gemini-content-manipulation-vulns-found/ \#Indirect-Injections-are-back! [find](https://scholar.google.com/scholar?q=Kenneth+found+Yeung%2E+misuse%2E+New+google+2024%2E+gemini+URL+vulnerability+enabling+pro%2Dhttps%3A%2F%2Fhiddenlayer%2Ecom%2F+research%2Fnew%2Dgoogle%2Dgemini%2Dcontent%2Dmanipulation%2Dvulns%2Dfound%2F+%5C%23Indirect%2DInjections%2Dare%2Dback) 184. Emine Yilmaz, Manisha Verma, Rishabh Mehrotra, Evangelos Kanoulas, Ben Carterette, and Nick Craswell. Overview of the TREC 2015 tasks track. In Proceedings of the Twenty-Fourth Text REtrieval Conference (TREC 2015), 2015. URL [https://trec.nist.gov/pubs/trec24/papers/](https://trec.nist.gov/pubs/trec24/papers/) Overview-T.pdf . [↗](https://trec.nist.gov/pubs/trec24/papers/) 185. Zhou Yu, Dejing Xu, Jun Yu, Ting Yu, Zhou Zhao, Yueting Zhuang, and Dacheng Tao. ActivityNet-QA: A dataset for understanding complex web videos via question answering. In AAAI, 2019. [find](https://scholar.google.com/scholar?q=Zhou+Yu%2C+Dejing+Xu%2C+Jun+Yu%2C+Ting+Yu%2C+Zhou+Zhao%2C+Yueting+Zhuang%2C+and+Dacheng+Tao%2E+ActivityNet%2DQA%3A+A+dataset+for+understanding+complex+web+videos+via+question+answering%2E+In+AAAI%2C+2019%2E) [our card](https://md.research.elamur.ai/free/en/papers/yu-2019-activitynet-qa-dataset-understanding-complex/) 186. Xiang Yue, Yuansheng Ni, Kai Zhang, Tianyu Zheng, Ruoqi Liu, Ge Zhang, Samuel Stevens, Dongfu Jiang, Weiming Ren, Yuxuan Sun, Cong Wei, Botao Yu, Ruibin Yuan, Renliang Sun, Ming Yin, Boyuan Zheng, Zhenzhu Yang, Yibo Liu, Wenhao Huang, Huan Sun, Yu Su, and Wenhu Chen. Mmmu: A massive multi-discipline… [find](https://scholar.google.com/scholar?q=Xiang+Yue%2C+Yuansheng+Ni%2C+Kai+Zhang%2C+Tianyu+Zheng%2C+Ruoqi+Liu%2C+Ge+Zhang%2C+Samuel+Stevens%2C+Dongfu+Jiang%2C+Weiming+Ren%2C+Yuxuan+Sun%2C+Cong+Wei%2C+Botao+Yu%2C+Ruibin+Yuan%2C+Renliang+Sun%2C+Ming+Yin%2C+Boyuan+Zheng%2C+Zhe) [our card](https://md.research.elamur.ai/free/en/papers/yue-2023-mmmu-massive-multi-discipline-multimodal/) 187. Manzil Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie, Chris Alberti, Santiago Ontanon, Philip Pham, Anirudh Ravula, Qifan Wang, Li Yang, et al. Big bird: Transformers for longer sequences. Advances in Neural Information Processing Systems, 33:17283–17297, 2020. [find](https://scholar.google.com/scholar?q=Manzil+Zaheer%2C+Guru+Guruganesh%2C+Kumar+Avinava+Dubey%2C+Joshua+Ainslie%2C+Chris+Alberti%2C+Santiago+Ontanon%2C+Philip+Pham%2C+Anirudh+Ravula%2C+Qifan+Wang%2C+Li+Yang%2C+et+al%2E+Big+bird%3A+Transformers+for+longer+sequenc) [our card](https://md.research.elamur.ai/free/en/papers/zaheer-2020-big-bird-transformers-longer-sequences/) 188. Rowan Zellers, Ari Holtzman, Yonatan Bisk, Ali Farhadi, and Yejin Choi. Hellaswag: Can a machine really finish your sentence? arXiv preprint arXiv:1905.07830, 2019. [find](https://scholar.google.com/scholar?q=Rowan+Zellers%2C+Ari+Holtzman%2C+Yonatan+Bisk%2C+Ali+Farhadi%2C+and+Yejin+Choi%2E+Hellaswag%3A+Can+a+machine+really+finish+your+sentence%3F+arXiv+preprint+arXiv%3A1905%2E07830%2C+2019%2E) 189. Biao Zhang, Barry Haddow, and Alexandra Birch. Prompting large language model for machine translation: a case study. In Proceedings of the 40th International Conference on Machine Learning, ICML’23. JMLR.org, 2023a. [find](https://scholar.google.com/scholar?q=Biao+Zhang%2C+Barry+Haddow%2C+and+Alexandra+Birch%2E+Prompting+large+language+model+for+machine+translation%3A+a+case+study%2E+In+Proceedings+of+the+40th+International+Conference+on+Machine+Learning%2C+ICML%E2%80%9923%2E+J) [our card](https://md.research.elamur.ai/free/en/papers/zhang-2023-prompting-large-language-model-machine/) 190. Michael Zhang and Christopher Ré. Contrastive adapters for foundation model group robustness. Advances in Neural Information Processing Systems, 35:21682–21697, 2022. [find](https://scholar.google.com/scholar?q=Michael+Zhang+and+Christopher+R%C3%A9%2E+Contrastive+adapters+for+foundation+model+group+robustness%2E+Advances+in+Neural+Information+Processing+Systems%2C+35%3A21682%E2%80%9321697%2C+2022%2E) 191. Yu Zhang, Wei Han, James Qin, Yongqiang Wang, Ankur Bapna, Zhehuai Chen, Nanxin Chen, Bo Li, Vera Axelrod, Gary Wang, Zhong Meng, Ke Hu, Andrew Rosenberg, Rohit Prabhavalkar, Daniel S. Park, Parisa Haghani, Jason Riesa, Ginger Perng, Hagen Soltau, Trevor Strohman, Bhuvana Ramabhadran, Tara Sainath,… — [arXiv:2303.01037](https://arxiv.org/abs/2303.01037) [find](https://scholar.google.com/scholar?q=Yu+Zhang%2C+Wei+Han%2C+James+Qin%2C+Yongqiang+Wang%2C+Ankur+Bapna%2C+Zhehuai+Chen%2C+Nanxin+Chen%2C+Bo+Li%2C+Vera+Axelrod%2C+Gary+Wang%2C+Zhong+Meng%2C+Ke+Hu%2C+Andrew+Rosenberg%2C+Rohit+Prabhavalkar%2C+Daniel+S%2E+Park%2C+Parisa+Ha) 192. Dora Zhao, Angelina Wang, and Olga Russakovsky. Understanding and evaluating racial biases in image captioning. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 14830–14840, 2021. [find](https://scholar.google.com/scholar?q=Dora+Zhao%2C+Angelina+Wang%2C+and+Olga+Russakovsky%2E+Understanding+and+evaluating+racial+biases+in+image+captioning%2E+In+Proceedings+of+the+IEEE%2FCVF+International+Conference+on+Computer+Vision%2C+pages+14830%E2%80%93) 193. Zexuan Zhong, Tao Lei, and Danqi Chen. Training language models with memory augmentation. In Yoav Goldberg, Zornitsa Kozareva, and Yue Zhang, editors, Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 5657–5673, Abu Dhabi, United Arab Emirates, December 20… [find](https://scholar.google.com/scholar?q=Zexuan+Zhong%2C+Tao+Lei%2C+and+Danqi+Chen%2E+Training+language+models+with+memory+augmentation%2E+In+Yoav+Goldberg%2C+Zornitsa+Kozareva%2C+and+Yue+Zhang%2C+editors%2C+Proceedings+of+the+2022+Conference+on+Empirical+M) 194. Luowei Zhou, Chenliang Xu, and Jason J Corso. Towards automatic learning of procedures from web instructional videos. In AAAI Conference on Artificial Intelligence, pages 7590–7598, 2018. [find](https://scholar.google.com/scholar?q=Luowei+Zhou%2C+Chenliang+Xu%2C+and+Jason+J+Corso%2E+Towards+automatic+learning+of+procedures+from+web+instructional+videos%2E+In+AAAI+Conference+on+Artificial+Intelligence%2C+pages+7590%E2%80%937598%2C+2018%2E) 195. Yaqin Zhou, Jing Kai Siow, Chenyu Wang, Shangqing Liu, and Yang Liu. SPI: Automated identification of security patches via commits. ACM Transactions on Software Engineering and Methodology, 31 (1):1–27, 2021. [find](https://scholar.google.com/scholar?q=Yaqin+Zhou%2C+Jing+Kai+Siow%2C+Chenyu+Wang%2C+Shangqing+Liu%2C+and+Yang+Liu%2E+SPI%3A+Automated+identification+of+security+patches+via+commits%2E+ACM+Transactions+on+Software+Engineering+and+Methodology%2C+31+%281%29%3A1%E2%80%932) 196. Fengbin Zhu, Wenqiang Lei, Fuli Feng, Chao Wang, Haozhou Zhang, and Tat-Seng Chua. Towards complex document understanding by discrete reasoning. In Proceedings of the 30th ACM International Conference on Multimedia, page 4857–4866, 2022. [find](https://scholar.google.com/scholar?q=Fengbin+Zhu%2C+Wenqiang+Lei%2C+Fuli+Feng%2C+Chao+Wang%2C+Haozhou+Zhang%2C+and+Tat%2DSeng+Chua%2E+Towards+complex+document+understanding+by+discrete+reasoning%2E+In+Proceedings+of+the+30th+ACM+International+Conference) 197. Barret Zoph, Irwan Bello, Sameer Kumar, Nan Du, Yanping Huang, Jeff Dean, Noam Shazeer, and William Fedus. Designing effective sparse expert models. arXiv preprint arXiv:2202.08906, 2022. URL https://arxiv.org/abs/2202.08906 . [↗](https://arxiv.org/abs/2202.08906) 198. Andy Zou, Zifan Wang, J Zico Kolter, and Matt Fredrikson. Universal and transferable adversarial attacks on aligned language models. arXiv preprint arXiv:2307.15043, 2023. \#\# 11. Contributions and Acknowledgments Core Contributors Petko Georgiev Ving Ian Lei Ryan Burnell Libin Bai Anmol Gulati Garre… [find](https://scholar.google.com/scholar?q=Andy+Zou%2C+Zifan+Wang%2C+J+Zico+Kolter%2C+and+Matt+Fredrikson%2E+Universal+and+transferable+adversarial+attacks+on+aligned+language+models%2E+arXiv+preprint+arXiv%3A2307%2E15043%2C+2023%2E+%5C%23%5C%23+11%2E+Contributions+and+A) [our card](https://md.research.elamur.ai/free/en/papers/zou-2023-universal-transferable-adversarial-attacks-aligned/) 199. Within each role, contributions are equal, and are listed in a randomized order. Ordering within each role does not indicate ordering of the contributions. Gemini is a cross-Google effort, with members from Google DeepMind (GDM), Google Research (GR), Bard/Assistant, Knowledge and Information (K&I),… [find](https://scholar.google.com/scholar?q=Within+each+role%2C+contributions+are+equal%2C+and+are+listed+in+a+randomized+order%2E+Ordering+within+each+role+does+not+indicate+ordering+of+the+contributions%2E+Gemini+is+a+cross%2DGoogle+effort%2C+with+member)