John’s research focuses on the challenges of evaluating the capability and generality of AI systems, how these concepts relate to risk posed by the system and how this risk can be mitigated. He has a PhD in Computer Science from the University of York, as well as a Master’s degree in Computer Science from Oriel College, Oxford.
Related resources
-
-
Exploring AI Safety in Degrees: Generality, Capability and Control
Paper by John Burden, José Hernández-Orallo
-
Safety-driven design of machine learning for sepsis treatment
Paper by John Burden, Yan Jia, Tom Lawton, John McDermid, Ibrahim Habli
-
Your Prompt is My Command: On Assessing the Human-Centred Generality of Multimodal Models
Paper by Wout Schellaert, Fernando Martínez-Plumed, Karina Vold, John Burden, Pablo A. M. Casares, Bao Sheng Loe, Roi Reichart, Seán Ó hÉigeartaigh, Anna Korhonen, José Hernández-Orallo
-
How General-Purpose Is a Language Model? Usefulness and Safety with Human Prompters in the Wild
Paper by John Burden, Pablo Antonio Moreno Casares, Bao Sheng Loe, José Hernández-Orallo, Seán Ó hÉigeartaigh
-
-
-
Predictable Artificial Intelligence
Paper by Lexin Zhou, Pablo A. Moreno-Casares, Fernando Martínez-Plumed, John Burden, Ryan Burnell, Lucy Cheke, Cèsar Ferri, Alexandru Marcoci, Behzad Mehrbakhsh, Yael Moros-Daval, Seán Ó hÉigeartaigh, Danaja Rutar, Wout Schellaert, Konstantinos Voudouris, José Hernández-Orallo
-
Harms from Increasingly Agentic Algorithmic Systems
Paper by Alan Chan, Rebecca Salganik, Alva Markelius, Chris Pang, Nitarshan Rajkumar, Dmitrii Krasheninnikov, Lauro Langosco, Zhonghao He, Yawen Duan, Micah Carroll, Michelle Lin, Alex Mayhew, Katherine Collins, Maryam Molamohammadi, John Burden, Wanru Zhao, Shalaleh Rismani, Konstantinos Voudouris, Umang Bhatt, Adrian Weller, David Krueger, Tegan Maharaj