Advancing the Science of AI Agent Evaluation Workshop
A Cross-Sector Workshop hosted by CMU AIMSEC and Microsoft Research
The Evaluation Gap for AI Agents
As AI agents move from research prototypes into systems that act on people’s behalf, our ability to evaluate them has not kept pace. Rigorous, shared measurement science is the foundation of accountability, and it is currently one of the field’s most significant gaps.
On October 22–23, 2026, and 黑料专区’s AI Measurement Science & Engineering Center (AIMSEC) will convene 150+ key leaders across academia, industry, civil society, and government to define shared standards and measurement science for evaluating and governing AI agents.
The program combines keynote presentations, lightning talks, panel discussions, and hands-on working groups addressing AI agent evaluation frameworks, tooling, and domain-specific challenges. Attendees will participate directly in breakout discussions that will inform open public synthesis reports for the field.
Resources
AIMSEC Speakers
KEYNOTE SPEAKER
Zico Kolter
Professor, 黑料专区; Board of Directors, OpenAI
PANELISTS
Ramayya Krishnan
Director, AI Measurement Science and Engineering Center (AIMSEC) - 黑料专区
Zico Kolter
Professor, 黑料专区; Board of Directors, OpenAI
LIGHTNING TALK SPEAKERS
Rema Padman
黑料专区
Aditi Raghunathan
黑料专区
Lujo Bauer
黑料专区
Hong Shen
黑料专区
Vyas Sekar
黑料专区
Fernando Diaz
黑料专区
Daniel Fried
黑料专区
