AI Model Evaluation

Debiased Gaussian Process-based Machine Learning with Partially Observed Information

Yanwen Xu, University of Texas at Dallas
Shengxiang Wu, JP Morgan Chase
Xuehui Chao, JP Morgan Chase

Hilton Waikoloa Village, Hawaii

12:00 AM - 12:00 AM

Visit Site

Exploring User Evaluations of Machine Learning Models: A Qualitative Study on the Impact of Confidence Intervals

Scott Meyers, DCS Corporation
Paige Murry, DCS Corporation
Sarah Jessup, Air Force Research Laboratory
Gene Alarcon, Air Force Research Laboratory
Krista Harris, DCS Corporation

Hilton Waikoloa Village, Hawaii

12:00 AM - 12:00 AM

Visit Site

Introduction to the Minitrack on AI Model Evaluation

Julia Rayz, Purdue University
Radmila Juric, ALMAIS Consultancy
Robert Steele, Quantic School of Business and Technology

Hilton Waikoloa Village, Hawaii

12:00 AM - 12:00 AM

Visit Site

Reinforcement Learning for Adversarial Environments

Christian Carrizales, Wright State University
Xiaodong (Frank) Zhang, Wright State University
Trevor Bihl, Air Force Research Laboratory

Hilton Waikoloa Village, Hawaii

12:00 AM - 12:00 AM

Visit Site

Simulating Strategic Reasoning: Comparing the Ability of Single LLMs and Multi-Agent Systems to Replicate Human Behavior

Karthik Sreedhar, Columbia University
Lydia Chilton, Columbia University

Hilton Waikoloa Village, Hawaii

12:00 AM - 12:00 AM

Visit Site

The Reliability Paradox: Exploring How Shortcut Learning Undermines Language Model Calibration

Geetanjali Bihani, Purdue University
Julia Rayz, Purdue University

Hilton Waikoloa Village, Hawaii

12:00 AM - 12:00 AM

Visit Site