{"id":2605,"date":"2025-07-15T04:36:54","date_gmt":"2025-07-15T04:36:54","guid":{"rendered":"https:\/\/ci.acm.org\/2025\/?page_id=2605"},"modified":"2025-07-18T21:01:49","modified_gmt":"2025-07-18T21:01:49","slug":"adam-kalai","status":"publish","type":"page","link":"https:\/\/ci.acm.org\/2025\/speakers\/adam-kalai\/","title":{"rendered":"Adam Kalai"},"content":{"rendered":"\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" width=\"1024\" height=\"1024\" data-src=\"https:\/\/ci.acm.org\/2025\/wp-content\/uploads\/2025\/05\/Instagram-Post-38-CI-25-Designs-1024x1024.png\" alt=\"\" class=\"wp-image-2354 lazyload\" data-srcset=\"https:\/\/ci.acm.org\/2025\/wp-content\/uploads\/2025\/05\/Instagram-Post-38-CI-25-Designs-1024x1024.png 1024w, https:\/\/ci.acm.org\/2025\/wp-content\/uploads\/2025\/05\/Instagram-Post-38-CI-25-Designs-300x300.png 300w, https:\/\/ci.acm.org\/2025\/wp-content\/uploads\/2025\/05\/Instagram-Post-38-CI-25-Designs-150x150.png 150w, https:\/\/ci.acm.org\/2025\/wp-content\/uploads\/2025\/05\/Instagram-Post-38-CI-25-Designs-768x768.png 768w, https:\/\/ci.acm.org\/2025\/wp-content\/uploads\/2025\/05\/Instagram-Post-38-CI-25-Designs.png 1080w\" data-sizes=\"(max-width: 1024px) 100vw, 1024px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 1024px; --smush-placeholder-aspect-ratio: 1024\/1024;\" \/><\/figure>\n\n\n\n\n\n<h3>Human Feedback in Reinforcement Learning Improves Chatbot Fairness<\/h3>\n\n\n\n<strong>Adam Kalai<br><\/strong>Research Scientist, AI Safety and Ethics, OpenAI\n\n\n\nAdam Tauman Kalai is a Research Scientist at OpenAI, specializing in AI Safety and Ethics. His research spans algorithms, fairness, machine learning theory, game theory, and crowdsourcing. Adam earned his BA from Harvard University and his PhD from Carnegie Mellon University, after which he served as an Assistant Professor at both Georgia Tech and the Toyota Technological Institute at Chicago. He also contributes to Project CETI\u2019s science team, an interdisciplinary initiative dedicated to decoding sperm whale communication. In addition, Adam has co-chaired leading conferences such as COLT (Conference on Learning Theory), HCOMP (Conference on Human Computation), and NEML. His work has been recognized with numerous honors, including several best paper awards, an NSF CAREER Award, an Alfred P. Sloan Fellowship, and most notably the Majulook Prize.<br>\n\n\n\n<strong>Learn more<\/strong><br>Website: <a href=\"https:\/\/kal.ai\/\" target=\"_blank\" rel=\"noopener\" title=\"\"><mark style=\"background-color:rgba(0, 0, 0, 0);color:#41649c\" class=\"has-inline-color\">https:\/\/kal.ai\/<\/mark><\/a><br><br><strong>Read these<\/strong><br><a href=\"https:\/\/arxiv.org\/abs\/2410.19803\" target=\"_blank\" rel=\"noopener\" title=\"\"><mark style=\"background-color:rgba(0, 0, 0, 0);color:#41649c\" class=\"has-inline-color\">First-Person Fairness in Chatbots<\/mark><\/a> by Tyna Eloundou, et al., 2024.<br><a href=\"https:\/\/dl.acm.org\/doi\/abs\/10.1145\/3618260.3649777\" target=\"_blank\" rel=\"noopener\" title=\"\"><mark style=\"background-color:rgba(0, 0, 0, 0);color:#41649c\" class=\"has-inline-color\">Calibrated language models must hallucinate<\/mark><\/a> by Adam Tauman Kalai and Santosh Vempala, 2024.<br><a href=\"https:\/\/proceedings.mlr.press\/v202\/aher23a.html\" target=\"_blank\" rel=\"noopener\" title=\"\"><mark style=\"background-color:rgba(0, 0, 0, 0);color:#41649c\" class=\"has-inline-color\">Using large language models to simulate multiple humans and replicate human subject studies<\/mark><\/a> by Gati Aher, Rosa Arriaga, and Adam Tauman Kalai, 2023.\n\n\n\n\n\n<div style=\"height:50px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"parent":2137,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_eb_attr":"","pagelayer_contact_templates":[],"_pagelayer_content":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_uf_show_specific_survey":0,"_uf_disable_surveys":false,"footnotes":""},"class_list":["post-2605","page","type-page","status-publish","hentry"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 4.9.8 - aioseo.com -->\n\t<meta name=\"description\" content=\"Human Feedback in Reinforcement Learning Improves Chatbot Fairness Adam KalaiResearch Scientist, AI Safety and Ethics, OpenAI Adam Tauman Kalai is a Research Scientist at OpenAI, specializing in AI Safety and Ethics. His research spans algorithms, fairness, machine learning theory, game theory, and crowdsourcing. Adam earned his BA from Harvard University and his PhD from Carnegie\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<link rel=\"canonical\" href=\"https:\/\/ci.acm.org\/2025\/speakers\/adam-kalai\/\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 4.9.8\" \/>\n\t\t<meta property=\"og:locale\" content=\"en_US\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ACM Collective Intelligence 2025 - ACM CI 2025\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"Adam Kalai - ACM Collective Intelligence 2025\" \/>\n\t\t<meta property=\"og:description\" content=\"Human Feedback in Reinforcement Learning Improves Chatbot Fairness Adam KalaiResearch Scientist, AI Safety and Ethics, OpenAI Adam Tauman Kalai is a Research Scientist at OpenAI, specializing in AI Safety and Ethics. His research spans algorithms, fairness, machine learning theory, game theory, and crowdsourcing. Adam earned his BA from Harvard University and his PhD from Carnegie\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/ci.acm.org\/2025\/speakers\/adam-kalai\/\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/ci.acm.org\/2025\/wp-content\/uploads\/2025\/01\/cropped-ci-2025-thicker-black-horizontal-Logo-1.png\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/ci.acm.org\/2025\/wp-content\/uploads\/2025\/01\/cropped-ci-2025-thicker-black-horizontal-Logo-1.png\" \/>\n\t\t<meta property=\"og:image:width\" content=\"1239\" \/>\n\t\t<meta property=\"og:image:height\" content=\"436\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2025-07-15T04:36:54+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2025-07-18T21:01:49+00:00\" \/>\n\t\t<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n\t\t<meta name=\"twitter:title\" content=\"Adam Kalai - ACM Collective Intelligence 2025\" \/>\n\t\t<meta name=\"twitter:description\" content=\"Human Feedback in Reinforcement Learning Improves Chatbot Fairness Adam KalaiResearch Scientist, AI Safety and Ethics, OpenAI Adam Tauman Kalai is a Research Scientist at OpenAI, specializing in AI Safety and Ethics. His research spans algorithms, fairness, machine learning theory, game theory, and crowdsourcing. Adam earned his BA from Harvard University and his PhD from Carnegie\" \/>\n\t\t<meta name=\"twitter:image\" content=\"https:\/\/ci.acm.org\/2025\/wp-content\/uploads\/2025\/01\/cropped-ci-2025-thicker-black-horizontal-Logo-1.png\" \/>\n\t\t<script type=\"application\/ld+json\" class=\"aioseo-schema\">\n\t\t\t{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/speakers\\\/adam-kalai\\\/#breadcrumblist\",\"itemListElement\":[{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/ci.acm.org\\\/2025#listItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/ci.acm.org\\\/2025\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/speakers\\\/#listItem\",\"name\":\"Speakers\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/speakers\\\/#listItem\",\"position\":2,\"name\":\"Speakers\",\"item\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/speakers\\\/\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/speakers\\\/adam-kalai\\\/#listItem\",\"name\":\"Adam Kalai\"},\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/ci.acm.org\\\/2025#listItem\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/speakers\\\/adam-kalai\\\/#listItem\",\"position\":3,\"name\":\"Adam Kalai\",\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/speakers\\\/#listItem\",\"name\":\"Speakers\"}}]},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/#organization\",\"name\":\"ACM Collective Intelligence 2025\",\"description\":\"ACM CI 2025\",\"url\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/cropped-ci-2025-thicker-black-horizontal-Logo-1.png\",\"@id\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/speakers\\\/adam-kalai\\\/#organizationLogo\",\"width\":1239,\"height\":436},\"image\":{\"@id\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/speakers\\\/adam-kalai\\\/#organizationLogo\"}},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/speakers\\\/adam-kalai\\\/#webpage\",\"url\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/speakers\\\/adam-kalai\\\/\",\"name\":\"Adam Kalai - ACM Collective Intelligence 2025\",\"description\":\"Human Feedback in Reinforcement Learning Improves Chatbot Fairness Adam KalaiResearch Scientist, AI Safety and Ethics, OpenAI Adam Tauman Kalai is a Research Scientist at OpenAI, specializing in AI Safety and Ethics. His research spans algorithms, fairness, machine learning theory, game theory, and crowdsourcing. Adam earned his BA from Harvard University and his PhD from Carnegie\",\"inLanguage\":\"en-US\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/#website\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/speakers\\\/adam-kalai\\\/#breadcrumblist\"},\"datePublished\":\"2025-07-15T04:36:54+00:00\",\"dateModified\":\"2025-07-18T21:01:49+00:00\"},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/#website\",\"url\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/\",\"name\":\"ACM Collective Intelligence 2025\",\"description\":\"ACM CI 2025\",\"inLanguage\":\"en-US\",\"publisher\":{\"@id\":\"https:\\\/\\\/ci.acm.org\\\/2025\\\/#organization\"}}]}\n\t\t<\/script>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"Adam Kalai - ACM Collective Intelligence 2025","description":"Human Feedback in Reinforcement Learning Improves Chatbot Fairness Adam KalaiResearch Scientist, AI Safety and Ethics, OpenAI Adam Tauman Kalai is a Research Scientist at OpenAI, specializing in AI Safety and Ethics. His research spans algorithms, fairness, machine learning theory, game theory, and crowdsourcing. Adam earned his BA from Harvard University and his PhD from Carnegie","canonical_url":"https:\/\/ci.acm.org\/2025\/speakers\/adam-kalai\/","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"BreadcrumbList","@id":"https:\/\/ci.acm.org\/2025\/speakers\/adam-kalai\/#breadcrumblist","itemListElement":[{"@type":"ListItem","@id":"https:\/\/ci.acm.org\/2025#listItem","position":1,"name":"Home","item":"https:\/\/ci.acm.org\/2025","nextItem":{"@type":"ListItem","@id":"https:\/\/ci.acm.org\/2025\/speakers\/#listItem","name":"Speakers"}},{"@type":"ListItem","@id":"https:\/\/ci.acm.org\/2025\/speakers\/#listItem","position":2,"name":"Speakers","item":"https:\/\/ci.acm.org\/2025\/speakers\/","nextItem":{"@type":"ListItem","@id":"https:\/\/ci.acm.org\/2025\/speakers\/adam-kalai\/#listItem","name":"Adam Kalai"},"previousItem":{"@type":"ListItem","@id":"https:\/\/ci.acm.org\/2025#listItem","name":"Home"}},{"@type":"ListItem","@id":"https:\/\/ci.acm.org\/2025\/speakers\/adam-kalai\/#listItem","position":3,"name":"Adam Kalai","previousItem":{"@type":"ListItem","@id":"https:\/\/ci.acm.org\/2025\/speakers\/#listItem","name":"Speakers"}}]},{"@type":"Organization","@id":"https:\/\/ci.acm.org\/2025\/#organization","name":"ACM Collective Intelligence 2025","description":"ACM CI 2025","url":"https:\/\/ci.acm.org\/2025\/","logo":{"@type":"ImageObject","url":"https:\/\/ci.acm.org\/2025\/wp-content\/uploads\/2025\/01\/cropped-ci-2025-thicker-black-horizontal-Logo-1.png","@id":"https:\/\/ci.acm.org\/2025\/speakers\/adam-kalai\/#organizationLogo","width":1239,"height":436},"image":{"@id":"https:\/\/ci.acm.org\/2025\/speakers\/adam-kalai\/#organizationLogo"}},{"@type":"WebPage","@id":"https:\/\/ci.acm.org\/2025\/speakers\/adam-kalai\/#webpage","url":"https:\/\/ci.acm.org\/2025\/speakers\/adam-kalai\/","name":"Adam Kalai - ACM Collective Intelligence 2025","description":"Human Feedback in Reinforcement Learning Improves Chatbot Fairness Adam KalaiResearch Scientist, AI Safety and Ethics, OpenAI Adam Tauman Kalai is a Research Scientist at OpenAI, specializing in AI Safety and Ethics. His research spans algorithms, fairness, machine learning theory, game theory, and crowdsourcing. Adam earned his BA from Harvard University and his PhD from Carnegie","inLanguage":"en-US","isPartOf":{"@id":"https:\/\/ci.acm.org\/2025\/#website"},"breadcrumb":{"@id":"https:\/\/ci.acm.org\/2025\/speakers\/adam-kalai\/#breadcrumblist"},"datePublished":"2025-07-15T04:36:54+00:00","dateModified":"2025-07-18T21:01:49+00:00"},{"@type":"WebSite","@id":"https:\/\/ci.acm.org\/2025\/#website","url":"https:\/\/ci.acm.org\/2025\/","name":"ACM Collective Intelligence 2025","description":"ACM CI 2025","inLanguage":"en-US","publisher":{"@id":"https:\/\/ci.acm.org\/2025\/#organization"}}]},"og:locale":"en_US","og:site_name":"ACM Collective Intelligence 2025 - ACM CI 2025","og:type":"article","og:title":"Adam Kalai - ACM Collective Intelligence 2025","og:description":"Human Feedback in Reinforcement Learning Improves Chatbot Fairness Adam KalaiResearch Scientist, AI Safety and Ethics, OpenAI Adam Tauman Kalai is a Research Scientist at OpenAI, specializing in AI Safety and Ethics. His research spans algorithms, fairness, machine learning theory, game theory, and crowdsourcing. Adam earned his BA from Harvard University and his PhD from Carnegie","og:url":"https:\/\/ci.acm.org\/2025\/speakers\/adam-kalai\/","og:image":"https:\/\/ci.acm.org\/2025\/wp-content\/uploads\/2025\/01\/cropped-ci-2025-thicker-black-horizontal-Logo-1.png","og:image:secure_url":"https:\/\/ci.acm.org\/2025\/wp-content\/uploads\/2025\/01\/cropped-ci-2025-thicker-black-horizontal-Logo-1.png","og:image:width":1239,"og:image:height":436,"article:published_time":"2025-07-15T04:36:54+00:00","article:modified_time":"2025-07-18T21:01:49+00:00","twitter:card":"summary_large_image","twitter:title":"Adam Kalai - ACM Collective Intelligence 2025","twitter:description":"Human Feedback in Reinforcement Learning Improves Chatbot Fairness Adam KalaiResearch Scientist, AI Safety and Ethics, OpenAI Adam Tauman Kalai is a Research Scientist at OpenAI, specializing in AI Safety and Ethics. His research spans algorithms, fairness, machine learning theory, game theory, and crowdsourcing. Adam earned his BA from Harvard University and his PhD from Carnegie","twitter:image":"https:\/\/ci.acm.org\/2025\/wp-content\/uploads\/2025\/01\/cropped-ci-2025-thicker-black-horizontal-Logo-1.png"},"aioseo_meta_data":{"post_id":"2605","title":null,"description":null,"keywords":null,"keyphrases":{"focus":{"keyphrase":"","score":0,"analysis":{"keyphraseInTitle":{"score":0,"maxScore":9,"error":1}}},"additional":[]},"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":"","og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"WebPage","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":"-1","robots_max_videopreview":"-1","robots_max_imagepreview":"large","priority":null,"frequency":"default","local_seo":null,"breadcrumb_settings":null,"limit_modified_date":false,"ai":{"faqs":[],"keyPoints":[],"titles":[],"descriptions":[],"socialPosts":{"email":[],"linkedin":[],"twitter":[],"facebook":[],"instagram":[]}},"created":"2025-07-15 04:36:54","updated":"2025-07-18 21:03:53","seo_analyzer_scan_date":null},"aioseo_breadcrumb":"<div class=\"aioseo-breadcrumbs\"><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/ci.acm.org\/2025\" title=\"Home\">Home<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/ci.acm.org\/2025\/speakers\/\" title=\"Speakers\">Speakers<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\tAdam Kalai\n\t\t<\/span><\/div>","aioseo_breadcrumb_json":[{"label":"Home","link":"https:\/\/ci.acm.org\/2025"},{"label":"Speakers","link":"https:\/\/ci.acm.org\/2025\/speakers\/"},{"label":"Adam Kalai","link":"https:\/\/ci.acm.org\/2025\/speakers\/adam-kalai\/"}],"_links":{"self":[{"href":"https:\/\/ci.acm.org\/2025\/wp-json\/wp\/v2\/pages\/2605","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ci.acm.org\/2025\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/ci.acm.org\/2025\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/ci.acm.org\/2025\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ci.acm.org\/2025\/wp-json\/wp\/v2\/comments?post=2605"}],"version-history":[{"count":10,"href":"https:\/\/ci.acm.org\/2025\/wp-json\/wp\/v2\/pages\/2605\/revisions"}],"predecessor-version":[{"id":2780,"href":"https:\/\/ci.acm.org\/2025\/wp-json\/wp\/v2\/pages\/2605\/revisions\/2780"}],"up":[{"embeddable":true,"href":"https:\/\/ci.acm.org\/2025\/wp-json\/wp\/v2\/pages\/2137"}],"wp:attachment":[{"href":"https:\/\/ci.acm.org\/2025\/wp-json\/wp\/v2\/media?parent=2605"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}