CHOMPS 2025
The 1st workshop on Confabulation, Hallucinations & Overgeneration in Multilingual and Practical Settings
Advances in hallucination mitigation in practical situations:
multilingual and precision-critical domains
In conjunction with AACL-IJCNLP 2025
23rd December, 2025, Mumbai, India (On-Site)
News and Updates
- [30 September, 2025] Paper submission deadline extension. New deadline: 03 October, 2025 (AoE). Submit via our OpenReview submission page.
- [26 May, 2025] Website Launched!
Overview
Despite rapid advances, LLMs continue to "make things up": a phenomenon that manifests as hallucination, confabulation, and overgeneration. That is, produce unsupported and unverifiable text that sounds deceptively plausible. These outputs pose real risks in settings where accuracy and accountability are non-negotiable, including healthcare, legal systems, and education. The aim of the CHOMPS workshop is to find ways to mitigate one of major the hurdles that currently prevent the adoption of Large Language Models in real-world scenarios: namely, their tendency to hallucinate, i.e., produce unsupported and unverifiable text that sounds deceptively plausible.
Call for Papers
The workshop will explore hallucination mitigation in practical situations, where this mitigation is crucial: in particular, precision-critical applications (such as those in the medical, legal and biotech domains), as well as multilingual settings (given the lack of resources available to reproduce what can be done for English in other linguistic contexts). In practice, we intend to invite works of the following (not exclusive) list of topics:
- Metrics, benchmarks and tools for hallucination detection
- Factuality challenges in mission critical & domain-specific (e.g., medical, legal, biotech) and their consequences on societal, engineering and practical levels
- Mitigation strategies during inference or model training
- Studies of hallucinatory and confabulatory behaviors of LLMS in cross-lingual and multilingual scenarios
- Confabulations in language & multimodal (vision, text, speech) models
- Perspectives and case studies from other disciplines
Important dates
- First call for papers: July 22, 2025
- Second call for papers: August 22, 2025
- Third call for papers: September 22, 2025
- Paper submission deadline:
September 29, 2025October 03, 2025 - Direct ARR commitment: October 27, 2025
- Author notification: November 3, 2025
- Camera-Ready due: November 11, 2025
- Workshop date: December 23rd, 2025 (TBC)
Submission guidelines
The workshop is designed with a widely inclusive submission policy so as to foster as vibrant a discussion as possible. In particular, we will accept:
- Archival submissions, corresponding to novel and unpublished research, to be included in the workshop proceedings,
- Non-archival submissions, corresponding to work in progress and early results,
- Dissemination submissions, articles presented in other venues that engage with the topics of the workshop.
Submission Format: Paper submissions must use the official ACL style templates, which are available either as an Overleaf template or via downloading LaTeX or Word files. We strongly encourage participants to use the LaTeX template. All submissions must be in PDF format and must conform to the official style guidelines, which are contained in these template files. For anonymity policy, we follow the ARR anonimity policy. For additional submission instructions, please check the Author Guidelines.
Submissions' Site: (a) via Direct submission (b) via ARR commitement
Keynote Speakers
Dr.
Anna Rogers
IT University of Copenhagen, Denmark
Website
Anna Rogers is a tenured Associate Professor in the Data Science Section at the IT University of Copenhagen, affiliated with the NLPNorth research group. Her research focuses on model analysis and evaluation of natural language understanding systems, with a keen interest in interpretability and robustness of NLP systems based on Large Language Models.
Dr.
Danish Pruthi
IISc Bangalore, India
Website
Danish Pruthi is an Assistant Professor at the Indian Institute of Science (IISc), Bangalore. He received his Ph.D. from the School of Computer Science at Carnegie Mellon University. His research focuses on addressing issues concerning the interpretability of deep learning models, and more recently, in geo-cultural representation in AI and understanding the behavior of Large Language Models.
Dr.
Abhilasha Ravichander
University of Washington, USA
Website
Abhilasha Ravichander is a postdoctoral scholar at the Paul G. Allen Center for Computer Science and Engineering at the University of Washington. Her work focuses on building trustworthy language models by developing rigorous diagnostic techniques for models and datasets, and by creating methods to understand large language models and the principles that govern them.
Dr.
Khyathi Raghavi Chandu
Mistral AI
Website
Khyathi Raghavi Chandu is a AI Research Scientist at Mistral AI. She received her Ph.D. from Carnegie Mellon University. Her research centers on developing and training large-scale models with an expertise on grounded multimodal long-form generation, more recently, practical pathways for building more reliable LLMs, focusing on multimodality.
Panelists
Preslav Nakov
MBZUAI
Sunayana Sitaram
Microsoft Research India
Chung-Chi Chen
NII, Japan
Shared Task: SHROOM-CAP
Shared-task on Hallucinations and Related Observable Overgeneration Mistakes in Crosslingual Analyses of Publications (SHROOM-CAP)
This task is the III edition in the SHROOM shared tasks series. This shared task focuses on evaluating language models for scientific cross-lingual hallucination detection, where we explore the hallucination difference between high resource and low resource languages. To participate fill the registration form: https://forms.gle/hWR9jwTBjZQmFKAE7 . For more information visit the website: https://helsinki-nlp.github.io/shroom/2025a
Program Committee
|
|
Organizers
Aman Sinha
University of Lorraine, France
Website
Timothee Mickus
University of Helsinki, Finland
Website
Raul Vazquez
University of Helsinki, Finland
Website
Ioana Buhnila
University of Lorraine, France
Website
Rohit Agarwal
UiT Tromsø, Norway
Website
Patricia Schmidtova
Charles University, Prague
Website
Jörg Tiedmann
University of Helsinki, Finland
Website
Dilip K. Prasad
UiT Tromsø, Norway
Website
Shared Task Organizers
Federica Gamba
Charles University, Prague
Website
Laura Zanella
Independent Reseacher
Website
Ahana Chattopadhyay
Orange Labs, France
Website
Yash Kankanampati
Université Sorbonne Paris Nord, France
Website
Binesh Arakkal Remesh
Universit\'e de Lorraine, France
Website
Aryan Chandramania
IIIT Hyderabad, India
Website
Call For Sponsors
If interested, please reach out to us at chomps-aacl2025@googlegroups.com