Tootfinder

LLMs and their Limited Theory of Mind: Evaluating Mental State Annotations in Situated Dialogue
Katharine Kowalyshyn, Matthias Scheutz
https://arxiv.org/abs/2509.02292 https://

LLMs and their Limited Theory of Mind: Evaluating Mental State Annotations in Situated Dialogue
What if large language models could not only infer human mindsets but also expose every blind spot in team dialogue such as discrepancies in the team members' joint understanding? We present a novel, two-step framework that leverages large language models (LLMs) both as human-style annotators of team dialogues to track the team's shared mental models (SMMs) and as automated discrepancy detectors among individuals' mental states. In the first step, an LLM generates annotations by identifying SMM…