Tootfinder

ProxAnn: Use-Oriented Evaluations of Topic Models and Document Clustering
Alexander Hoyle, Lorena Calvo-Bartolom\'e, Jordan Boyd-Graber, Philip Resnik
https://arxiv.org/abs/2507.00828

ProxAnn: Use-Oriented Evaluations of Topic Models and Document Clustering
Topic model and document-clustering evaluations either use automated metrics that align poorly with human preferences or require expert labels that are intractable to scale. We design a scalable human evaluation protocol and a corresponding automated approximation that reflect practitioners' real-world usage of models. Annotators -- or an LLM-based proxy -- review text items assigned to a topic or cluster, infer a category for the group, then apply that category to other documents. Using this p…

A Versatile Dataset of Mouse and Eye Movements on Search Engine Results Pages
Kayhan Latifzadeh, Jacek Gwizdka, Luis A. Leiva
https://arxiv.org/abs/2507.08003

A Versatile Dataset of Mouse and Eye Movements on Search Engine Results Pages
We contribute a comprehensive dataset to study user attention and purchasing behavior on Search Engine Result Pages (SERPs). Previous work has relied on mouse movements as a low-cost large-scale behavioral proxy but also has relied on self-reported ground-truth labels, collected at post-task, which can be inaccurate and prone to biases. To address this limitation, we use an eye tracker to construct an objective ground-truth of continuous visual attention. Our dataset comprises 2,776 transaction…