Optical response of a binary atomic system with incoherent gain
L. Acevedo, J. S\'anchez-C\'anovas, M. Donaire
https://arxiv.org/abs/2506.21177 htt…
Institutional Noise, Strategic Deviation, and Intertemporal Collapse: A Formal Model of Miner Behaviour under Protocol Uncertainty
Craig Steven Wright
https://arxiv.org/abs/2506.20992
Potemkin Understanding in Large Language Models
Marina Mancoridis, Bec Weeks, Keyon Vafa, Sendhil Mullainathan
https://arxiv.org/abs/2506.21521 https://arxiv.org/pdf/2506.21521 https://arxiv.org/html/2506.21521
arXiv:2506.21521v1 Announce Type: new
Abstract: Large language models (LLMs) are regularly evaluated using benchmark datasets. But what justifies making inferences about an LLM's capabilities based on its answers to a curated set of questions? This paper first introduces a formal framework to address this question. The key is to note that the benchmarks used to test LLMs -- such as AP exams -- are also those used to test people. However, this raises an implication: these benchmarks are only valid tests if LLMs misunderstand concepts in ways that mirror human misunderstandings. Otherwise, success on benchmarks only demonstrates potemkin understanding: the illusion of understanding driven by answers irreconcilable with how any human would interpret a concept. We present two procedures for quantifying the existence of potemkins: one using a specially designed benchmark in three domains, the other using a general procedure that provides a lower-bound on their prevalence. We find that potemkins are ubiquitous across models, tasks, and domains. We also find that these failures reflect not just incorrect understanding, but deeper internal incoherence in concept representations.
toXiv_bot_toot
Pasadena officially condemns immigration raids with vote on formal statement – NBC Los Angeles
https://www.nbclosangeles.com/news/local/pasadena-votes-to-officially-condemns-immigration-raids/3730964/
Bulls vs Bears: a Trinomial Model of a Financial Asset
Nahuel I. Arca
https://arxiv.org/abs/2505.18723 https://arxiv.org/pdf/2505.187…
The Composition of Digital Twins for Systems-of-Systems: a Systematic Literature Review
Mennatullah T. Khedr, John S. Fitzgerald
https://arxiv.org/abs/2506.20435
I increasingly think that we need mandatory formal training for PhD students in “research as a profession” (as it exists in other countries, apparently).
Yes, submitting a paper to a conference (in particular as a first author) constitutes an commitment to present the paper if it’s accepted. When working with coauthors, no, you can’t tacitly assume that they’ll take care of it.
And yes, a workshop on Monday from 09:00 to 12:30 takes place during “normal working hours.”
Stochastic Preconditioning for Neural Field Optimization
Selena Ling, Merlin Nimier-David, Alec Jacobson, Nicholas Sharp
https://arxiv.org/abs/2505.20473 h…
hdbayes: An R Package for Bayesian Analysis of Generalized Linear Models Using Historical Data
Ethan M. Alt, Xinxin Chen, Luiz M. Carvalho, Joseph G. Ibrahim
https://arxiv.org/abs/2506.20060
COIN: Uncertainty-Guarding Selective Question Answering for Foundation Models with Provable Risk Guarantees
Zhiyuan Wang, Jinhao Duan, Qingni Wang, Xiaofeng Zhu, Tianlong Chen, Xiaoshuang Shi, Kaidi Xu
https://arxiv.org/abs/2506.20178