Tootfinder

Straightforward Bayesian A/B testing with Dirichlet posteriors
Dustin Hayden, Thomas Armitage
https://arxiv.org/abs/2508.08077 https://arxiv.org/pdf/2508.0…

Straightforward Bayesian A/B testing with Dirichlet posteriors
Bayesian A/B testing investigates metric changes using the joint posterior distribution of two (or more) experimentally-derived datasets. The construction of said joint posterior is often a time-consuming process requiring specialized knowledge and domain expertise. In businesses that perform tens to hundreds of A/B tests per month it is important to have a robust analysis pipeline that can handle the variety of experiments performed on a modern web platform; requiring a domain expert to select…

from my link log —
What is my fuzzer doing? How to get coverage of Rust code.
https://tweedegolf.nl/en/blog/154/what-is-my-fuzzer-doing
saved 2025-05-06

What is my fuzzer doing? - Blog - Tweede golf
Fuzz testing is incredibly useful: it has caught many a bug during the development of NTP packet parsing and gzip/bzip2 (de)compression. But I've always been unsatisfied with the fuzzer being a b ...

A proposal and assessment of an improved heuristic for the Eager Test smell detection
Huynh Khanh Vi Tran, Nauman bin Ali, Michael Unterkalmsteiner, J\"urgen B\"orstler
https://arxiv.org/abs/2507.06354

A proposal and assessment of an improved heuristic for the Eager Test smell detection
Context: The evidence for the prevalence of test smells at the unit testing level has relied on the accuracy of detection tools, which have seen intense research in the last two decades. The Eager Test smell, one of the most prevalent, is often identified using simplified detection rules that practitioners find inadequate. Objective: We aim to improve the rules for detecting the Eager Test smell. Method: We reviewed the literature on test smells to analyze the definitions and detection rules of…

Quality attributes of test cases and test suites -- importance & challenges from practitioners' perspectives
Huynh Khanh Vi Tran, Nauman bin Ali, Michael Unterkalmsteiner, J\"urgen B\"orstler, Panagiota Chatzipetrou
https://arxiv.org/abs/2507.06343

Quality attributes of test cases and test suites -- importance & challenges from practitioners' perspectives
Context: The quality of the test suites and the constituent test cases significantly impacts confidence in software testing. While research has identified several quality attributes of test cases and test suites, there is a need for a better understanding of their relative importance in practice. Objective: We investigate practitioners' perceptions regarding the relative importance of quality attributes of test cases and test suites and the challenges they face in ensuring the perceived importa…

Prompting Science Report 3: I'll pay you or I'll kill you -- but will you care?
Lennart Meincke, Ethan Mollick, Lilach Mollick, Dan Shapiro
https://arxiv.org/abs/2508.00614

Prompting Science Report 3: I'll pay you or I'll kill you -- but will you care?
This is the third in a series of short reports that seek to help business, education, and policy leaders understand the technical details of working with AI through rigorous testing. In this report, we investigate two commonly held prompting beliefs: a) offering to tip the AI model and b) threatening the AI model. Tipping was a commonly shared tactic for improving AI performance and threats have been endorsed by Google Founder Sergey Brin (All-In, May 2025, 8:20) who observed that 'models tend …

A Two-armed Bandit Framework for A/B Testing
Jinjuan Wang, Qianglin Wen, Yu Zhang, Xiaodong Yan, Chengchun Shi
https://arxiv.org/abs/2507.18118 https://arx…

A Two-armed Bandit Framework for A/B Testing
A/B testing is widely used in modern technology companies for policy evaluation and product deployment, with the goal of comparing the outcomes under a newly-developed policy against a standard control. Various causal inference and reinforcement learning methods developed in the literature are applicable to A/B testing. This paper introduces a two-armed bandit framework designed to improve the power of existing approaches. The proposed procedure consists of three main steps: (i) employing doubl…

What is going on in the land of Fedora Linux?
First, the latest kernel in Fedora 42 recently went from "working" to "broken" with regard to the video screen on Intel(R) Core(TM) Ultra 7 155H on an ASUSTeK COMPUTER INC. NUC14RVK-B/NUC14RVBU7
Second, the update repositories now all have invalid checksums. (Update: this is now corrected.)
Fedora is Redhat is IBM - you would think that they could do some regression testing and maybe do a better locking of t…

Brazil’s Chamber of Deputies Approves Bill Banning Cosmetic Testing on Live Vertebrates https://vegconomist.com/politics-law/brazil-approves-bill-banning-cosmetic-testing-live-vertebrates/

Brazil's Chamber of Deputies Approves Bill Banning Cosmetic Testing on Live Vertebrates - vegconomist - the vegan business magazine
Brazil's Chamber of Deputies has approved the Senate's substitute text for a bill that would ban the testing of cosmetics, personal hygiene products, and

Locally Differentially Private Two-Sample Testing
Alexander Kent, Thomas B. Berrett, Yi Yu
https://arxiv.org/abs/2505.24811 https://a…

Locally Differentially Private Two-Sample Testing
We consider the problem of two-sample testing under a local differential privacy constraint where a permutation procedure is used to calibrate the tests. We develop testing procedures which are optimal up to logarithmic factors, for general discrete distributions and continuous distributions subject to a smoothness constraint. Both non-interactive and interactive tests are considered, and we show allowing interactivity results in an improvement in the minimax separation rates. Our results show …

The multi-physics analysis, design and testing of CUSP, a CubeSat mission for space weather and solar flares x-ray polarimetry
Giovanni Lombardi, Sergio Fabiani, Ettore Del Monte, Andrea Alimenti, Riccardo Campana, Mauro Centrone, Enrico Costa, Nicolas De Angelis, Giovanni De Cesare, Sergio Di Cosimo, Giuseppe Di Persio, Abhay Kumar, Alessandro Lacerenza, Pasqualino Loffredo, Gabriele Minervini, Fabio Muleri, Paolo Romano, Alda Rubini, Emanuele Scalise, Enrico Silva, Paolo Soffitta, Da…

The multi-physics analysis, design and testing of CUSP, a CubeSat mission for space weather and solar flares x-ray polarimetry
The space-based CUbesat Solar Polarimeter (CUSP) mission aims to measure the linear polarization of solar flares in the hard X-ray band by means of a Compton scattering polarimeter. CUSP is a project in the framework of the Alcor Program of the Italian Space Agency aimed at developing new CubeSat missions. As part of CUSP's Phase B study, which began in December 2024 and will last one year, we present the current development status of the design solutions adopted for the mission's most critical…

Xbow, whose AI tool automates penetration testing and topped HackerOne's US leaderboard for finding and reporting software bugs, raised a $75M Series B (Dina Bass/Bloomberg)
https://www.bloomberg.com/news/articles/2025-06-…

Investigating New Physics through the Observables of Semileptonic $B_{s}\to K^{\ast}(\to K \pi)\mu^{ }\mu^{-}$ Decay
Zohaib Aarfi, Qazi Maaz Us Salam, Ishtiaq Ahmed, Faisal Munir Bhutta, Rizwan Khalid, M. Ali Paracha
https://arxiv.org/abs/2506.20446

Investigating New Physics through the Observables of Semileptonic $B_{s}\to K^{\ast}(\to K π)μ^{+}μ^{-}$ Decay
The rare four-fold decay $B_s \to K^*(\to Kπ)μ^+μ^- $, governed by the flavor-changing neutral current transition $b \to dμ^+μ^-$, provides a sensitive probe for testing the Standard Model (SM) and investigating signatures of new physics (NP). This work presents a comprehensive model-independent analysis of the decay using the framework of the weak effective field theory. We compute a set of key physical observables, including the differential branching ratio, forward-backward asymmetry, l…

Reactive Transport Simulation of Silicate-Rich Shale Rocks when Exposed to CO2 Saturated Brine Under High Pressure and High Temperature
Shaziya A. Banu, Venkata R. S. B. Varanasi, Arash Noshadravan, Sara Abedi
https://arxiv.org/abs/2506.05122

Reactive Transport Simulation of Silicate-Rich Shale Rocks when Exposed to CO2 Saturated Brine Under High Pressure and High Temperature
This study examines the feasibility of carbon dioxide storage in shale rocks and the reliability of reactive transport models in achieving accurate replication of the chemo-mechanical interactions and transport processes transpiring in these rocks when subjected to CO2 saturated brine. Owing to the heterogeneity of rocks, experimental testing for adequate deductions and findings, could be an expensive and time-intensive process. Therefore, this study proposes utilization of reactive transport m…

Meta-Fair: AI-Assisted Fairness Testing of Large Language Models
Miguel Romero-Arjona, Jos\'e A. Parejo, Juan C. Alonso, Ana B. S\'anchez, Aitor Arrieta, Sergio Segura
https://arxiv.org/abs/2507.02533

Meta-Fair: AI-Assisted Fairness Testing of Large Language Models
Fairness--the absence of unjustified bias--is a core principle in the development of Artificial Intelligence (AI) systems, yet it remains difficult to assess and enforce. Current approaches to fairness testing in large language models (LLMs) often rely on manual evaluation, fixed templates, deterministic heuristics, and curated datasets, making them resource-intensive and difficult to scale. This work aims to lay the groundwork for a novel, automated method for testing fairness in LLMs, reducin…

Examination of Eye-Tracking, Head-Gaze, and Controller-Based Ray-casting in TMT-VR: Performance and Usability Across Adulthood
Panagiotis Kourtesis, Evgenia Giatzoglou, Panagiotis Vorias, Katerina Alkisti Gounari, Eleni Orfanidou, Chrysanthi Nega
https://arxiv.org/abs/2506.19519

Examination of Eye-Tracking, Head-Gaze, and Controller-Based Ray-casting in TMT-VR: Performance and Usability Across Adulthood
Virtual reality (VR) can enrich neuropsychological testing, yet the ergonomic trade-offs of its input modes remain under-examined. Seventy-seven healthy volunteers-young (19-29 y) and middle-aged (27-56 y)-completed a VR Trail-Making Test with three pointing methods: eye-tracking, head-gaze, and a six-degree-of-freedom hand controller. Completion time, spatial accuracy, and error counts for the simple (Trail A) and alternating (Trail B) sequences were analysed in 3 x 2 x 2 mixed-model ANOVAs; p…

This https://arxiv.org/abs/2403.17285 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_sta…

Unraveling the Interplay between Carryover Effects and Reward Autocorrelations in Switchback Experiments
A/B testing has become the gold standard for policy evaluation in modern technological industries. Motivated by the widespread use of switchback experiments in A/B testing, this paper conducts a comprehensive comparative analysis of various switchback designs in Markovian environments. Unlike many existing works which derive the optimal design based on specific and relatively simple estimators, our analysis covers a range of state-of-the-art estimators developed in the reinforcement learning (R…

Testing Quantum-Corrected Black Holes with QPOs Observations: A Study of Particle Dynamics and Accretion Flow
G. Mustafa, Sushant G. Ghosh, Orhan Donmez, S. K. Maurya, Shakhzod Orzuev, Farruh Atamurotov
https://arxiv.org/abs/2506.16405

Testing Quantum-Corrected Black Holes with QPOs Observations: A Study of Particle Dynamics and Accretion Flow
We study the epicyclic oscillations of test particles around rotating quantum-corrected black holes (QCBHs), characterized by mass $M$, spin $a$, and quantum deformation parameter $b$. By deriving the radial ($Ω_r$) and vertical ($Ω_θ$) oscillation frequencies, we explore their dependence on spacetime parameters and show that quantum corrections ($b \neq 0$) significantly modify the dynamics compared to the classical Kerr case. Through numerical modelling of accretion around QCBHs, we furthe…

Estimation of Treatment Effects Under Nonstationarity via Truncated Difference-in-Q's
Ramesh Johari, Tianyi Peng, Wenqian Xing
https://arxiv.org/abs/2506.05308

Estimation of Treatment Effects Under Nonstationarity via Truncated Difference-in-Q's
Randomized controlled experiments (''A/B testing'') are fundamental for assessing interventions in dynamic technology-driven environments, such as recommendation systems, online marketplaces, and digital health interventions. In these systems, interventions typically impact not only the current state of the system, but also future states; therefore, accurate estimation of the global average treatment effect (or GATE) from experiments requires accounting for the dynamic temporal behavior of the …

DELVE-ing into the Milky Way's Globular Clusters: Assessing extra-tidal features in NGC 5897, NGC 7492, and testing detectability with deeper photometry
A. Chiti, K. Tavangar, P. S. Ferguson, J. A. Carballo-Bello, A. M. Senkevich, D. Erkal, A. Drlica-Wagner, A. B. Pace, A. P. Ji, D. J. Sand, G. Limberg, A. Chaturvedi, D. Crnojevi\'c, G. E. Medina, A. H. Riley, N. Shipp, A. K. Vivas, M. Wertheim, Y. Choi, C. E. Mart\'inez-V\'azquez, B. Mutlu-Pakdil, M. Navabi, J. D. Sako…

DELVE-ing into the Milky Way's Globular Clusters: Assessing extra-tidal features in NGC 5897, NGC 7492, and testing detectability with deeper photometry
Extra-tidal features around globular clusters (GCs) are tracers of their disruption, stellar stream formation, and their host's gravitational potential. However, these features remain challenging to detect due to their low surface brightness. We conduct a systematic search for such features around 19 GCs in the DECam Local Volume Exploration (DELVE) survey Data Release 2, discovering a new extra-tidal envelope around NGC 5897 and find tentative evidence for an extended envelope surrounding NGC …

Testing Paradox May Explain Increased Observed Prevalence of Bacterial STIs among MSM on HIV PrEP: A Modeling Study
Laura M\"uller, Piklu Mallick, Antonio B. Mar\'in-Carballo, Philipp D\"onges, Robyn J. N. Kettlitz, Carolina J. Klett-Tammen, Mirjam Kretzschmar, Viola Priesemann, Seba Contreras
https://arxiv.org/abs…

Testing Paradox May Explain Increased Observed Prevalence of Bacterial STIs among MSM on HIV PrEP: A Modeling Study
HIV pre-exposure Prophylaxis (PrEP) has become essential for global HIV control, but its implementation coincides with rising bacterial STI rates among men who have sex with men (MSM). While risk-compensation behavioral changes like reduced condom use are frequently reported, we examine whether intensified asymptomatic screening in PrEP programs creates surveillance artifacts that could be misinterpreted. We developed a compartmental model to represent the simultaneous spread of HIV and chlamyd…

Testing the Origin of Hot Jupiters with Ariel
Lina D'Aoust, Ben Coull-Neveu, Eve J. Lee, Nicolas B. Cowan
https://arxiv.org/abs/2507.13446 https://

Testing the Origin of Hot Jupiters with Ariel
In spite of their long detection history, the origin of hot Jupiters remains to be resolved. While multiple dynamical evidence suggests high-eccentricity migration is most likely, conflicts remain when considering hot Jupiters as a population in the context of warm and cold Jupiters. Here, we turn to atmospheric signatures as an alternative mean to test the origin theory of hot Jupiters, focusing on population level trends that arise from post-formation pollution, motivated by the upcoming Arie…

Density Ratio Permutation Tests with connections to distributional shifts and conditional two-sample testing
Alberto Bordino, Thomas B. Berrett
https://arxiv.org/abs/2505.24529

Density Ratio Permutation Tests with connections to distributional shifts and conditional two-sample testing
We introduce novel hypothesis tests to allow for statistical inference for density ratios. More precisely, we introduce the Density Ratio Permutation Test (DRPT) for testing $H_0: g \propto r f$ based on independent data drawn from distributions with densities $f$ and $g$, where the hypothesised density ratio $r$ is a fixed function. The proposed test employs an efficient Markov Chain Monte Carlo algorithm to draw permutations of the combined dataset according to a distribution determined by $r…

Helium recovery system at IB3A
D. Porwisiak (Fermi National Accelerator Laboratory, Wroclaw University of Science and Technology), M. J. White (Fermi National Accelerator Laboratory), B. J. Hansen (Fermi National Accelerator Laboratory)
https://arxiv.org/abs/2507.17538

Helium recovery system at IB3A
The growing demand for sustainable cryogenic operations at Fermilab has underscored the need to improve helium management, particularly at the Industrial Building 3A (IB3A) test facility. IB3A characterizes and tests superconductors, cables, and coils for projects such as the HL-LHC AUP and Mu2e, yet currently relies on 500 L Dewars whose boil-off is vented to atmosphere, wasting a critical, non-renewable resource and increasing the cost of testing. A project is therefore under way to link IB3A…

Detecting weighted hidden cliques
Urmisha Chatterjee, Karissa Huang, Ritabrata Karmakar, B. R. Vinay Kumar, G\'abor Lugosi, Nandan Malhotra, Anirban Mandal, Maruf Alam Tarafdar
https://arxiv.org/abs/2506.21543

Detecting weighted hidden cliques
We study a generalization of the classical hidden clique problem to graphs with real-valued edge weights. Formally, we define a hypothesis testing problem. Under the null hypothesis, edges of a complete graph on $n$ vertices are associated with independent and identically distributed edge weights from a distribution $P$. Under the alternate hypothesis, $k$ vertices are chosen at random and the edge weights between them are drawn from a distribution $Q$, while the remaining are sampled from $P$.…

Practical Improvements of A/B Testing with Off-Policy Estimation
Sakhi Otmane, Gilotte Alexandre, Rohde David
https://arxiv.org/abs/2506.10677 https://

Practical Improvements of A/B Testing with Off-Policy Estimation
We address the problem of A/B testing, a widely used protocol for evaluating the potential improvement achieved by a new decision system compared to a baseline. This protocol segments the population into two subgroups, each exposed to a version of the system and estimates the improvement as the difference between the measured effects. In this work, we demonstrate that the commonly used difference-in-means estimator, while unbiased, can be improved. We introduce a family of unbiased off-policy e…

An Online A/B Testing Decision Support System for Web Usability Assessment Based on a Linguistic Decision-making Methodology: Case of Study a Virtual Learning Environment
Noe Zerme\~no, Cristina Zuheros, Lucas Daniel Del Rosso Calache, Francisco Herrera, Rosana Montes
https://arxiv.org/abs/2507.12118

An Online A/B Testing Decision Support System for Web Usability Assessment Based on a Linguistic Decision-making Methodology: Case of Study a Virtual Learning Environment
In recent years, attention has increasingly focused on enhancing user satisfaction with user interfaces, spanning both mobile applications and websites. One fundamental aspect of human-machine interaction is the concept of web usability. In order to assess web usability, the A/B testing technique enables the comparison of data between two designs. Expanding the scope of tests to include the designs being evaluated, in conjunction with the involvement of both real and fictional users, presents a…

Behavior Driven Development for 3D Games
Fernando Pastor Ric\'os, Beatriz Mar\'in, I. S. W. B. Prasetya, Tanja E. J. Vos, Joseph Davidson, Karel Hovorka
https://arxiv.org/abs/2506.17057

Behavior Driven Development for 3D Games
Computer 3D games are complex software environments that require novel testing processes to ensure high-quality standards. The Intelligent Verification/Validation for Extended Reality Based Systems (iv4XR) framework addresses this need by enabling the implementation of autonomous agents to automate game testing scenarios. This framework facilitates the automation of regression test cases for complex 3D games like Space Engineers. Nevertheless, the technical expertise required to define test scr…

Robust and efficient multiple-unit switchback experimentation
Paul Missault, Lorenzo Masoero, Christian Delb\'e, Thomas Richardson, Guido Imbens
https://arxiv.org/abs/2506.12654

Robust and efficient multiple-unit switchback experimentation
User-randomized A/B testing has emerged as the gold standard for online experimentation. However, when this kind of approach is not feasible due to legal, ethical or practical considerations, experimenters have to consider alternatives like item-randomization. Item-randomization is often met with skepticism due to its poor empirical performance. To fill this gap, in this paper we introduce a novel and rich class of experimental designs, "Regular Balanced Switchback Designs" (RBSDs). At their co…

Leveraging GPT-4 for Vulnerability-Witnessing Unit Test Generation
G\'abor Antal, D\'enes B\'an, Martin Isztin, Rudolf Ferenc, P\'eter Heged\H{u}s
https://arxiv.org/abs/2506.11559

Leveraging GPT-4 for Vulnerability-Witnessing Unit Test Generation
In the life-cycle of software development, testing plays a crucial role in quality assurance. Proper testing not only increases code coverage and prevents regressions but it can also ensure that any potential vulnerabilities in the software are identified and effectively fixed. However, creating such tests is a complex, resource-consuming manual process. To help developers and security experts, this paper explores the automatic unit test generation capability of one of the most widely used larg…