Tootfinder

Improving Deep Learning Framework Testing with Model-Level Metamorphic Testing
Yanzhou Mu, Juan Zhai, Chunrong Fang, Xiang Chen, Zhixiang Cao, Peiran Yang, Kexin Zhao, An Guo, Zhenyu Chen
https://arxiv.org/abs/2507.04354

Improving Deep Learning Framework Testing with Model-Level Metamorphic Testing
Deep learning (DL) frameworks are essential to DL-based software systems, and framework bugs may lead to substantial disasters, thus requiring effective testing. Researchers adopt DL models or single interfaces as test inputs and analyze their execution results to detect bugs. However, floating-point errors, inherent randomness, and the complexity of test inputs make it challenging to analyze execution results effectively, leading to existing methods suffering from a lack of suitable test oracl…

YouTube rolls out a tool to let some creators upload different thumbnails for each video dubbed into a different language, to help expand their global audience (Dan Whateley/Business Insider)
https://www.businessinsider.com/youtube-te

YouTube is testing a new feature to help videos travel globally
YouTube is testing a new tool to let creators switch out thumbnails for videos in different languages, helping their content spread globally.

Reinforcement Learning for Automated Cybersecurity Penetration Testing
Daniel L\'opez-Montero, Jos\'e L. \'Alvarez-Aldana, Alicia Morales-Mart\'inez, Marta Gil-L\'opez, Juan M. Au\~n\'on Garc\'ia
https://arxiv.org/abs/2507.02969

Reinforcement Learning for Automated Cybersecurity Penetration Testing
This paper aims to provide an innovative machine learning-based solution to automate security testing tasks for web applications, ensuring the correct functioning of all components while reducing project maintenance costs. Reinforcement Learning is proposed to select and prioritize tools and optimize the testing path. The presented approach utilizes a simulated webpage along with its network topology to train the agent. Additionally, the model leverages Geometric Deep Learning to create priors …

Testing for Renamability to Classes of Clause Sets
Albert Brandl, Christian G. Ferm\"uller, Gernot Salzer
https://arxiv.org/abs/2507.05044 https://

Testing for Renamability to Classes of Clause Sets
This paper investigates the problem of testing clause sets for membership in classes known from literature. In particular, we are interested in classes defined via renaming: Is it possible to rename the predicates in a way such that positive and negative literals satisfy certain conditions? We show that for classes like Horn or OCC1N, the existence of such renamings can be decided in polynomial time, whereas the same problem is NP-complete for class PVD. The decision procedures are based on hyp…

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models
Sangwon Hyun, Shaukat Ali, M. Ali Babar
https://arxiv.org/abs/2507.05565 …

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models
Assessing the trustworthiness of Large Language Models (LLMs), such as robustness, has garnered significant attention. Recently, metamorphic testing that defines Metamorphic Relations (MRs) has been widely applied to evaluate the robustness of LLM executions. However, the MR-based robustness testing still requires a scalable number of MRs, thereby necessitating the optimization of selecting MRs. Most extant LLM testing studies are limited to automatically generating test cases (i.e., MRs) to en…

Optimal structure learning and conditional independence testing
Ming Gao, Yuhao Wang, Bryon Aragam
https://arxiv.org/abs/2507.05689 https://

Optimal structure learning and conditional independence testing
We establish a fundamental connection between optimal structure learning and optimal conditional independence testing by showing that the minimax optimal rate for structure learning problems is determined by the minimax rate for conditional independence testing in these problems. This is accomplished by establishing a general reduction between these two problems in the case of poly-forests, and demonstrated by deriving optimal rates for several examples, including Bernoulli, Gaussian and nonpar…

YouTube rolls out a tool to let some creators upload different thumbnails for each video dubbed into a different language, to help expand their global audience (Dan Whateley/Business Insider)
https://www.businessinsider.com/youtube-te

YouTube is testing a new feature to help videos travel globally
YouTube is testing a new tool to let creators switch out thumbnails for videos in different languages, helping their content spread globally.

Apropos of yet another conversation today, I’m a big fan of using automation in WCAG testing.
But I also know WCAG well enough to understand the limitations (and lies) the tools.
https://adrianroselli.com/2025/04/automated-wcag-testing-is-grrreat.htm…

Automated WCAG Testing Is Grrreat!
I’m a big fan of using automation in WCAG testing. I use bookmarklets, dev tools, browser features & reporting, and a pile of third-party products from assorted vendors. These save me time and effort, letting me focus on more tricky cases. But… Unfortunately, the marketing machines of some vendors seem…

MateInfoUB: A Real-World Benchmark for Testing LLMs in Competitive, Multilingual, and Multimodal Educational Tasks
Dumitran Adrian Marius, Theodor-Pierre Moroianu, Buca Mihnea-Vicentiu
https://arxiv.org/abs/2507.03162

MateInfoUB: A Real-World Benchmark for Testing LLMs in Competitive, Multilingual, and Multimodal Educational Tasks
The rapid advancement of Large Language Models (LLMs) has transformed various domains, particularly computer science (CS) education. These models exhibit remarkable capabilities in code-related tasks and problem-solving, raising questions about their potential and limitations in advanced CS contexts. This study presents a novel bilingual (English-Romanian) multimodal (text and image) dataset of multiple-choice questions derived from a high-level computer science competition. A particularity of …

@… has stopped adding OCSP URLs to newly issued certificates (since a few hours). Somewhat to my surprise, I haven't heard about any issues yet caused by this (I would've preferred if they had provided better opportunities for testing). But if you observe unexpected behavior with anything related to TLS certificates in the upcoming days, you may …

Testing Hypotheses of Covariate Effects on Topics of Discourse
Gabriel Phelan, David A. Campbell
https://arxiv.org/abs/2506.05570 https://

Testing Hypotheses of Covariate Effects on Topics of Discourse
We introduce an approach to topic modelling with document-level covariates that remains tractable in the face of large text corpora. This is achieved by de-emphasizing the role of parameter estimation in an underlying probabilistic model, assuming instead that the data come from a fixed but unknown distribution whose statistical functionals are of interest. We propose combining a convex formulation of non-negative matrix factorization with standard regression techniques as a fast-to-compute and…

Testing the ubiquitous presence of very high energy emission in gamma-ray bursts with the MAGIC telescopes
S. Abe, J. Abhir, A. Abhishek, V. A. Acciari, A. Aguasca-Cabot, I. Agudo, T. Aniello, S. Ansoldi, L. A. Antonelli, A. Arbet Engels, C. Arcaro, T. T. H. Arnesen, K. Asano, A. Babic, C. Bakshi, U. Barres de Almeida, J. A. Barrio, L. Barrios-Jimenez, I. Batkovic, J. Baxter, J. Becerra Gonzalez, W. Bednarek, E. Bernardini, J. Bernete, A. Berti, J. Besenrieder, C. Bigongiari, A. Biland…

Testing the ubiquitous presence of very high energy emission in gamma-ray bursts with the MAGIC telescopes
Gamma-ray bursts (GRBs) are the most powerful transient objects in the Universe, and they are a primary target for the MAGIC Collaboration. Recognizing the challenges of observing these elusive objects with Imaging Atmospheric Cherenkov Telescopes (IACTs), we implemented a dedicated observational strategy that included an automated procedure for rapid re-pointing to transient sources. Since 2013, this automated procedure has enabled MAGIC to observe GRBs at a rate of approximately ten per year,…

Question for any folk that do reader/audience/play testing.
I find that the more fidelity (detail, production value) a project has, the less accurate the user's identification of an issue. I try to interpret accordingly.
Do you know of any studies regarding this or personal experiences (that confirm or refute this)? I have studies on how people don't know what they want, etc. But keen on the connection btw fidelity & inaccuracy
Thank you! :)
Other relate…

Testing OH Megamaser Identification Methods in HI Surveys: Updated Source-Flagging Algorithms and New Detections in ALFALFA
Hayley Roberts, Jeremy Darling, Kelley M. Hess, Andrew J. Baker, Elizabeth A. K. Adams, Helga D\'enes
https://arxiv.org/abs/2506.06115

Testing OH Megamaser Identification Methods in HI Surveys: Updated Source-Flagging Algorithms and New Detections in ALFALFA
OH megamasers (OHMs) are extragalactic masers found primarily in gas-rich galaxy major mergers. To date, only $\sim$120 OHMs have been cataloged since their discovery in 1982, and efforts to identify distinct characteristics of OHM host galaxies have remained inconclusive. As radio astronomy advances with next-generation telescopes and extensive 21 cm HI surveys, precursors to the Square Kilometre Array (SKA) are expected to detect the 18 cm OH masing line with significantly increased frequency…

On void formation during the simulated tensile testing of polymer-filler particle composites
John J. Karnes, Supun S. Mohottalalage, Amitesh Maiti, Andrew P. Saab, Todd H. Weisgraber
https://arxiv.org/abs/2507.05547

On void formation during the simulated tensile testing of polymer-filler particle composites
We simulate a series of model polymer composites, composed of linear polymer strands and spherical, monodisperse filler particles (FP). These molecular dynamics simulations implement a coarse-grained, bead-spring force field and we vary several formulation parameters to study their respective influences on material properties. These parameters include FP radius, FP volume fraction, temperature, and the polymer-polymer, FP-FP, and polymer-FP interaction potentials. Uniaxial extension of the simu…

Testing 4.4.0

ASSURE: Metamorphic Testing for AI-powered Browser Extensions
Xuanqi Gao, Juan Zhai, Shiqing Ma, Siyi Xie, Chao Shen
https://arxiv.org/abs/2507.05307 https…

ASSURE: Metamorphic Testing for AI-powered Browser Extensions
The integration of Large Language Models (LLMs) into browser extensions has revolutionized web browsing, enabling sophisticated functionalities like content summarization, intelligent translation, and context-aware writing assistance. However, these AI-powered extensions introduce unprecedented challenges in testing and reliability assurance. Traditional browser extension testing approaches fail to address the non-deterministic behavior, context-sensitivity, and complex web environment integrat…

Test Automatically - Test improvements against current setup with intelligent #AB testing and performance comparison 🎛️ Control What Goes Live - Review auto-generated fixes, approve changes, and roll back if needed with full control ✍️ Version Everything - Complete version

Replicable Distribution Testing
Ilias Diakonikolas, Jingyi Gao, Daniel Kane, Sihan Liu, Christopher Ye
https://arxiv.org/abs/2507.02814 https://

Replicable Distribution Testing
We initiate a systematic investigation of distribution testing in the framework of algorithmic replicability. Specifically, given independent samples from a collection of probability distributions, the goal is to characterize the sample complexity of replicably testing natural properties of the underlying distributions. On the algorithmic front, we develop new replicable algorithms for testing closeness and independence of discrete distributions. On the lower bound front, we develop a new metho…

Enter, Exit, Page Fault, Leak: Testing Isolation Boundaries for Microarchitectural Leaks
Oleksii Oleksenko, Flavien Solt, C\'edric Fournet, Jana Hofmann, Boris K\"opf, Stavros Volos
https://arxiv.org/abs/2507.06039

Enter, Exit, Page Fault, Leak: Testing Isolation Boundaries for Microarchitectural Leaks
CPUs provide isolation mechanisms like virtualization and privilege levels to protect software. Yet these focus on architectural isolation while typically overlooking microarchitectural side channels, exemplified by Meltdown and Foreshadow. Software must therefore supplement architectural defenses with ad-hoc microarchitectural patches, which are constantly evolving as new attacks emerge and defenses are proposed. Such reactive approach makes ensuring complete isolation a daunting task, and lea…

Optimizing Cloud-to-GPU Throughput for Deep Learning With Earth Observation Data
Akram Zaytar, Caleb Robinson, Girmaw Abebe Tadesse, Tammy Glazer, Gilles Hacheme, Anthony Ortiz, Rahul M Dodhia, Juan M Lavista Ferres
https://arxiv.org/abs/2506.06235

Optimizing Cloud-to-GPU Throughput for Deep Learning With Earth Observation Data
Training deep learning models on petabyte-scale Earth observation (EO) data requires separating compute resources from data storage. However, standard PyTorch data loaders cannot keep modern GPUs utilized when streaming GeoTIFF files directly from cloud storage. In this work, we benchmark GeoTIFF loading throughput from both cloud object storage and local SSD, systematically testing different loader configurations and data parameters. We focus on tile-aligned reads and worker thread pools, usin…

TigAug: Data Augmentation for Testing Traffic Light Detection in Autonomous Driving Systems
You Lu, Dingji Wang, Kaifeng Huang, Bihuan Chen, Xin Peng
https://arxiv.org/abs/2507.05932

TigAug: Data Augmentation for Testing Traffic Light Detection in Autonomous Driving Systems
Autonomous vehicle technology has been developed in the last decades with recent advances in sensing and computing technology. There is an urgent need to ensure the reliability and robustness of autonomous driving systems (ADSs). Despite the recent achievements in testing various ADS modules, little attention has been paid on the automated testing of traffic light detection models in ADSs. A common practice is to manually collect and label traffic light data. However, it is labor-intensive, and…

IPv6 woes solved, I now have (I think, still testing) fully working IPv6 again.
The fix was incredibly braindead and stupid: turning on the IPv4 DHCP server on the LAN side of the Comcast CPE (i.e. on the point to point link between the CPE and my border router).
This would be completely unnecessary in a sane world, since I'm never going to DHCPDISCOVER on this subnet (the CPE and border router both have static world routable IPv4 addresses).
But apparently turning on t…

PyGemini: Unified Software Development towards Maritime Autonomy Systems
Kjetil Vasstein, Christian Le, Simon Lerv{\aa}g Breivik, Trygve Maukon Myhr, Annette Stahl, Edmund F{\o}rland Brekke
https://arxiv.org/abs/2506.06262

PyGemini: Unified Software Development towards Maritime Autonomy Systems
Ensuring the safety and certifiability of autonomous surface vessels (ASVs) requires robust decision-making systems, supported by extensive simulation, testing, and validation across a broad range of scenarios. However, the current landscape of maritime autonomy development is fragmented -- relying on disparate tools for communication, simulation, monitoring, and system integration -- which hampers interdisciplinary collaboration and inhibits the creation of compelling assurance cases, demanded…

Dann finden wir es doch heraus, landet ein Beitrag mit nur dem Hashtag:
#test
einfach auf
https://feddit.org/c/testing@kbin.earth?

👏💪👍 #WebDev #FrontEnd

feat: Add Storybook for component documentation, testing, and development by diondiondion · Pull Request #34907 · mastodon/mastodon
Closes MAS-428 Changes proposed in this PR: Introduces an initial basic Storybook (v9) setup to the project (only the Button component is included for now) Updates vitest to version 3.2 and uses t...

Kernel Trace Distance: Quantum Statistical Metric between Measures through RKHS Density Operators
Arturo Castellanos, Anna Korba, Pavlo Mozharovskyi, Hicham Janati
https://arxiv.org/abs/2507.06055

Kernel Trace Distance: Quantum Statistical Metric between Measures through RKHS Density Operators
Distances between probability distributions are a key component of many statistical machine learning tasks, from two-sample testing to generative modeling, among others. We introduce a novel distance between measures that compares them through a Schatten norm of their kernel covariance operators. We show that this new distance is an integral probability metric that can be framed between a Maximum Mean Discrepancy (MMD) and a Wasserstein distance. In particular, we show that it avoids some pitfa…

Identity Testing for Circuits with Exponentiation Gates
Jiatu Li, Mengdi Wu
https://arxiv.org/abs/2506.04529 https://arxiv.org/pdf/25…

Identity Testing for Circuits with Exponentiation Gates
Motivated by practical applications in the design of optimization compilers for neural networks, we initiated the study of identity testing problems for arithmetic circuits augmented with \emph{exponentiation gates} that compute the real function $x\mapsto e^x$. These circuits compute real functions of form $P(\vec x)/P'(\vec x)$, where both $P(\vec x)$ and $P'(\vec x)$ are exponential polynomials \[ \sum_{i=1}^k f_i(\vec x)\cdot \exp\left(\frac{g_i(\vec x)}{h_i(\vec x)}\right), \] for …

On Fault Tolerance of Data Storage Systems: A Holistic Perspective
Mai Zheng, Duo Zhang, Ahmed Dajani
https://arxiv.org/abs/2507.03849 https://

On Fault Tolerance of Data Storage Systems: A Holistic Perspective
Data storage systems serve as the foundation of digital society. The enormous data generated by people on a daily basis make the fault tolerance of data storage systems increasingly important. Unfortunately, modern storage systems consist of complicated hardware and software layers interacting with each other, which may contain latent bugs that elude extensive testing and lead to data corruption, system downtime, or even unrecoverable data loss in practice. In this chapter, we take a holistic v…

Why I Don’t Use #Mocking Frameworks and Why You Might Not Need Them Either by @…

An experimental approach: Converting verbal expressions to numerical scales
Zsombor Sz\'adoczki, S\'andor Boz\'oki, L\'aszl\'o Sipos, Zs\'ofia Galambosi
https://arxiv.org/abs/2507.04539

An experimental approach: Converting verbal expressions to numerical scales
One of the key issues in decision problems is the selection and use of the appropriate response scale. In this paper verbal expressions are converted into numerical scales for a subjective problem instance. The main motivation for our research was that verbal values in decision tasks are often mechanically converted into numbers, which thus typically do not fully represent the respondent's true evaluation. In our experiment, we conducted a color selection test with 462 subjects by testing six c…

"There was a recent 2024 study that showed us that individuals who survive an acute COVID-19 infection (...) on average will lose somewhere in the neighbourhood of two to six IQ points per infection."
"although your immune system can take on [a COVID] infection, you want to avoid testing it as much as possible because your body is sustaining damage with each infection that it survives."
Seriously, wear a mask 😷 .

Beyond long COVID — how reinfections could be causing silent long-term organ damage | CBC Radio
Scientific evidence is painting an unsettling picture: COVID infections, even if mild or asymptomatic, may be causing long-term cellular and organ damage, as well as increasing your risk of developing long COVID.

New limits on CPT-Symmetry Violation in Charm mesons
W. Krzemien, M . Kmiec, A. Szabelski, W. Wislicki
https://arxiv.org/abs/2507.05457 https://

New limits on CPT-Symmetry Violation in Charm mesons
Neutral flavour meson oscillations are a fascinating quantum phenomenon that allows for high-precision tests of fundamental symmetries, including CPT invariance. In this contribution, we present the methodology for testing CPT violation in neutral flavour meson systems, with particular emphasis on the charm sector. We report the recently established constraints on CPT-violating effects, derived from a reinterpretation of the LHCb measurement of the time-dependent asymmetry in the Cabibbo-favour…

Neural Substitute Solver for Efficient Edge Inference of Power Electronic Hybrid Dynamics
Jialin Zheng, Haoyu Wang, Yangbin Zeng, Han Xu, Di Mou, Hong Li, Sergio Vazquez, Leopoldo G. Franquelo
https://arxiv.org/abs/2507.03144

Neural Substitute Solver for Efficient Edge Inference of Power Electronic Hybrid Dynamics
Advancing the dynamics inference of power electronic systems (PES) to the real-time edge-side holds transform-ative potential for testing, control, and monitoring. How-ever, efficiently inferring the inherent hybrid continu-ous-discrete dynamics on resource-constrained edge hardware remains a significant challenge. This letter pro-poses a neural substitute solver (NSS) approach, which is a neural-network-based framework aimed at rapid accurate inference with significantly reduced computational …

What is going on in the land of Fedora Linux?
First, the latest kernel in Fedora 42 recently went from "working" to "broken" with regard to the video screen on Intel(R) Core(TM) Ultra 7 155H on an ASUSTeK COMPUTER INC. NUC14RVK-B/NUC14RVBU7
Second, the update repositories now all have invalid checksums. (Update: this is now corrected.)
Fedora is Redhat is IBM - you would think that they could do some regression testing and maybe do a better locking of t…

This might also explain why #OpenAI pushed ChatGPT to market before it was worth touching. If you can’t afford testing at scale, why not do a huge free public release so that you can call the last 80% of the dev effort “product support" which should be fully expensible.
NOTE: I AM NOT A TAX EXPERT AND THE ABOVE COULD BE ABSURD.

MalVol-25: A Diverse, Labelled and Detailed Volatile Memory Dataset for Malware Detection and Response Testing and Validation
Dipo Dunsin, Mohamed Chahine Ghanem, Eduardo Almeida Palmieri
https://arxiv.org/abs/2507.03993

MalVol-25: A Diverse, Labelled and Detailed Volatile Memory Dataset for Malware Detection and Response Testing and Validation
This paper addresses the critical need for high-quality malware datasets that support advanced analysis techniques, particularly machine learning and agentic AI frameworks. Existing datasets often lack diversity, comprehensive labelling, and the complexity necessary for effective machine learning and agent-based AI training. To fill this gap, we developed a systematic approach for generating a dataset that combines automated malware execution in controlled virtual environments with dynamic moni…

"The immigration detention system has become a testing ground for authoritarianism." - @silkys13.bsky.social
https://bsky.app/profile/democracynow.org/post/3lqpltpcg522i

User testing at Xerox PARC and Apple in the 1970s–80s, by Larry Tesler:
https://dl.acm.org/doi/pdf/10.1145/1044774.1534167
Thanks, @…

A Generalized Graph Signal Processing Framework for Multiple Hypothesis Testing over Networks
Xingchao Jian, Martin G\"olz, Feng Ji, Wee Peng Tay, Abdelhak M. Zoubir
https://arxiv.org/abs/2506.03496

A Generalized Graph Signal Processing Framework for Multiple Hypothesis Testing over Networks
We consider the multiple hypothesis testing (MHT) problem over the joint domain formed by a graph and a measure space. On each sample point of this joint domain, we assign a hypothesis test and a corresponding $p$-value. The goal is to make decisions for all hypotheses simultaneously, using all available $p$-values. In practice, this problem resembles the detection problem over a sensor network during a period of time. To solve this problem, we extend the traditional two-groups model such that …

Good article summarizing a lot of things relevant to continued COVID'19 caution:
https://www.cbc.ca/radio/quirks/beyond-long-covid-1.7485888
Key points:
COVID'19 weakens the immune system:
"""
So it's not just about infecting you and causing respiratory illness and fever and all of the things that we usually get with the viral infection. This virus also specifically causes your immune system to become weaker.
"""
It damages blood vessels:
"""
In addition to SARS-CoV-2's ability to dysregulate the immune system and suppress the immune system, the spike protein itself is very damaging to blood vessel structures as well as red blood cells and platelets themselves.
"""
The folk idea that infections make our immune system stronger and stronger like a muscle just isn't true (or at least, doesn't apply to COVID'19 because of how, unlike most other viruses, it damages the immune system):
"""
For the longest time in the field of immunology, there was the sort of adage that your immune system needs to be tested every now and again to stay strong. That's an old-fashioned idea.
The more new-fashioned and evidence-based idea is that, although your immune system can take on [a COVID] infection, you want to avoid testing it as much as possible because your body is sustaining damage with each infection that it survives.
"""

Check out today's Metacurity for the most critical infosec developments you might have missed over the weekend, including
--German police ID Trickbot's "Stern,"
--BitMEX thwarts Lazarus Group attack,
--Shin Bet thwarted 85 Iranian cyberattacks aimed at civilians,
--Vibe coding app Lovable failed to fix critical flaw,
--China's quantum satellite Micius has a severe security flaw,
--Russia's GRU Unit 29155 has a hacker team,
--…

Law enforcement took down cybercriminal malware testing service AVCheck
German police ID Trickbot's "Stern," BitMEX thwarts Lazarus Group attack, Shin Bet thwarted 85 Iranian cyberattacks aimed at civilians, Vibe coding app Lovable failed to fix critical flaw, China's quantum satellite Micius has a security flaw, Russia's Unit 29155 has a hacker team, much more

Parting Thoughts on Performance Testing - #dotNet
https://improveandrepeat.com/2025/04/parting-thoughts-on-performance-testing/

Parting Thoughts on Performance Testing - Improve & Repeat
None

Replaced article(s) found for physics.ins-det. https://arxiv.org/list/physics.ins-det/new
[1/1]:
- Development, Characterization, and Testing of a Bias Supply for SiPMs in the CMVD Experiment
Chattopadhyay, Saraf, Majumder, Bheesette, Shinde

@… thanks for testing! fair point about overscroll, I don’t think there is an `overscroll-behavior` value that makes sense for the component to add though — this seems more like an app-level option

Testing Hypotheses regarding Covariance and Correlation matrices with the R package CovCorTest
Paavo Sattler, Svenja Jedhoff
https://arxiv.org/abs/2507.03406

Testing Hypotheses regarding Covariance and Correlation matrices with the R package CovCorTest
In addition to the commonly analyzed measures of location, dispersion measurements such as variance and correlation provide many valuable information. Consequently, they play a crucial role in multivariate statistics, which leads to tests regarding covariance and correlation matrices. Furthermore, also the structure of these matrices leads to important hypotheses of interest, since it contains substantial information about the underlying model. In fact, assumptions regarding the structures of c…

AI for the Routine, Humans for the Complex: Accuracy-Driven Data Labelling with Mixed Integer Linear Programming
Mohammad Hossein Amini, Mehrdad Sabetzadeh, Shiva Nejati
https://arxiv.org/abs/2507.04990

AI for the Routine, Humans for the Complex: Accuracy-Driven Data Labelling with Mixed Integer Linear Programming
The scarcity of accurately labelled data remains a major challenge in deep learning (DL). Many DL approaches rely on semi-supervised methods, which focus on constructing large datasets that require only a minimal amount of human-labelled data. Since DL training algorithms can tolerate moderate label noise, it has generally been acceptable for the accuracy of labels in large training datasets to fall well short of a perfect 100%. However, when it comes to testing DL models, achieving high label …

Hybrid Approach to Directed Fuzzing
Darya Parygina, Timofey Mezhuev, Daniil Kuts
https://arxiv.org/abs/2507.04855 https://arxiv.org/p…

Hybrid Approach to Directed Fuzzing
Program analysis and automated testing have recently become an essential part of SSDLC. Directed greybox fuzzing is one of the most popular automated testing methods that focuses on error detection in predefined code regions. However, it still lacks ability to overcome difficult program constraints. This problem can be well addressed by symbolic execution, but at the cost of lower performance. Thus, combining directed fuzzing and symbolic execution techniques can lead to more efficient error de…

Vivodyne, which uses AI and robots to grow human tissues in the lab for drug discovery and development, raised a $40M Series A, taking its total funding to $78M (Katherine Davis/Axios)
https://www.axios.com/pro/biotech-deals/2025/05…

Vivodyne raises $40M for human tissue drug testing
It's seeing heightened demand following the FDA's plans to phase out animal testing requirements.

Won’t someone think of the jackbooted thugs?
“…ICE officers themselves…facing inhumane conditions…showing symptoms of respiratory infections…can’t get proper testing for diagnoses…at risk of rocket attacks from Yemeni terrorists…lack body armor or other protective gear. …Trump…said…judge was ‘literally putting ICE agents’ lives in danger.’
…not quite true…judge never said they had to stay there…officials are ‘manufacturing the…chaos they decry.’”

ICE details dangerous working conditions in Djibouti. But they don’t have to be there.
Immigration and Customs Enforcement officers are laboring under dangerous conditions while maintaining custody over migrants they’re holding at a military base in Djibouti, according to a declaration from an ICE official Thursday.

»Pay up or stop scraping – Cloudflare program charges bots for each crawl:
Cloudflare now beta testing pay-per-crawl feature to stop endless AI scraping.
Cloudflare is now experimenting with tools that will allow content creators to charge a fee to AI crawlers to scrape their websites.«
This is certainly a good idea, but on the other hand, the competition is trying to eliminate each other. I'm curious… 🍿😎

Pay up or stop scraping: Cloudflare program charges bots for each crawl
Cloudflare now beta testing pay-per-crawl feature to stop endless AI scraping.

The most effective way to reduce immigration is to tank the economy. The USA is seriously testing that, it seems. The populations of many countries in Europe would like their governments to follow suit, convinced as they are that there is too much wealth in their countries.

Whoops, testing in prod I see

💉 Olympic anti-doping lab puts U.S. meat supply to the test
#food

Olympic anti-doping lab puts U.S. meat supply to the test
Scientists at UCLA's Olympic Analytical Laboratory turned their sophisticated analytical capabilities for testing athlete samples for performance-enhancing drugs to research examining the U.S. meat supply as part of a study led by Texas Tech. The study was designed to investigate concerns that residues of growth promoters used in meat production could potentially cause athletes to test positive.

Testing, Evaluation, Verification and Validation (TEVV) of Digital Twins: A Comprehensive Framework
Gabriella Waters
https://arxiv.org/abs/2507.04555 https…

Testing, Evaluation, Verification and Validation (TEVV) of Digital Twins: A Comprehensive Framework
Digital twins have emerged as a powerful technology for modeling and simulating complex systems across various domains (Fuller et al., 2020; Tao et al., 2019). As virtual representations of physical assets, processes, or systems, digital twins enable real-time monitoring, predictive analysis, and optimization. However, as digital twins become more sophisticated and integral to decision-making processes, ensuring their accuracy, reliability, and ethical implementation is essential. This paper pr…

Practical Short-Length Coding Schemes for Binary Distributed Hypothesis Testing
Ismaila Salihou Adamou, Elsa Dupraz, Reza Asvadi, Tad Matsumoto
https://arxiv.org/abs/2506.01747

Practical Short-Length Coding Schemes for Binary Distributed Hypothesis Testing
This paper addresses the design of practical shortlength coding schemes for Distributed Hypothesis Testing (DHT). While most prior work on DHT has focused on informationtheoretic analyses, deriving bounds on Type-II error exponents via achievability schemes based on quantization and quantizebinning, the practical implementation of DHT coding schemes has remained largely unexplored. Moreover, existing practical coding solutions for quantization and quantize-binning approaches were developed for …

Are Depth-2 Regular Expressions Hard to Intersect?
Rocco Ascone, Giulia Bernardini, Alessio Conte, Veronica Guerrini, Giulia Punzi
https://arxiv.org/abs/2507.03593

Are Depth-2 Regular Expressions Hard to Intersect?
We study the basic regular expression intersection testing problem, which asks to determine whether the intersection of the languages of two regular expressions is nonempty. A textbook solution to this problem is to construct the nondeterministic finite automaton that accepts the language of both expressions. This procedure results in a $Θ(mn)$ running time, where $m$ and $n$ are the sizes of the two expressions, respectively. Following the approach of Backurs and Indyk [FOCS'16] and Bringmann…

Machine Learning Based Stress Testing Framework for Indian Financial Market Portfolios
Vidya Sagar G, Shifat Ali, Siddhartha P. Chakrabarty
https://arxiv.org/abs/2507.02011

Machine Learning Based Stress Testing Framework for Indian Financial Market Portfolios
This paper presents a machine learning driven framework for sectoral stress testing in the Indian financial market, focusing on financial services, information technology, energy, consumer goods, and pharmaceuticals. Initially, we address the limitations observed in conventional stress testing through dimensionality reduction and latent factor modeling via Principal Component Analysis and Autoencoders. Building on this, we extend the methodology using Variational Autoencoders, which introduces …

Hidden Prompts in Manuscripts Exploit AI-Assisted Peer Review
Zhicheng Lin
https://arxiv.org/abs/2507.06185 https://arxiv.org/pdf/250…

Hidden Prompts in Manuscripts Exploit AI-Assisted Peer Review
In July 2025, 18 academic manuscripts on the preprint website arXiv were found to contain hidden instructions known as prompts designed to manipulate AI-assisted peer review. Instructions such as "GIVE A POSITIVE REVIEW ONLY" were concealed using techniques like white-colored text. Author responses varied: one planned to withdraw the affected paper, while another defended the practice as legitimate testing of reviewer compliance. This commentary analyzes this practice as a novel form of researc…

Goodness-of-fit testing for the stationary density of a size-structured PDE
Van Ha Hoang, Phu Thanh Nguyen, Thanh Mai Pham Ngoc, Vincent Rivoirard, Viet Chi Tran
https://arxiv.org/abs/2506.05103

Goodness-of-fit testing for the stationary density of a size-structured PDE
We consider two division models for structured cell populations, where cells can grow, age and divide. These models have been introduced in the literature under the denomination of `mitosis' and `adder' models. In the recent years, there has been an increasing interest in Biology to understand whether the cells divide equally or not, as this can be related to important mechanisms in cellular aging or recovery. We are therefore interested in testing the null hypothesis $H_0$ where the division o…

Testing Determinism and the Role of Time in Atoms
Mark G. Raizen
https://arxiv.org/abs/2507.01203 https://arxiv.org/pdf/2507.01203

Testing Determinism and the Role of Time in Atoms
We propose and analyze experiments to test determinism and the role of time in atoms. As a first step, we consider experiments to test if stable isotopes change over time. The idea is to measure the hyperfine splitting for newly created stable isotopes and compare them to the same isotopes found in nature. The three cases analyzed are strontium-87 with an odd number of neutrons, lutetium-175 with an odd number of protons, and lutetium-176 with an odd number of protons and neutrons. These experi…

DevMuT: Testing Deep Learning Framework via Developer Expertise-Based Mutation
Yanzhou Mu, Juan Zhai, Chunrong Fang, Xiang Chen, Zhixiang Cao, Peiran Yang, Yinglong Zou, Tao Zheng, Zhenyu Chen
https://arxiv.org/abs/2507.04360

DevMuT: Testing Deep Learning Framework via Developer Expertise-Based Mutation
Deep learning (DL) frameworks are the fundamental infrastructure for various DL applications. Framework defects can profoundly cause disastrous accidents, thus requiring sufficient detection. In previous studies, researchers adopt DL models as test inputs combined with mutation to generate more diverse models. Though these studies demonstrate promising results, most detected defects are considered trivial (i.e., either treated as edge cases or ignored by the developers). To identify important b…

Day 5
TL;DR: Continued work on backend security — role-based access is now fully wired up.
✅ Got fine-grained role-based access control fully working today.
• Roles loaded from PostgreSQL
• Injected into JWT during login
• Validated via custom `@Roles()` `RolesGuard`
• Authenticated via `@UseGuards(JwtAuthGuard)` globally
• Introduced `@Public()` decorator to bypass guards for public endpoints
• Swagger supports Bearer token for testing …

Continuation: Securing Routes with JWT and Role-Based Access Control
TL;DR: Continuing development on the backend platform — this time focusing on securing routes with JWT, implementing @Roles decorators, h...

Jakiś czas temu, zainspirowany #Fedorą, wyodrębniłem paczki .whl z Pythonowego ensurepip w #Gentoo (właśnie sprawdziłem — "jakiś czas" to 3 lata). Umożliwiło to nam aktualizowanie ich razem z paczkami pip i setuptools, dzięki czemu nowe środowiska wirtualne otrzymują najnowszą dostępną wersję, a …

Why #PropertyTesting Finds Bugs #UnitTesting Does Not
https://bu…

A Vehicle-in-the-Loop Simulator with AI-Powered Digital Twins for Testing Automated Driving Controllers
Zengjie Zhang, Giannis Badakis, Michalis Galanis, Adem Bavar\c{s}i, Edwin van Hassel, Mohsen Alirezaei, Sofie Haesaert
https://arxiv.org/abs/2507.02313

A Vehicle-in-the-Loop Simulator with AI-Powered Digital Twins for Testing Automated Driving Controllers
Simulators are useful tools for testing automated driving controllers. Vehicle-in-the-loop (ViL) tests and digital twins (DTs) are widely used simulation technologies to facilitate the smooth deployment of controllers to physical vehicles. However, conventional ViL tests rely on full-size vehicles, requiring large space and high expenses. Also, physical-model-based DT suffers from the reality gap caused by modeling imprecision. This paper develops a comprehensive and practical simulator for tes…

A Note on Inferential Decisions, Errors and Path-Dependency
Kangda K. Wren
https://arxiv.org/abs/2507.05634 https://arxiv.org/pdf/250…

A Note on Inferential Decisions, Errors and Path-Dependency
Consider the standard sequential testing of a binary outcome. The associated belief process and its objectively true conditional-probability counterpart generally differ, but they converge to the same target in well-defined tests. We show that unless the two processes are 'essentially identical', differing at most by an a priori factor, time-homogeneous continuous sequential decisions based on the former must be path-dependent with respect to state-variables based on the latter or other non-ess…

Hyperelastic characterization via deep indentation
Mohammad Shojaeifard, Mattia Bacca
https://arxiv.org/abs/2506.05371 https://arxiv.…

Hyperelastic characterization via deep indentation
Hyperelastic material characterization is crucial for understanding the behavior of soft materials, such as tissues, rubbers, hydrogels, and polymers, under quasi-static loading before failure. Traditional methods typically rely on uniaxial tensile tests, which require the cumbersome preparation of dumbbell-shaped samples for clamping in a uniaxial testing machine. In contrast, indentation-based methods, which can be conducted in situ without sample preparation, have been underexplored. To char…

Development and Testing of a Low Cost Ultrasonic Leak Detector
Senol Gulgonul
https://arxiv.org/abs/2506.04862 https://arxiv.org/pdf/…

Development and Testing of a Low Cost Ultrasonic Leak Detector
This study focuses on the development of an ultrasonic leak detection system utilizing the Arduino Nano 33 BLE Sense Rev2 board. The research aimed to create a compact and cost-effective solution for identifying leaks in high-pressure pipes. Algorithms were designed to enable lossless recording and processing of sound data captured by the onboard MEMS microphone. Key signal processing techniques, including the implementation of an IIR high-pass filter and RMS calculation, were employed to detec…

LLM-Guided Scenario-based GUI Testing
Shengcheng Yu, Yuchen Ling, Chunrong Fang, Quan Zhou, Chunyang Chen, Shaomin Zhu, Zhenyu Chen
https://arxiv.org/abs/2506.05079

LLM-Guided Scenario-based GUI Testing
The assurance of mobile app GUI is more and more significant. Automated GUI testing approaches of different strategies have been developed, while there are still huge gaps between the approaches and the app business logic, not taking the completion of specific testing scenarios as the exploration target, leading to the exploration missing of critical app functionalities. Learning from the manual testing, which takes testing scenarios with app business logic as the basic granularity, in this pap…

Testing gravity with wide binaries -- 3D velocities and distances of wide binaries from Gaia and HARPS
R. Saglia, L. Pasquini, F. Patat, H. -G. Ludwig, R. Giribaldi, I. Leao, J. R. de Medeiros, Michael T. Murphy
https://arxiv.org/abs/2506.05049

Testing gravity with wide binaries -- 3D velocities and distances of wide binaries from Gaia and HARPS
Wide Binaries (WBs) are interesting systems to test Newton-Einstein gravity in low potentials. The basic concept is to verify whether the difference in velocity between the WB components is compatible with what is expected from the Newton law. Previous attempts, based solely on Gaia proper motion differences scaled to transverse velocity differences using mean parallax distances, do not provide conclusive results. Here we add to the Gaia transverse velocities precise measurements of the third v…

This https://arxiv.org/abs/2504.09567 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_sta…

Conditional Independence Test Based on Transport Maps
Testing conditional independence between two random vectors given a third is a fundamental and challenging problem in statistics, particularly in multivariate nonparametric settings due to the complexity of conditional structures. We propose a innovative framework for testing conditional independence using transport maps. At the population level, we show that two well-defined transport maps can transform the conditional independence test into an unconditional independence test, this substantial…

Some cool footage and discussion of full-scale EV fire testing by UL/FSRI. This should have been done a long time ago, given how many EVs are on the roads now, but better late than never I guess.
Video: https://www.youtube.com/watch?v=K6j3GtcAfE0
Project website:

An Investigation into Maintenance Support for Neural Networks
Fatema Tuz Zohra, Brittany Johnson
https://arxiv.org/abs/2507.05245 https://

An Investigation into Maintenance Support for Neural Networks
As the potential for neural networks to augment our daily lives grows, ensuring their quality through effective testing, debugging, and maintenance is essential. This is especially the case as we acknowledge the prospects of negative impacts from these technologies. Traditional software engineering methods, such as testing and debugging, have proven effective in maintaining software quality; however, they reveal significant research and practice gaps in maintaining neural networks. In particula…

“Check / Uncheck all in a Table”
https://adrianroselli.com/2025/07/check-uncheck-all-in-a-table.html
TL;DR: Unless you have user testing results saying otherwise, maybe put a check-all checkbox outside the table.
The rest of this thread ha…

Check / Uncheck all in a Table
TL;DR: Unless you have user testing results saying otherwise, maybe put a check-all checkbox outside the table. The rest of this post is an awkward mash-up of my posts Don’t Turn a Table into an ARIA Grid Just for a Clickable Row and Check-All / Expand-All Controls with a little…

LIFT: Automating Symbolic Execution Optimization with Large Language Models for AI Networks
Ruoxi Wang, Kun Li, Minghui Xu, Yue Zhang, Kaidi Xu, Chunchi Liu, Yinhao Xiao, Xiuzhen Cheng
https://arxiv.org/abs/2507.04931

LIFT: Automating Symbolic Execution Optimization with Large Language Models for AI Networks
Dynamic Symbolic Execution (DSE) is a key technique in program analysis, widely used in software testing, vulnerability discovery, and formal verification. In distributed AI systems, DSE plays a crucial role in identifying hard-to-detect bugs, especially those arising from complex network communication patterns. However, traditional approaches to symbolic execution are often hindered by scalability issues and inefficiencies, particularly in large-scale systems. This paper introduces LIFT (Large…

This https://arxiv.org/abs/2505.01892 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csLG_…

OODTE: A Differential Testing Engine for the ONNX Optimizer
With over 700 stars on GitHub and being part of the official ONNX repository, the ONNX Optimizer is the default tool for applying graph-based optimizations to ONNX models. Despite its widespread use, its ability to maintain model accuracy during optimization has not been thoroughly investigated. In this work, we present OODTE, a utility designed to automatically and comprehensively evaluate the correctness of the ONNX Optimizer. OODTE adopts a straightforward yet powerful differential testing a…

New aspects of quantum topological data analysis: Betti number estimation, and testing and tracking of homology and cohomology classes
Nhat A. Nghiem, Junseo Lee
https://arxiv.org/abs/2506.01432

New aspects of quantum topological data analysis: Betti number estimation, and testing and tracking of homology and cohomology classes
Recently, the application of quantum computation to topological data analysis (TDA) has received increasing attention. In particular, several quantum algorithms have been proposed for estimating (normalized) Betti numbers, a central challenge in TDA. However, it was recently proven that estimating Betti numbers is an NP-hard problem, revealing a complexity-theoretic limitation to achieving a generic quantum advantage for this task. Motivated by this limitation and inspired by previous progress,…

Testing for large-dimensional covariance matrix under differential privacy
Shiwei Sang, Yicheng Zeng, Xuehu Zhu, Shurong Zheng
https://arxiv.org/abs/2506.02410

Testing for large-dimensional covariance matrix under differential privacy
The increasing prevalence of high-dimensional data across various applications has raised significant privacy concerns in statistical inference. In this paper, we propose a differentially private integrated statistic for testing large-dimensional covariance structures, enabling accurate statistical insights while safeguarding privacy. First, we analyze the global sensitivity of sample eigenvalues for sub-Gaussian populations, where our method bypasses the commonly assumed boundedness of data co…

UniAud: A Unified Auditing Framework for High Auditing Power and Utility with One Training Run
Ruixuan Liu, Li Xiong
https://arxiv.org/abs/2507.04457 https…

UniAud: A Unified Auditing Framework for High Auditing Power and Utility with One Training Run
Differentially private (DP) optimization has been widely adopted as a standard approach to provide rigorous privacy guarantees for training datasets. DP auditing verifies whether a model trained with DP optimization satisfies its claimed privacy level by estimating empirical privacy lower bounds through hypothesis testing. Recent O(1) frameworks improve auditing efficiency by checking the membership status of multiple audit samples in a single run, rather than checking individual samples across…

Sources say Alibaba, Tencent, Baidu, and other Chinese companies are testing domestic alternatives as they deal with a dwindling stockpile of Nvidia processors (Financial Times)
https://www.ft.com/content/bb1315e8-27df-4a93-a4dc-11e2883fdde3

Chinese tech groups prepare for AI future without Nvidia
Tougher US export restrictions on advanced chips give added urgency to testing of domestic alternatives

Evaluating the Evaluators: Trust in Adversarial Robustness Tests
Antonio Emanuele Cin\`a, Maura Pintor, Luca Demetrio, Ambra Demontis, Battista Biggio, Fabio Roli
https://arxiv.org/abs/2507.03450

Evaluating the Evaluators: Trust in Adversarial Robustness Tests
Despite significant progress in designing powerful adversarial evasion attacks for robustness verification, the evaluation of these methods often remains inconsistent and unreliable. Many assessments rely on mismatched models, unverified implementations, and uneven computational budgets, which can lead to biased results and a false sense of security. Consequently, robustness claims built on such flawed testing protocols may be misleading and give a false sense of security. As a concrete step to…

This https://arxiv.org/abs/2501.09015 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_sta…

Family-wise Error Rate Control with E-values
The closure principle is a standard tool for achieving strong family-wise error rate (FWER) control in multiple testing problems. We develop an e-value-based closed testing framework that inherits nice properties of e-values, which are common in settings of sequential hypothesis testing or universal inference for irregular parametric models. We prove that e-value-based closed testing strongly controls the post-hoc FWER in the static setting, and has stronger anytime-valid and always-valid FWER-…

A Systematization of Security Vulnerabilities in Computer Use Agents
Daniel Jones, Giorgio Severi, Martin Pouliot, Gary Lopez, Joris de Gruyter, Santiago Zanella-Beguelin, Justin Song, Blake Bullwinkel, Pamela Cortez, Amanda Minnich
https://arxiv.org/abs/2507.05445

A Systematization of Security Vulnerabilities in Computer Use Agents
Computer Use Agents (CUAs), autonomous systems that interact with software interfaces via browsers or virtual machines, are rapidly being deployed in consumer and enterprise environments. These agents introduce novel attack surfaces and trust boundaries that are not captured by traditional threat models. Despite their growing capabilities, the security boundaries of CUAs remain poorly understood. In this paper, we conduct a systematic threat analysis and testing of real-world CUAs under adversa…

Solsmith: Solidity Random Program Generator for Compiler Testing
Lantian Li, Zhihao Liu, Zhongxing Yu
https://arxiv.org/abs/2506.03909 https://

Solsmith: Solidity Random Program Generator for Compiler Testing
Smart contracts are computer programs that run on blockchain platforms, with Solidity being the most widely used language for their development. As blockchain technology advances, smart contracts have become increasingly important across various fields. In order for smart contracts to operate correctly, the correctness of the compiler is particularly crucial. Although some research efforts have been devoted to testing Solidity compilers, they primarily focus on testing methods and do not addres…

The Impact of LLM-Assistants on Software Developer Productivity: A Systematic Literature Review
Amr Mohamed, Maram Assi, Mariam Guizani
https://arxiv.org/abs/2507.03156

The Impact of LLM-Assistants on Software Developer Productivity: A Systematic Literature Review
Large language model assistants (LLM-assistants) present new opportunities to transform software development. Developers are increasingly adopting these tools across tasks, including coding, testing, debugging, documentation, and design. Yet, despite growing interest, there is no synthesis of how LLM-assistants affect software developer productivity. In this paper, we present a systematic literature review of 37 peer-reviewed studies published between January 2014 and December 2024 that examine…

FuzzFeed: An Automatic Approach to Weakest Precondition Generation using LLMs and Fuzzing
Daragh King, Vasileios Koutavas, Laura Kovacs
https://arxiv.org/abs/2507.05272

FuzzFeed: An Automatic Approach to Weakest Precondition Generation using LLMs and Fuzzing
The weakest precondition (WP) of a program describes the largest set of initial states from which all terminating executions of the program satisfy a given postcondition. The generation of WPs is an important task with practical applications in areas ranging from verification to run-time error checking. This paper proposes the combination of Large Language Models (LLMs) and fuzz testing for generating WPs. In pursuit of this goal, we introduce Fuzzing Guidance (FG); FG acts as a means of dire…

iPanda: An Intelligent Protocol Testing and Debugging Agent for Conformance Testing
Xikai Sun, Fan Dang, Kebin Liu, Xin Miao, Zihao Yang, Haimo Lu, Yawen Zheng, Yunhao Liu
https://arxiv.org/abs/2507.00378

iPanda: An Intelligent Protocol Testing and Debugging Agent for Conformance Testing
Conformance testing is essential for ensuring that protocol implementations comply with their specifications. However, traditional testing approaches involve manually creating numerous test cases and scripts, making the process labor-intensive and inefficient. Recently, Large Language Models (LLMs) have demonstrated impressive text comprehension and code generation abilities, providing promising opportunities for automation. In this paper, we propose iPanda, the first end-to-end framework that …

On the Surprising Efficacy of LLMs for Penetration-Testing
Andreas Happe, J\"urgen Cito
https://arxiv.org/abs/2507.00829 https://

On the Surprising Efficacy of LLMs for Penetration-Testing
This paper presents a critical examination of the surprising efficacy of Large Language Models (LLMs) in penetration testing. The paper thoroughly reviews the evolution of LLMs and their rapidly expanding capabilities which render them increasingly suitable for complex penetration testing operations. It systematically details the historical adoption of LLMs in both academic research and industry, showcasing their application across various offensive security tasks and covering broader phases of…

Meta-Fair: AI-Assisted Fairness Testing of Large Language Models
Miguel Romero-Arjona, Jos\'e A. Parejo, Juan C. Alonso, Ana B. S\'anchez, Aitor Arrieta, Sergio Segura
https://arxiv.org/abs/2507.02533

Meta-Fair: AI-Assisted Fairness Testing of Large Language Models
Fairness--the absence of unjustified bias--is a core principle in the development of Artificial Intelligence (AI) systems, yet it remains difficult to assess and enforce. Current approaches to fairness testing in large language models (LLMs) often rely on manual evaluation, fixed templates, deterministic heuristics, and curated datasets, making them resource-intensive and difficult to scale. This work aims to lay the groundwork for a novel, automated method for testing fairness in LLMs, reducin…

Temac: Multi-Agent Collaboration for Automated Web GUI Testing
Chenxu Liu, Zhiyu Gu, Guoquan Wu, Ying Zhang, Jun Wei, Tao Xie
https://arxiv.org/abs/2506.00520

Temac: Multi-Agent Collaboration for Automated Web GUI Testing
Quality assurance of web applications is critical, as web applications play an essential role in people's daily lives. To reduce labor costs, automated web GUI testing (AWGT) is widely adopted, exploring web applications via GUI actions such as clicks and text inputs. However, these approaches face limitations in generating continuous and meaningful action sequences capable of covering complex functionalities. Recent work incorporates large language models (LLMs) for GUI testing. However, these…

This https://arxiv.org/abs/2411.05185 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csCR_…

PentestAgent: Incorporating LLM Agents to Automated Penetration Testing
Penetration testing is a critical technique for identifying security vulnerabilities, traditionally performed manually by skilled security specialists. This complex process involves gathering information about the target system, identifying entry points, exploiting the system, and reporting findings. Despite its effectiveness, manual penetration testing is time-consuming and expensive, often requiring significant expertise and resources that many organizations cannot afford. While automated pen…

The Impact of Software Testing with Quantum Optimization Meets Machine Learning
Gopichand Bandarupalli
https://arxiv.org/abs/2506.02090 https://

The Impact of Software Testing with Quantum Optimization Meets Machine Learning
Modern software systems complexity challenges efficient testing, as traditional machine learning (ML) struggles with large test suites. This research presents a hybrid framework integrating Quantum Annealing with ML to optimize test case prioritization in CI/CD pipelines. Leveraging quantum optimization, it achieves a 25 percent increase in defect detection efficiency and a 30 percent reduction in test execution time versus classical ML, validated on the Defects4J dataset. A simulated CI/CD env…

Automated Web Application Testing: End-to-End Test Case Generation with Large Language Models and Screen Transition Graphs
Nguyen-Khang Le, Quan Minh Bui, Minh Ngoc Nguyen, Hiep Nguyen, Trung Vo, Son T. Luu, Shoshin Nomura, Minh Le Nguyen
https://arxiv.org/abs/2506.02529

Automated Web Application Testing: End-to-End Test Case Generation with Large Language Models and Screen Transition Graphs
Web applications are critical to modern software ecosystems, yet ensuring their reliability remains challenging due to the complexity and dynamic nature of web interfaces. Recent advances in large language models (LLMs) have shown promise in automating complex tasks, but limitations persist in handling dynamic navigation flows and complex form interactions. This paper presents an automated system for generating test cases for two key aspects of web application testing: site navigation and form …

VISCA: Inferring Component Abstractions for Automated End-to-End Testing
Parsa Alian, Martin Tang, Ali Mesbah
https://arxiv.org/abs/2506.04161 https://

VISCA: Inferring Component Abstractions for Automated End-to-End Testing
Providing optimal contextual input presents a significant challenge for automated end-to-end (E2E) test generation using large language models (LLMs), a limitation that current approaches inadequately address. This paper introduces Visual-Semantic Component Abstractor (VISCA), a novel method that transforms webpages into a hierarchical, semantically rich component abstraction. VISCA starts by partitioning webpages into candidate segments utilizing a novel heuristic-based segmentation method. Th…

Coverage-Guided Testing for Deep Learning Models: A Comprehensive Survey
Hongjing Guo, Chuanqi Tao, Zhiqiu Huang, Weiqin Zou
https://arxiv.org/abs/2507.00496

Coverage-Guided Testing for Deep Learning Models: A Comprehensive Survey
As Deep Learning (DL) models are increasingly applied in safety-critical domains, ensuring their quality has emerged as a pressing challenge in modern software engineering. Among emerging validation paradigms, coverage-guided testing (CGT) has gained prominence as a systematic framework for identifying erroneous or unexpected model behaviors. Despite growing research attention, existing CGT studies remain methodologically fragmented, limiting the understanding of current advances and emerging t…

STCLocker: Deadlock Avoidance Testing for Autonomous Driving Systems
Mingfei Cheng, Renzhi Wang, Xiaofei Xie, Yuan Zhou, Lei Ma
https://arxiv.org/abs/2506.23995

STCLocker: Deadlock Avoidance Testing for Autonomous Driving Systems
Autonomous Driving System (ADS) testing is essential to ensure the safety and reliability of autonomous vehicles (AVs) before deployment. However, existing techniques primarily focus on evaluating ADS functionalities in single-AV settings. As ADSs are increasingly deployed in multi-AV traffic, it becomes crucial to assess their cooperative performance, particularly regarding deadlocks, a fundamental coordination failure in which multiple AVs enter a circular waiting state indefinitely, resultin…

TESTQUEST: A Web Gamification Tool to Improve Locators and Page Objects Quality
Dario Olianas, Diego Clerissi, Maurizio Leotta, Filippo Ricca
https://arxiv.org/abs/2505.24756

TESTQUEST: A Web Gamification Tool to Improve Locators and Page Objects Quality
Web applications play a crucial role in our daily lives, making it essential to employ testing methods that ensure their quality. Typically, Web testing automation frameworks rely on locators to interact with the graphical user interface, acting as connection points to the elements on a Web page. Nevertheless, locators are widely recognized as a major vulnerability in Web testing, as they are highly sensitive to the frequent changes in Web page structures caused by rapid software evolution. The…

Software Fairness Testing in Practice
Ronnie de Souza Santos, Matheus de Morais Leca, Reydne Santos, Cleyton Magalhaes
https://arxiv.org/abs/2506.17095 htt…

Software Fairness Testing in Practice
Software testing ensures that a system functions correctly, meets specified requirements, and maintains high quality. As artificial intelligence and machine learning (ML) technologies become integral to software systems, testing has evolved to address their unique complexities. A critical advancement in this space is fairness testing, which identifies and mitigates biases in AI applications to promote ethical and equitable outcomes. Despite extensive academic research on fairness testing, inclu…

This https://arxiv.org/abs/2405.04860 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csSE_…

Quantum Concolic Testing
This paper presents the first concolic testing framework explicitly designed for quantum programs. The framework introduces quantum constraint generation methods for quantum control statements that quantify quantum states and offers a symbolization method for quantum variables. Based on this framework, we generate path constraints for each concrete execution path of a quantum program. These constraints guide the exploration of new paths, with a quantum constraint solver determining outcomes to …