Tootfinder

Optimal Convergence Rates of Deep Neural Network Classifiers
Zihan Zhang, Lei Shi, Ding-Xuan Zhou
https://arxiv.org/abs/2506.14899 https://

Optimal Convergence Rates of Deep Neural Network Classifiers
In this paper, we study the binary classification problem on $[0,1]^d$ under the Tsybakov noise condition (with exponent $s \in [0,\infty]$) and the compositional assumption. This assumption requires the conditional class probability function of the data distribution to be the composition of $q+1$ vector-valued multivariate functions, where each component function is either a maximum value function or a Hölder-$β$ smooth function that depends only on $d_*$ of its input variables. Notably, $d_…

J3DAI: A tiny DNN-Based Edge AI Accelerator for 3D-Stacked CMOS Image Sensor
Benoit Tain, Raphael Millet, Romain Lemaire, Michal Szczepanski, Laurent Alacoque, Emmanuel Pluchart, Sylvain Choisnet, Rohit Prasad, Jerome Chossat, Pascal Pierunek, Pascal Vivet, Sebastien Thuries
https://arxiv.org/abs/2506.15316

J3DAI: A tiny DNN-Based Edge AI Accelerator for 3D-Stacked CMOS Image Sensor
This paper presents J3DAI, a tiny deep neural network-based hardware accelerator for a 3-layer 3D-stacked CMOS image sensor featuring an artificial intelligence (AI) chip integrating a Deep Neural Network (DNN)-based accelerator. The DNN accelerator is designed to efficiently perform neural network tasks such as image classification and segmentation. This paper focuses on the digital system of J3DAI, highlighting its Performance-Power-Area (PPA) characteristics and showcasing advanced edge AI c…

Integrated photonic deep neural network with end-to-end on-chip backpropagation training
Farshid Ashtiani, Mohamad Hossein Idjadi, Kwangwoong Kim
https://arxiv.org/abs/2506.14575 …

Integrated photonic deep neural network with end-to-end on-chip backpropagation training
Integrated photonic neural networks (PNNs) have demonstrated significant potential to complement the digital electronic counterparts [1-3]. Nevertheless, robust and repeatable performance of scalable integrated PNNs is directly tied to the quality of their training. Error backpropagation (BP), which relies on nonlinear activation gradient computation, is the mainstream algorithm to train digital neural networks due to its scalability, versatility, and implementation efficiency [4]. Consequently…

Rel-HNN: Split Parallel Hypergraph Neural Network for Learning on Relational Databases
Md. Tanvir Alam, Md. Ahasanul Alam, Md Mahmudur Rahman, Md. Mosaddek Khan
https://arxiv.org/abs/2507.12562

Rel-HNN: Split Parallel Hypergraph Neural Network for Learning on Relational Databases
Relational databases (RDBs) are ubiquitous in enterprise and real-world applications. Flattening the database poses challenges for deep learning models that rely on fixed-size input representations to capture relational semantics from the structured nature of relational data. Graph neural networks (GNNs) have been proposed to address this, but they often oversimplify relational structures by modeling all the tuples as monolithic nodes and ignoring intra-tuple associations. In this work, we prop…

Weak TransNet: A Petrov-Galerkin based neural network method for solving elliptic PDEs
Zhihang Xu, Min Wang, Zhu Wang
https://arxiv.org/abs/2506.14812 http…

Weak TransNet: A Petrov-Galerkin based neural network method for solving elliptic PDEs
While deep learning has achieved remarkable success in solving partial differential equations (PDEs), it still faces significant challenges, particularly when the PDE solutions have low regularity or singularities. To address these issues, we propose the Weak TransNet (WTN) method, based on a Petrov-Galerkin formulation, for solving elliptic PDEs in this work, though its framework may extend to other classes of equations. Specifically, the neural feature space defined by TransNet (Zhang et al.,…

Online Training and Pruning of Deep Reinforcement Learning Networks
Valentin Frank Ingmar Guenter, Athanasios Sideris
https://arxiv.org/abs/2507.11975 http…

Online Training and Pruning of Deep Reinforcement Learning Networks
Scaling deep neural networks (NN) of reinforcement learning (RL) algorithms has been shown to enhance performance when feature extraction networks are used but the gained performance comes at the significant expense of increased computational and memory complexity. Neural network pruning methods have successfully addressed this challenge in supervised learning. However, their application to RL is underexplored. We propose an approach to integrate simultaneous training and pruning within advance…

Disentangling coincident cell events using deep transfer learning and compressive sensing
Moritz Leuthner, Rafael Vorl\"ander, Oliver Hayden
https://arxiv.org/abs/2507.13176 …

Disentangling coincident cell events using deep transfer learning and compressive sensing
Accurate single-cell analysis is critical for diagnostics, immunomonitoring, and cell therapy, but coincident events - where multiple cells overlap in a sensing zone - can severely compromise signal fidelity. We present a hybrid framework combining a fully convolutional neural network (FCN) with compressive sensing (CS) to disentangle such overlapping events in one-dimensional sensor data. The FCN, trained on bead-derived datasets, accurately estimates coincident event counts and generalizes to…

Demographics-Informed Neural Network for Multi-Modal Spatiotemporal forecasting of Urban Growth and Travel Patterns Using Satellite Imagery
Eugene Kofi Okrah Denteh, Andrews Danyo, Joshua Kofi Asamoah, Blessing Agyei Kyem, Armstrong Aboah
https://arxiv.org/abs/2506.12456

Demographics-Informed Neural Network for Multi-Modal Spatiotemporal forecasting of Urban Growth and Travel Patterns Using Satellite Imagery
This study presents a novel demographics informed deep learning framework designed to forecast urban spatial transformations by jointly modeling geographic satellite imagery, socio-demographics, and travel behavior dynamics. The proposed model employs an encoder-decoder architecture with temporal gated residual connections, integrating satellite imagery and demographic data to accurately forecast future spatial transformations. The study also introduces a demographics prediction component which…

Hashed Watermark as a Filter: Defeating Forging and Overwriting Attacks in Weight-based Neural Network Watermarking
Yuan Yao, Jin Song, Jian Jin
https://arxiv.org/abs/2507.11137

Hashed Watermark as a Filter: Defeating Forging and Overwriting Attacks in Weight-based Neural Network Watermarking
As valuable digital assets, deep neural networks necessitate robust ownership protection, positioning neural network watermarking (NNW) as a promising solution. Among various NNW approaches, weight-based methods are favored for their simplicity and practicality; however, they remain vulnerable to forging and overwriting attacks. To address those challenges, we propose NeuralMark, a robust method built around a hashed watermark filter. Specifically, we utilize a hash function to generate an irre…

Search for Z/2 eigenfunctions on the sphere using machine learning
Andriy Haydys, Willem Adriaan Salm
https://arxiv.org/abs/2507.13122 https://

Search for Z/2 eigenfunctions on the sphere using machine learning
We use machine learning to search for examples of Z/2 eigenfunctions on the 2-sphere. For this we created a multivalued version of a feedforward deep neural network, and we implemented it using the JAX library. We found Z/2 eigenfunctions for three cases: In the first two cases we fixed the branch points at the vertices of a tetrahedron and at a cube respectively. In a third case, we allowed the AI to move the branch points around and, in the end, it positioned the branch points at the vertices…

Catching Bid-rigging Cartels with Graph Attention Neural Networks
David Imhof, Emanuel W Viklund, Martin Huber
https://arxiv.org/abs/2507.12369 https://

Catching Bid-rigging Cartels with Graph Attention Neural Networks
We propose a novel application of graph attention networks (GATs), a type of graph neural network enhanced with attention mechanisms, to develop a deep learning algorithm for detecting collusive behavior, leveraging predictive features suggested in prior research. We test our approach on a large dataset covering 13 markets across seven countries. Our results show that predictive models based on GATs, trained on a subset of the markets, can be effectively transferred to other markets, achieving …

Exploring the Effectiveness of Deep Features from Domain-Specific Foundation Models in Retinal Image Synthesis
Zuzanna Skorniewska, Bartlomiej W. Papiez
https://arxiv.org/abs/2506.11753

Exploring the Effectiveness of Deep Features from Domain-Specific Foundation Models in Retinal Image Synthesis
The adoption of neural network models in medical imaging has been constrained by strict privacy regulations, limited data availability, high acquisition costs, and demographic biases. Deep generative models offer a promising solution by generating synthetic data that bypasses privacy concerns and addresses fairness by producing samples for under-represented groups. However, unlike natural images, medical imaging requires validation not only for fidelity (e.g., Fréchet Inception Score) but also…

Efficient Traffic Classification using HW-NAS: Advanced Analysis and Optimization for Cybersecurity on Resource-Constrained Devices
Adel Chehade, Edoardo Ragusa, Paolo Gastaldo, Rodolfo Zunino
https://arxiv.org/abs/2506.11319

Efficient Traffic Classification using HW-NAS: Advanced Analysis and Optimization for Cybersecurity on Resource-Constrained Devices
This paper presents a hardware-efficient deep neural network (DNN), optimized through hardware-aware neural architecture search (HW-NAS); the DNN supports the classification of session-level encrypted traffic on resource-constrained Internet of Things (IoT) and edge devices. Thanks to HW-NAS, a 1D convolutional neural network (CNN) is tailored on the ISCX VPN-nonVPN dataset to meet strict memory and computational limits while achieving robust performance. The optimized model attains an accuracy…

Genericity of Polyak-Lojasiewicz Inequalities for Entropic Mean-Field Neural ODEs
Samuel Daudin, Fran\c{c}ois Delarue
https://arxiv.org/abs/2507.08486 http…

Genericity of Polyak-Lojasiewicz Inequalities for Entropic Mean-Field Neural ODEs
We address the behavior of idealized deep residual neural networks (ResNets), modeled via an optimal control problem set over continuity (or adjoint transport) equations. The continuity equations describe the statistical evolution of the features in the asymptotic regime where the layers of the network form a continuum. The velocity field is expressed through the network activation function, which is itself viewed as a function of the statistical distribution of the network parameters (weights …

Deep learning inference with the #EventHorizonTelescope I. Calibration improvements and a comprehensive synthetic data library / II. The ZINGULARITY framework for Bayesian artificial neural networks / III. ZINGULARITY results from the 2017 observations and predictions for future array expansions: https://www.aanda.org/articles/aa/full_html/2025/06/aa53784-25/aa53784-25.html / https://www.aanda.org/articles/aa/full_html/2025/06/aa53785-25/aa53785-25.html / https://www.aanda.org/articles/aa/full_html/2025/06/aa53786-25/aa53786-25.html -> Self-learning neural network cracks iconic black holes: https://www.astronomie.nl/nieuws/en/self-learning-neural-network-cracks-iconic-black-holes-4528

Selective Quantization Tuning for ONNX Models
Nikolaos Louloudakis, Ajitha Rajan
https://arxiv.org/abs/2507.12196 https://arxiv.org/p…

Selective Quantization Tuning for ONNX Models
Quantization is a process that reduces the precision of deep neural network models to lower model size and computational demands, often at the cost of accuracy. However, fully quantized models may exhibit sub-optimal performance below acceptable levels and face deployment challenges on low-end hardware accelerators due to practical constraints. To address these issues, quantization can be selectively applied to only a subset of layers, but selecting which layers to exclude is non-trivial. To th…

Machine Intelligence on Wireless Edge Networks
Sri Krishna Vadlamani, Kfir Sulimany, Zhihui Gao, Tingjun Chen, Dirk Englund
https://arxiv.org/abs/2506.12210

Machine Intelligence on Wireless Edge Networks
Deep neural network (DNN) inference on power-constrained edge devices is bottlenecked by costly weight storage and data movement. We introduce MIWEN, a radio-frequency (RF) analog architecture that ``disaggregates'' memory by streaming weights wirelessly and performing classification in the analog front end of standard transceivers. By encoding weights and activations onto RF carriers and using native mixers as computation units, MIWEN eliminates local weight memory and the overhead of analog-t…

Emulating CO Line Radiative Transfer with Deep Learning
Shiqi Su, Frederik De Ceuster, Jaehoon Cha, Mark I. Wilkinson, Jeyan Thiyagalingam, Jeremy Yates, Yi-Hang Zhu, Jan Bolte
https://arxiv.org/abs/2507.11398

Emulating CO Line Radiative Transfer with Deep Learning
Modelling carbon monoxide (CO) line radiation is computationally expensive for traditional numerical solvers, especially when applied to complex, three-dimensional stellar atmospheres. We present COEmuNet, a 3D convolutional neural network (CNN)-based surrogate model that emulates CO line radiation transport with high accuracy and efficiency. It consists of an asymmetric encoder-decoder design that takes 3D hydrodynamical models as inputs and generates synthetic observations of evolved stellar …

Deep Spatial Neural Net Models with Functional Predictors: Application in Large-Scale Crop Yield Prediction
Yeonjoo Park, Bo Li, Yehua Li
https://arxiv.org/abs/2506.13017

Deep Spatial Neural Net Models with Functional Predictors: Application in Large-Scale Crop Yield Prediction
Accurate prediction of crop yield is critical for supporting food security, agricultural planning, and economic decision-making. However, yield forecasting remains a significant challenge due to the complex and nonlinear relationships between weather variables and crop production, as well as spatial heterogeneity across agricultural regions. We propose DSNet, a deep neural network architecture that integrates functional and scalar predictors with spatially varying coefficients and spatial rando…

Accurate Depth-Resolved Temperature Profiling via Thermal-Radiation Spectroscopy: Numerical Methods vs Machine Learning
Dmitrii Shymkiv, Zhongyuan Wang, Brigham Thornock, Aiden Karpf, Camila Nunez, Yuzhe Xiao
https://arxiv.org/abs/2506.14554

Accurate Depth-Resolved Temperature Profiling via Thermal-Radiation Spectroscopy: Numerical Methods vs Machine Learning
We present and compare three approaches for accurately retrieving depth-resolved temperature distributions within materials from their thermal-radiation spectra, based on: (1) a nonlinear equation solver implemented in commercial software, (2) a custom-built nonlinear equation solver, and (3) a deep neural network (DNN) model. These methods are first validated using synthetic datasets comprising randomly generated temperature profiles and corresponding noisy thermal-radiation spectra for three …

Critical dynamics governs deep learning
Simon Vock, Christian Meisel
https://arxiv.org/abs/2507.08527 https://arxiv.org/pdf/2507.0852…

Critical dynamics governs deep learning
Artificial intelligence has advanced rapidly through larger and deeper neural networks, yet fundamental questions remain about how to optimize network dynamics for performance and adaptability. This study shows that deep neural networks (DNNs), like biological brains, perform optimally when operating near a critical phase transition - poised between active and inactive dynamics. Drawing from physics and neuroscience, we demonstrate that criticality provides a unifying principle linking structur…

Improving spliced alignment by modeling splice sites with deep learning
Siying Yang, Neng Huang, Heng Li
https://arxiv.org/abs/2506.12986 https://

Improving spliced alignment by modeling splice sites with deep learning
Motivation: Spliced alignment refers to the alignment of messenger RNA (mRNA) or protein sequences to eukaryotic genomes. It plays a critical role in gene annotation and the study of gene functions. Accurate spliced alignment demands sophisticated modeling of splice sites, but current aligners use simple models, which may affect their accuracy given dissimilar sequences. Results: We implemented minisplice to learn splice signals with a one-dimensional convolutional neural network (1D-CNN) and…

Hybrid Quantum Convolutional Neural Network-Aided Pilot Assignment in Cell-Free Massive MIMO Systems
Doan Hieu Nguyen, Xuan Tung Nguyen, Seon-Geun Jeong, Trinh Van Chien, Lajos Hanzo, Won Joo Hwang
https://arxiv.org/abs/2507.06585

Hybrid Quantum Convolutional Neural Network-Aided Pilot Assignment in Cell-Free Massive MIMO Systems
A sophisticated hybrid quantum convolutional neural network (HQCNN) is conceived for handling the pilot assignment task in cell-free massive MIMO systems, while maximizing the total ergodic sum throughput. The existing model-based solutions found in the literature are inefficient and/or computationally demanding. Similarly, conventional deep neural networks may struggle in the face of high-dimensional inputs, require complex architectures, and their convergence is slow due to training numerous …

Replaced article(s) found for physics.atom-ph. https://arxiv.org/list/physics.atom-ph/new
[1/1]:
- A deep neural network approach to solve the Dirac equation
Chuanxin Wang, Tomoya Naito, Jian Li, Haozhao Liang

Standards-Compliant DM-RS Allocation via Temporal Channel Prediction for Massive MIMO Systems
Sehyun Ryu, Hyun Jong Yang
https://arxiv.org/abs/2507.11064 h…

Standards-Compliant DM-RS Allocation via Temporal Channel Prediction for Massive MIMO Systems
Reducing feedback overhead in beyond 5G networks is a critical challenge, as the growing number of antennas in modern massive MIMO systems substantially increases the channel state information (CSI) feedback demand in frequency division duplex (FDD) systems. To address this, extensive research has focused on CSI compression and prediction, with neural network-based approaches gaining momentum and being considered for integration into the 3GPP 5G-Advanced standards. While deep learning has been …

3D Magnetic Inverse Routine for Single-Segment Magnetic Field Images
J. Senthilnath, Chen Hao, F. C. Wellstood
https://arxiv.org/abs/2507.11293 https://

3D Magnetic Inverse Routine for Single-Segment Magnetic Field Images
In semiconductor packaging, accurately recovering 3D information is crucial for non-destructive testing (NDT) to localize circuit defects. This paper presents a novel approach called the 3D Magnetic Inverse Routine (3D MIR), which leverages Magnetic Field Images (MFI) to retrieve the parameters for the 3D current flow of a single-segment. The 3D MIR integrates a deep learning (DL)-based Convolutional Neural Network (CNN), spatial-physics-based constraints, and optimization techniques. The metho…

Recursive KalmanNet: Deep Learning-Augmented Kalman Filtering for State Estimation with Consistent Uncertainty Quantification
Hassan Mortada, Cyril Falcon, Yanis Kahil, Math\'eo Clavaud, Jean-Philippe Michel
https://arxiv.org/abs/2506.11639

Recursive KalmanNet: Deep Learning-Augmented Kalman Filtering for State Estimation with Consistent Uncertainty Quantification
State estimation in stochastic dynamical systems with noisy measurements is a challenge. While the Kalman filter is optimal for linear systems with independent Gaussian white noise, real-world conditions often deviate from these assumptions, prompting the rise of data-driven filtering techniques. This paper introduces Recursive KalmanNet, a Kalman-filter-informed recurrent neural network designed for accurate state estimation with consistent error covariance quantification. Our approach propaga…

DRO-EDL-MPC: Evidential Deep Learning-Based Distributionally Robust Model Predictive Control for Safe Autonomous Driving
Hyeongchan Ham, Heejin Ahn
https://arxiv.org/abs/2507.05710

DRO-EDL-MPC: Evidential Deep Learning-Based Distributionally Robust Model Predictive Control for Safe Autonomous Driving
Safety is a critical concern in motion planning for autonomous vehicles. Modern autonomous vehicles rely on neural network-based perception, but making control decisions based on these inference results poses significant safety risks due to inherent uncertainties. To address this challenge, we present a distributionally robust optimization (DRO) framework that accounts for both aleatoric and epistemic perception uncertainties using evidential deep learning (EDL). Our approach introduces a novel…

SNR and Resource Adaptive Deep JSCC for Distributed IoT Image Classification
Ali Waqas, Sinem Coleri
https://arxiv.org/abs/2506.10699 https://

SNR and Resource Adaptive Deep JSCC for Distributed IoT Image Classification
Sensor-based local inference at IoT devices faces severe computational limitations, often requiring data transmission over noisy wireless channels for server-side processing. To address this, split-network Deep Neural Network (DNN) based Joint Source-Channel Coding (JSCC) schemes are used to extract and transmit relevant features instead of raw data. However, most existing methods rely on fixed network splits and static configurations, lacking adaptability to varying computational budgets and c…

Deep Potential-Driven Molecular Dynamics of CO Ice Analogues: Investigating Desorption Following Vibrational Excitation
Maxime Infuso, Samuel Del Fr\'e, Gilberto A. Alou, Mathieu Bertin, Jean-Hugues Fillion, Alejandro Rivero Santamar\'ia, Maurice Monnerville
https://arxiv.org/abs/2506.10882…

Deep Potential-Driven Molecular Dynamics of CO Ice Analogues: Investigating Desorption Following Vibrational Excitation
We present a new deep learning-based machine learning potential (MLP) for molecular dynamics simulations of solid carbon monoxide (CO), capable of accurately describing CO vibrations both in the fundamental state and in highly excited vibrational states, up to approximately v = 40. The MLP is based on the combination of high-dimensional neural network atomic potentials using the DeePMD-kit package, trained on prior ab initio molecular dynamics (AIMD) data, with selective treatment of the excite…

HEIMDALL: a grapH-based sEIsMic Detector And Locator for microseismicity
Matteo Bagagli, Francesco Grigoli, Davide Bacciu
https://arxiv.org/abs/2507.10850 …

HEIMDALL: a grapH-based sEIsMic Detector And Locator for microseismicity
In this work, we present a new deep-learning model for microseismicity monitoring that utilizes continuous spatiotemporal relationships between seismic station recordings, forming an end-to-end pipeline for seismic catalog creation. It employs graph theory and state-of-the-art graph neural network architectures to perform phase picking, association, and event location simultaneously over rolling windows, making it suitable for both playback and near-real-time monitoring. As part of the global s…

Node-neighbor subnetworks and Hk-core decomposition
Dinghua Shi, Yang Zhao, Guanrong Chen
https://arxiv.org/abs/2507.04948 https://ar…

Node-neighbor subnetworks and Hk-core decomposition
The network homology Hk-core decomposition proposed in this article is similar to the k-core decomposition based on node degrees of the network. The C. elegans neural network and the cat cortical network are used as examples to reveal the symmetry of the deep structures of such networks. First, based on the concept of neighborhood in mathematics, some new concepts are introduced, including such as node-neighbor subnetwork and Betti numbers of the neighbor subnetwork, among others. Then, the Bet…

Deep Feed-Forward Neural Network for Bangla Isolated Speech Recognition
Dipayan Bhadra, Mehrab Hosain, Fatema Alam
https://arxiv.org/abs/2507.07068 https:/…

Deep Feed-Forward Neural Network for Bangla Isolated Speech Recognition
As the most important human-machine interfacing tool, an insignificant amount of work has been carried out on Bangla Speech Recognition compared to the English language. Motivated by this, in this work, the performance of speaker-independent isolated speech recognition systems has been implemented and analyzed using a dataset that is created containing both isolated Bangla and English spoken words. An approach using the Mel Frequency Cepstral Coefficient (MFCC) and Deep Feed-Forward Fully Conne…

This https://arxiv.org/abs/2505.06732 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_hepe…

Particle Identification with Deep Neural Networks Across Collision Energies in Simulated Proton-Proton Collisions
This study demonstrates a proof-of-concept application of a deep neural network for particle identification in simulated high transverse momentum proton-proton collisions, with a focus on evaluating model performance under controlled conditions. A model trained on simulated Large Hadron Collider (LHC) proton-proton collisions at $\sqrt{s} = 13\,\mathrm{TeV}$ is used to classify nine particle species based on seven kinematic-level features. The model is then tested on simulated high transverse m…

A Dynamical Systems Perspective on the Analysis of Neural Networks
Dennis Chemnitz, Maximilian Engel, Christian Kuehn, Sara-Viola Kuntz
https://arxiv.org/abs/2507.05164

A Dynamical Systems Perspective on the Analysis of Neural Networks
In this chapter, we utilize dynamical systems to analyze several aspects of machine learning algorithms. As an expository contribution we demonstrate how to re-formulate a wide variety of challenges from deep neural networks, (stochastic) gradient descent, and related topics into dynamical statements. We also tackle three concrete challenges. First, we consider the process of information propagation through a neural network, i.e., we study the input-output map for different architectures. We ex…

SPEAR: Structured Pruning for Spiking Neural Networks via Synaptic Operation Estimation and Reinforcement Learning
Hui Xie, Yuhe Liu, Shaoqi Yang, Jinyang Guo, Yufei Guo, Yuqing Ma, Jiaxin Chen, Jiaheng Liu, Xianglong Liu
https://arxiv.org/abs/2507.02945

SPEAR: Structured Pruning for Spiking Neural Networks via Synaptic Operation Estimation and Reinforcement Learning
While deep spiking neural networks (SNNs) demonstrate superior performance, their deployment on resource-constrained neuromorphic hardware still remains challenging. Network pruning offers a viable solution by reducing both parameters and synaptic operations (SynOps) to facilitate the edge deployment of SNNs, among which search-based pruning methods search for the SNNs structure after pruning. However, existing search-based methods fail to directly use SynOps as the constraint because it will d…

DeepQuark: deep-neural-network approach to multiquark bound states
Wei-Lin Wu, Lu Meng, Shi-Lin Zhu
https://arxiv.org/abs/2506.20555 https://

DeepQuark: deep-neural-network approach to multiquark bound states
For the first time, we implement the deep-neural-network-based variational Monte Carlo approach for the multiquark bound states, whose complexity surpasses that of electron or nucleon systems due to strong SU(3) color interactions. We design a novel and high-efficiency architecture, DeepQuark, to address the unique challenges in multiquark systems such as stronger correlations, extra discrete quantum numbers, and intractable confinement interaction. Our method demonstrates competitive performan…

Generalised Rate Control Approach For Stream Processing Applications
Ziren Xiao
https://arxiv.org/abs/2506.11710 https://arxiv.org/pd…

Generalised Rate Control Approach For Stream Processing Applications
Distributed stream processing systems are widely deployed to process real-time data generated by various devices, such as sensors and software systems. A key challenge in the system is overloading, which leads to an unstable system status and consumes additional system resources. In this paper, we use a graph neural network-based deep reinforcement learning to collaboratively control the data emission rate at which the data is generated in the stream source to proactively avoid overloading scen…

Sharp uniform approximation for spectral Barron functions by deep neural networks
Yulei Liao, Pingbing Ming, Hao Yu
https://arxiv.org/abs/2507.06789 https:…

Sharp uniform approximation for spectral Barron functions by deep neural networks
This work explores the neural network approximation capabilities for functions within the spectral Barron space $\mathscr{B}^s$, where $s$ is the smoothness index. We demonstrate that for functions in $\mathscr{B}^{1/2}$, a shallow neural network (a single hidden layer) with $N$ units can achieve an $L^p$-approximation rate of $\mathcal{O}(N^{-1/2})$. This rate also applies to uniform approximation, differing by at most a logarithmic factor. Our results significantly reduce the smoothness requi…

This https://arxiv.org/abs/2504.05424 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csSE_…

Speculative Automated Refactoring of Imperative Deep Learning Programs to Graph Execution
Efficiency is essential to support ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code -- supporting symbolic, graph-based Deep Neural Network (DNN) computation. While scalable, such development is error-prone, non-intuitive, and difficult to debug. Consequently, more natural, imperative DL frameworks encouraging eager execution have emerged but at the expense of run-time performance. Though hybrid approach…

Data-Driven Surrogate Modeling of DSMC Solutions Using Deep Neural Networks
Ehsan Roohi, Ahmad Shoja-sani
https://arxiv.org/abs/2506.22453 https://

Data-Driven Surrogate Modeling of DSMC Solutions Using Deep Neural Networks
This study presents a deep neural network (DNN) framework that accelerates Direct Simulation Monte Carlo (DSMC) computations for rarefied-gas flows, while maintaining high physical fidelity. First, a fully connected deep neural network is trained on high-quality DSMC data for seven temperatures (200-650 K) to reproduce the Maxwell-Boltzmann speed distribution of argon. Injecting the physical boundary point into the training set enforces the correct low-speed limit. It reduces the mean-squared e…

This https://arxiv.org/abs/2503.17945 has been replaced.
initial toot: https://mastoxiv.page/@a…

Deep Learning Assisted Denoising of Experimental Micrographs
Microstructure imaging is crucial in materials science, but experimental images often introduce noise that obscures critical structural details. This study presents a novel deep learning approach for robust microstructure image denoising, combining phase-field simulations, Fourier transform techniques, and an attention-based neural network. The innovative framework addresses dataset limitations by synthetically generating training data by combining computational phase-field microstructures with…

Partially-Supervised Neural Network Model For Quadratic Multiparametric Programming
Fuat Can Beylunioglu, Mehrdad Pirnia, P. Robert Duimering
https://arxiv.org/abs/2506.05567

Partially-Supervised Neural Network Model For Quadratic Multiparametric Programming
Neural Networks (NN) with ReLU activation functions are used to model multiparametric quadratic optimization problems (mp-QP) in diverse engineering applications. Researchers have suggested leveraging the piecewise affine property of deep NN models to solve mp-QP with linear constraints, which also exhibit piecewise affine behaviour. However, traditional deep NN applications to mp-QP fall short of providing optimal and feasible predictions, even when trained on large datasets. This study propos…

DUN-SRE: Deep Unrolling Network with Spatiotemporal Rotation Equivariance for Dynamic MRI Reconstruction
Yuliang Zhu, Jing Cheng, Qi Xie, Zhuo-Xu Cui, Qingyong Zhu, Yuanyuan Liu, Xin Liu, Jianfeng Ren, Chengbo Wang, Dong Liang
https://arxiv.org/abs/2506.10309

DUN-SRE: Deep Unrolling Network with Spatiotemporal Rotation Equivariance for Dynamic MRI Reconstruction
Dynamic Magnetic Resonance Imaging (MRI) exhibits transformation symmetries, including spatial rotation symmetry within individual frames and temporal symmetry along the time dimension. Explicit incorporation of these symmetry priors in the reconstruction model can significantly improve image quality, especially under aggressive undersampling scenarios. Recently, Equivariant convolutional neural network (ECNN) has shown great promise in exploiting spatial symmetry priors. However, existing ECNN…

Admissibility of Stein Shrinkage for Batch Normalization in the Presence of Adversarial Attacks
Sofia Ivolgina, P. Thomas Fletcher, Baba C. Vemuri
https://arxiv.org/abs/2507.08261

Admissibility of Stein Shrinkage for Batch Normalization in the Presence of Adversarial Attacks
Batch normalization (BN) is a ubiquitous operation in deep neural networks used primarily to achieve stability and regularization during network training. BN involves feature map centering and scaling using sample means and variances, respectively. Since these statistics are being estimated across the feature maps within a batch, this problem is ideally suited for the application of Stein's shrinkage estimation, which leads to a better, in the mean-squared-error sense, estimate of the mean and …

Efficient nanophotonic devices optimization using deep neural network trained with physics-based transfer learning (PBTL) methodology
Gibaek Kim, Jungho Kim
https://arxiv.org/abs/2506.10418

Efficient nanophotonic devices optimization using deep neural network trained with physics-based transfer learning (PBTL) methodology
We propose a neural network(NN)-based surrogate modeling framework for photonic device optimization, especially in domains with imbalanced feature importance and high data generation costs. Our framework, which comprises physics-based transfer learning (PBTL)-enhanced surrogate modeling and scalarized multi-objective genetic algorithms (GAs), offers a generalizable solution for photonic design automation with minimal data resources.To validate the framework, we optimize mid-infrared quantum cas…

Deep learning of thermodynamic laws from microscopic dynamics
Hiroto Kuroyanagi, Tatsuro Yuge
https://arxiv.org/abs/2506.01506 https://

Deep learning of thermodynamic laws from microscopic dynamics
We numerically show that a deep neural network (DNN) can learn macroscopic thermodynamic laws purely from microscopic data. Using molecular dynamics simulations, we generate the data of snapshot images of gas particles undergoing adiabatic processes. We train a DNN to determine the temporal order of input image pairs. We observe that the trained network induces an order relation between states consistent with adiabatic accessibility, satisfying the axioms of thermodynamics. Furthermore, the int…

Classification of Hoyle State Decay Branches in Active Target Time Projection Chamber using Neural Network
Pralay Kumar Das, Nayana Majumdar, Supratik Mukhopadhyay
https://arxiv.org/abs/2506.02506

Classification of Hoyle State Decay Branches in Active Target Time Projection Chamber using Neural Network
A multi-class convolutional neural network (CNN) model has been developed using Keras deep learning library in Python for image-based classification of $^{12}$C Hoyle state decay branches from tracking information, recorded by Saha Active Target Time Projection Chamber, SAT-TPC (currently under development). The nuclear events, produced by the 30 MeV $α$-particle beam in the SAT-TPC, filled with Ar + CO$_2$ (90:10) gas mixture at atmospheric pressure, have been considered for training and vali…

KnowIt: Deep Time Series Modeling and Interpretation
M. W. Theunissen, R. Rabe, M. H. Davel
https://arxiv.org/abs/2507.06009 https://…

KnowIt: Deep Time Series Modeling and Interpretation
KnowIt (Knowledge discovery in time series data) is a flexible framework for building deep time series models and interpreting them. It is implemented as a Python toolkit, with source code and documentation available from https://must-deep-learning.github.io/KnowIt. It imposes minimal assumptions about task specifications and decouples the definition of dataset, deep neural network architecture, and interpretability technique through well defined interfaces. This ensures the ease of importing n…

FLARE: A Dataflow-Aware and Scalable Hardware Architecture for Neural-Hybrid Scientific Lossy Compression
Wenqi Jia, Ying Huang, Jian Xu, Zhewen Hu, Sian Jin, Jiannan Tian, Yuede Ji, Miao Yin
https://arxiv.org/abs/2507.01224

FLARE: A Dataflow-Aware and Scalable Hardware Architecture for Neural-Hybrid Scientific Lossy Compression
Scientific simulation leveraging high-performance computing (HPC) systems is crucial for modeling complex systems and phenomena in fields such as astrophysics, climate science, and fluid dynamics, generating massive datasets that often reach petabyte to exabyte scales. However, managing these vast data volumes introduces significant I/O and network bottlenecks, limiting practical performance and scalability. While cutting-edge lossy compression frameworks powered by deep neural networks (DNNs) …

EIM-TRNG: Obfuscating Deep Neural Network Weights with Encoding-in-Memory True Random Number Generator via RowHammer
Ranyang Zhou, Abeer Matar A. Almalky, Gamana Aragonda, Sabbir Ahmed, Filip Roth Tr{\o}nnes-Christensen, Adnan Siraj Rakin, Shaahin Angizi
https://arxiv.org/abs/2507.02206 …

EIM-TRNG: Obfuscating Deep Neural Network Weights with Encoding-in-Memory True Random Number Generator via RowHammer
True Random Number Generators (TRNGs) play a fundamental role in hardware security, cryptographic systems, and data protection. In the context of Deep NeuralNetworks (DNNs), safeguarding model parameters, particularly weights, is critical to ensure the integrity, privacy, and intel-lectual property of AI systems. While software-based pseudo-random number generators are widely used, they lack the unpredictability and resilience offered by hardware-based TRNGs. In this work, we propose a novel an…

WAKE: Watermarking Audio with Key Enrichment
Yaoxun Xu, Jianwei Yu, Hangting Chen, Zhiyong Wu, Xixin Wu, Dong Yu, Rongzhi Gu, Yi Luo
https://arxiv.org/abs/2506.05891

WAKE: Watermarking Audio with Key Enrichment
As deep learning advances in audio generation, challenges in audio security and copyright protection highlight the need for robust audio watermarking. Recent neural network-based methods have made progress but still face three main issues: preventing unauthorized access, decoding initial watermarks after multiple embeddings, and embedding varying lengths of watermarks. To address these issues, we propose WAKE, the first key-controllable audio watermark framework. WAKE embeds watermarks using sp…

This https://arxiv.org/abs/2409.15683 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_qu…

Quantum DeepONet: Neural operators accelerated by quantum computing
In the realm of computational science and engineering, constructing models that reflect real-world phenomena requires solving partial differential equations (PDEs) with different conditions. Recent advancements in neural operators, such as deep operator network (DeepONet), which learn mappings between infinite-dimensional function spaces, promise efficient computation of PDE solutions for a new condition in a single forward pass. However, classical DeepONet entails quadratic complexity concerni…

FieldFormer: Self-supervised Reconstruction of Physical Fields via Tensor Attention Prior
Panqi Chen, Siyuan Li, Lei Cheng, Xiao Fu, Yik-Chung Wu, Sergios Theodoridis
https://arxiv.org/abs/2506.11629

FieldFormer: Self-supervised Reconstruction of Physical Fields via Tensor Attention Prior
Reconstructing physical field tensors from \textit{in situ} observations, such as radio maps and ocean sound speed fields, is crucial for enabling environment-aware decision making in various applications, e.g., wireless communications and underwater acoustics. Field data reconstruction is often challenging, due to the limited and noisy nature of the observations, necessitating the incorporation of prior information to aid the reconstruction process. Deep neural network-based data-driven struct…

Deep Brain Net: An Optimized Deep Learning Model for Brain tumor Detection in MRI Images Using EfficientNetB0 and ResNet50 with Transfer Learning
Daniel Onah, Ravish Desai
https://arxiv.org/abs/2507.07011

Deep Brain Net: An Optimized Deep Learning Model for Brain tumor Detection in MRI Images Using EfficientNetB0 and ResNet50 with Transfer Learning
In recent years, deep learning has shown great promise in the automated detection and classification of brain tumors from MRI images. However, achieving high accuracy and computational efficiency remains a challenge. In this research, we propose Deep Brain Net, a novel deep learning system designed to optimize performance in the detection of brain tumors. The model integrates the strengths of two advanced neural network architectures which are EfficientNetB0 and ResNet50, combined with transfer…

MAGNet: A Multi-Scale Attention-Guided Graph Fusion Network for DRC Violation Detection
Weihan Lu, Hong Cai Chen
https://arxiv.org/abs/2506.07126 https://

MAGNet: A Multi-Scale Attention-Guided Graph Fusion Network for DRC Violation Detection
Design rule checking (DRC) is of great significance for cost reduction and design efficiency improvement in integrated circuit (IC) designs. Machine-learning-based DRC has become an important approach in computer-aided design (CAD). In this paper, we propose MAGNet, a hybrid deep learning model that integrates an improved U-Net with a graph neural network for DRC violation prediction. The U-Net backbone is enhanced with a Dynamic Attention Module (DAM) and a Multi-Scale Convolution Module (MSCM…

S-shaped Utility Maximization with VaR Constraint and Partial Information
Dongmei Zhu, Ashley Davey, Harry Zheng
https://arxiv.org/abs/2506.10103 https://

S-shaped Utility Maximization with VaR Constraint and Partial Information
We study S-shaped utility maximisation with VaR constraint and unobservable drift coefficient. Using the Bayesian filter, the concavification principle, and the change of measure, we give a semi-closed integral representation for the dual value function and find a critical wealth level that determines if the constrained problem admits a unique optimal solution and Lagrange multiplier or is infeasible. We also propose three algorithms (Lagrange, simulation, deep neural network) to solve the prob…

Exploring a Specialized Eccentricity-Based Deep Neural Network Model to Simulate Visual Attention
Manvi Jain
https://arxiv.org/abs/2507.05031 https://

Exploring a Specialized Eccentricity-Based Deep Neural Network Model to Simulate Visual Attention
While visual attention theories abound, neurodevelopmental research remains constrained by infants' unreliable responses and limited attention spans. Through collaboration with Project Prakash, we accessed a unique population: patients gaining vision later in life. This cohort enables investigation of visual process development in cognitively mature, cooperative participants rather than infants. We collected data from pre-operation patients, post-operation patients tracked longitudinally (1, 3,…

QMCTorch: Molecular Wavefunctions with Neural Components for Energy and Force Calculations
Nicolas Renaud
https://arxiv.org/abs/2506.09743 https://

QMCTorch: Molecular Wavefunctions with Neural Components for Energy and Force Calculations
In this paper, we present results obtained using QMCTorch, a modular framework for real-space Quantum Monte Carlo (QMC) simulations of small molecular systems. Built on the popular deep learning library PyTorch, QMCTorch is GPU-native and enables the integration of machine learning-inspired components into the wave function ansatz, such as neural network backflow transformations and Jastrow factors, while leveraging efficient optimization algorithms. QMCTorch interfaces with two widely used qua…

This https://arxiv.org/abs/2503.02041 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csCE_…

Interpolating Neural Network-Tensor Decomposition (INN-TD): a scalable and interpretable approach for large-scale physics-based problems
Deep learning has been extensively employed as a powerful function approximator for modeling physics-based problems described by partial differential equations (PDEs). Despite their popularity, standard deep learning models often demand prohibitively large computational resources and yield limited accuracy when scaling to large-scale, high-dimensional physical problems. Their black-box nature further hinders the application in industrial problems where interpretability and high precision are cr…

FACT: the Features At Convergence Theorem for neural networks
Enric Boix-Adsera, Neil Mallinar, James B. Simon, Mikhail Belkin
https://arxiv.org/abs/2507.05644

FACT: the Features At Convergence Theorem for neural networks
A central challenge in deep learning theory is to understand how neural networks learn and represent features. To this end, we prove the Features at Convergence Theorem (FACT), which gives a self-consistency equation that neural network weights satisfy at convergence when trained with nonzero weight decay. For each weight matrix $W$, this equation relates the "feature matrix" $W^\top W$ to the set of input vectors passed into the matrix during forward propagation and the loss gradients passed t…

TED-LaST: Towards Robust Backdoor Defense Against Adaptive Attacks
Xiaoxing Mo, Yuxuan Cheng, Nan Sun, Leo Yu Zhang, Wei Luo, Shang Gao
https://arxiv.org/abs/2506.10722

TED-LaST: Towards Robust Backdoor Defense Against Adaptive Attacks
Deep Neural Networks (DNNs) are vulnerable to backdoor attacks, where attackers implant hidden triggers during training to maliciously control model behavior. Topological Evolution Dynamics (TED) has recently emerged as a powerful tool for detecting backdoor attacks in DNNs. However, TED can be vulnerable to backdoor attacks that adaptively distort topological representation distributions across network layers. To address this limitation, we propose TED-LaST (Topological Evolution Dynamics agai…

The Neural Approximated Virtual Element Method for Elasticity Problems
Stefano Berrone, Moreno Pintore, Gioana Teora
https://arxiv.org/abs/2507.05786 https…

The Neural Approximated Virtual Element Method for Elasticity Problems
We present the Neural Approximated Virtual Element Method to numerically solve elasticity problems. This hybrid technique combines classical concepts from the Finite Element Method and the Virtual Element Method with recent advances in deep neural networks. Specifically, it is a polygonal method in which the virtual basis functions are element-wise approximated by a neural network, eliminating the need for stabilization or projection operators typical of the standard virtual element method. We …

Topology-Aware Graph Neural Network-based State Estimation for PMU-Unobservable Power Systems
Shiva Moshtagh, Behrouz Azimian, Mohammad Golgol, Anamitra Pal
https://arxiv.org/abs/2506.03493

Topology-Aware Graph Neural Network-based State Estimation for PMU-Unobservable Power Systems
Traditional optimization-based techniques for time-synchronized state estimation (SE) often suffer from high online computational burden, limited phasor measurement unit (PMU) coverage, and presence of non-Gaussian measurement noise. Although conventional learning-based models have been developed to overcome these challenges, they are negatively impacted by topology changes and real-time data loss. This paper proposes a novel deep geometric learning approach based on graph neural networks (GNNs…

Learning Intrinsic Alignments from Local Galaxy Environments
Matthew Craigie, Eric Huff, Yuan-Sen Ting, Rossana Ruggeri, Tamara M. Davis
https://arxiv.org/abs/2506.05155

Learning Intrinsic Alignments from Local Galaxy Environments
We present DELTA (Data-Empiric Learned Tidal Alignments), a deep learning model that isolates galaxy intrinsic alignments (IAs) from weak lensing distortions using only observational data. The model uses an Equivariant Graph Neural Network backbone suitable for capturing information from the local galaxy environment, in conjunction with a probabilistic orientation output. Unlike parametric models, DELTA flexibly learns the relationship between galaxy shapes and their local environments, without…

From large-eddy simulations to deep learning: A U-net model for fast urban canopy flow predictions
Themistoklis Vargiemezis, Catherine Gorl\'e
https://arxiv.org/abs/2507.06533

From large-eddy simulations to deep learning: A U-net model for fast urban canopy flow predictions
Accurate prediction of wind flow fields in urban canopies is crucial for ensuring pedestrian comfort, safety, and sustainable urban design. Traditional methods using wind tunnels and Computational Fluid Dynamics, such as Large-Eddy Simulations (LES), are limited by high costs, computational demands, and time requirements. This study presents a deep neural network (DNN) approach for fast and accurate predictions of urban wind flow fields, reducing computation time from an order of 10 hours on 32…

Baseband-Free End-to-End Communication System Based on Diffractive Deep Neural Network
Xiaokun Teng, Wankai Tang, Xiao Li, Shi Jin
https://arxiv.org/abs/2506.02411

Baseband-Free End-to-End Communication System Based on Diffractive Deep Neural Network
Diffractive deep neural network (D2NN), also referred to as reconfigurable intelligent metasurface based deep neural networks (Rb-DNNs) or stacked intelligent metasurfaces (SIMs) in the field of wireless communications, has emerged as a promising signal processing paradigm that enables computing-by-propagation. However, existing architectures are limited to implementing specific functions such as precoding and combining, while still relying on digital baseband modules for other essential tasks …

ExDiff: A Framework for Simulating Diffusion Processes on Complex Networks with Explainable AI Integration
Annamaria Defilippo, Ugo Lomoio, Barbara Puccio, Pierangelo Veltri, Pietro Hiram Guzzi
https://arxiv.org/abs/2506.04271

ExDiff: A Framework for Simulating Diffusion Processes on Complex Networks with Explainable AI Integration
Understanding and controlling diffusion processes in complex networks is critical across domains ranging from epidemiology to information science. Here, we present ExDiff, an interactive and modular computational framework that integrates network simulation, graph neural networks (GNNs), and explainable artificial intelligence (XAI) to model and interpret diffusion dynamics. ExDiff combines classical compartmental models with deep learning techniques to capture both the structural and temporal …

Template-Fitting Meets Deep Learning: Redshift Estimation Using Physics-Guided Neural Networks
Jonas Chris Ferrao, Dickson Dias, Pranav Naik, Glory D'Cruz, Anish Naik, Siya Khandeparkar, Manisha Gokuldas Fal Dessai
https://arxiv.org/abs/2507.00866

Template-Fitting Meets Deep Learning: Redshift Estimation Using Physics-Guided Neural Networks
Accurate photometric redshift estimation is critical for observational cosmology, especially in large-scale surveys where spectroscopic measurements are impractical. Traditional approaches include template fitting and machine learning, each with distinct strengths and limitations. We present a hybrid method that integrates template fitting with deep learning using physics-guided neural networks. By embedding spectral energy distribution templates into the network architecture, our model encodes…

Towards End-to-End Earthquake Monitoring Using a Multitask Deep Learning Model
Weiqiang Zhu, Junhao Song, Haoyu Wang, Jannes M\"unchmeyer
https://arxiv.org/abs/2506.06939

Towards End-to-End Earthquake Monitoring Using a Multitask Deep Learning Model
Seismic waveforms contain rich information about earthquake processes, making effective data analysis crucial for earthquake monitoring, source characterization, and seismic hazard assessment. With rapid developments in deep learning, the state-of-the-art approach in artificial intelligence, many neural network models have been developed to enhance earthquake monitoring tasks, such as earthquake detection, phase picking, and phase association. However, most current efforts focus on developing s…

Surrogate-Assisted Evolution for Efficient Multi-branch Connection Design in Deep Neural Networks
Fergal Stapleton, Daniel Garc\'ia N\'u\~nez, Yanan Sun, Edgar Galv\'an
https://arxiv.org/abs/2506.20469

Surrogate-Assisted Evolution for Efficient Multi-branch Connection Design in Deep Neural Networks
State-of-the-art Deep Neural Networks (DNNs) often incorporate multi-branch connections, enabling multi-scale feature extraction and enhancing the capture of diverse features. This design improves network capacity and generalisation to unseen data. However, training such DNNs can be computationally expensive. The challenge is further exacerbated by the complexity of identifying optimal network architectures. To address this, we leverage Evolutionary Algorithms (EAs) to automatically discover hi…

From Motion to Meaning: Biomechanics-Informed Neural Network for Explainable Cardiovascular Disease Identification
Comte Valentin, Gemma Piella, Mario Ceresa, Miguel A. Gonzalez Ballester
https://arxiv.org/abs/2507.05783

From Motion to Meaning: Biomechanics-Informed Neural Network for Explainable Cardiovascular Disease Identification
Cardiac diseases are among the leading causes of morbidity and mortality worldwide, which requires accurate and timely diagnostic strategies. In this study, we introduce an innovative approach that combines deep learning image registration with physics-informed regularization to predict the biomechanical properties of moving cardiac tissues and extract features for disease classification. We utilize the energy strain formulation of Neo-Hookean material to model cardiac tissue deformations, opti…

Dense Associative Memory in a Nonlinear Optical Hopfield Neural Network
Khalid Musa, Santosh Kumar, Michael Katidis, Yu-Ping Huang
https://arxiv.org/abs/2506.07849

Dense Associative Memory in a Nonlinear Optical Hopfield Neural Network
Modern Hopfield Neural Networks (HNNs), also known as Dense Associative Memories (DAMs), enhance the performance of simple recurrent neural networks by leveraging the nonlinearities in their energy functions. They have broad applications in combinatorial optimization, high-capacity memory storage, deep learning transformers, and correlated pattern recognition. Thus far, research on DAMs has been primarily theoretical, with implementations limited to CPUs and GPUs. In this work, for the first ti…

Understanding Stability Mechanisms in Single-Atom Alloys with Theory-infused Deep Learning
Yang Huang, Shih-Han Wang, Shuyi Cao, Luke E. K. Achenie, Hongliang Xin
https://arxiv.org/abs/2506.03031

Understanding Stability Mechanisms in Single-Atom Alloys with Theory-infused Deep Learning
We present an interpretable deep learning model that enhances the prediction of cohesive energy in transition metal alloys (TMAs) by incorporating cohesion theory into a graph neural network (GNN) framework. The model not only predicts the total cohesive energy-an indicator of crystal stability-but also disentangles its various contributing factors and underlying physical parameters. The physics insights extracted from the model clarify the stability trends of transition metal surfaces across t…

Beyond ReLU: How Activations Affect Neural Kernels and Random Wide Networks
David Holzm\"uller, Max Sch\"olpple
https://arxiv.org/abs/2506.22429 …

Beyond ReLU: How Activations Affect Neural Kernels and Random Wide Networks
While the theory of deep learning has made some progress in recent years, much of it is limited to the ReLU activation function. In particular, while the neural tangent kernel (NTK) and neural network Gaussian process kernel (NNGP) have given theoreticians tractable limiting cases of fully connected neural networks, their properties for most activation functions except for powers of the ReLU function are poorly understood. Our main contribution is to provide a more general characterization of t…

AI-Augmented Visible Light Communication: A Framework for Noise Mitigation and Secure Data Transmission
A. A. Nutfaji, Moustafa Hassan Elmallah
https://arxiv.org/abs/2507.08145

AI-Augmented Visible Light Communication: A Framework for Noise Mitigation and Secure Data Transmission
This paper presents a proposed AI Deep Learning model that addresses common challenges encountered in Visible Light Communication (VLC) systems. In this work, we run a Python simulation that models a basic VLC system primarily affected by Additive White Gaussian Noise (AWGN). A Deep Neural Network (DNN) is then trained to equalize the noisy signal received and improve signal integrity. The system evaluates and compares the Bit Error Rate (BER) before and after equalization to demonstrate the ef…

MobileIE: An Extremely Lightweight and Effective ConvNet for Real-Time Image Enhancement on Mobile Devices
Hailong Yan, Ao Li, Xiangtao Zhang, Zhe Liu, Zenglin Shi, Ce Zhu, Le Zhang
https://arxiv.org/abs/2507.01838

MobileIE: An Extremely Lightweight and Effective ConvNet for Real-Time Image Enhancement on Mobile Devices
Recent advancements in deep neural networks have driven significant progress in image enhancement (IE). However, deploying deep learning models on resource-constrained platforms, such as mobile devices, remains challenging due to high computation and memory demands. To address these challenges and facilitate real-time IE on mobile, we introduce an extremely lightweight Convolutional Neural Network (CNN) framework with around 4K parameters. Our approach integrates reparameterization with an Incr…

Fredholm Neural Networks for forward and inverse problems in elliptic PDEs
Kyriakos Georgiou, Constantinos Siettos, Athanasios N. Yannacopoulos
https://arxiv.org/abs/2507.06038

Fredholm Neural Networks for forward and inverse problems in elliptic PDEs
Building on our previous work introducing Fredholm Neural Networks (Fredholm NNs/ FNNs) for solving integral equations, we extend the framework to tackle forward and inverse problems for linear and semi-linear elliptic partial differential equations. The proposed scheme consists of a deep neural network (DNN) which is designed to represent the iterative process of fixed-point iterations for the solution of elliptic PDEs using the boundary integral method within the framework of potential theory…

This https://arxiv.org/abs/2503.11351 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_hepe…

Muon identification with Deep Neural Network in the Belle II K-Long and Muon detector
Muon identification is crucial for elementary particle physics experiments. At the Belle II experiment, muons and pions with momenta greater than 0.7 GeV/c are distinguished by their penetration ability through the $K_L$ and Muon (KLM) sub-detector, which is the outermost sub-detector of Belle II. In this paper, we first discuss the possible room for $μ/π$ identification performance improvement and then present a new method based on Deep Neural Network (DNN). This DNN model utilizes the KLM h…

This https://arxiv.org/abs/2505.15304 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csRO_…

Saliency-Aware Quantized Imitation Learning for Efficient Robotic Control
Deep neural network (DNN)-based policy models, such as vision-language-action (VLA) models, excel at automating complex decision-making from multi-modal inputs. However, scaling these models greatly increases computational overhead, complicating deployment in resource-constrained settings like robot manipulation and autonomous driving. To address this, we propose Saliency-Aware Quantized Imitation Learning (SQIL), which combines quantization-aware training with a selective loss-weighting strate…

Orthogonality-Constrained Deep Instrumental Variable Model for Causal Effect Estimation
Shunxin Yao
https://arxiv.org/abs/2506.02790 https://

Orthogonality-Constrained Deep Instrumental Variable Model for Causal Effect Estimation
OC-DeepIV is a neural network model designed for estimating causal effects. It characterizes heterogeneity by adding interaction features and reduces redundancy through orthogonal constraints. The model includes two feature extractors, one for the instrumental variable Z and the other for the covariate X*. The training process is divided into two stages: the first stage uses the mean squared error (MSE) loss function, and the second stage incorporates orthogonal regularization. Experimental res…

This https://arxiv.org/abs/2406.19580 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csAR_…

FRED: Flexible REduction-Distribution Interconnect and Communication Implementation for Wafer-Scale Distributed Training of DNN Models
Distributed Deep Neural Network (DNN) training is a technique to reduce the training overhead by distributing the training tasks into multiple accelerators, according to a parallelization strategy. However, high-performance compute and interconnects are needed for maximum speed-up and linear scaling of the system. Wafer-scale systems are a promising technology that allows for tightly integrating high-end accelerators with high-speed wafer-scale interconnects, making it an attractive platform fo…

Estimating Head Motion in Structural MRI Using a Deep Neural Network Trained on Synthetic Artifacts
Charles Bricout, Samira Ebrahimi Kahou, Sylvain Bouix
https://arxiv.org/abs/2505.23916

Estimating Head Motion in Structural MRI Using a Deep Neural Network Trained on Synthetic Artifacts
Motion-related artifacts are inevitable in Magnetic Resonance Imaging (MRI) and can bias automated neuroanatomical metrics such as cortical thickness. Manual review cannot objectively quantify motion in anatomical scans, and existing automated approaches often require specialized hardware or rely on unbalanced noisy training data. Here, we train a 3D convolutional neural network to estimate motion severity using only synthetically corrupted volumes. We validate our method with one held-out site…

Learning Interpretable Rules from Neural Networks: Neurosymbolic AI for Radar Hand Gesture Recognition
Sarah Seifi, Tobias Sukianto, Cecilia Carbonelli, Lorenzo Servadei, Robert Wille
https://arxiv.org/abs/2506.22443

Learning Interpretable Rules from Neural Networks: Neurosymbolic AI for Radar Hand Gesture Recognition
Rule-based models offer interpretability but struggle with complex data, while deep neural networks excel in performance yet lack transparency. This work investigates a neuro-symbolic rule learning neural network named RL-Net that learns interpretable rule lists through neural optimization, applied for the first time to radar-based hand gesture recognition (HGR). We benchmark RL-Net against a fully transparent rule-based system (MIRA) and an explainable black-box model (XentricAI), evaluating a…

Aperiodic-sampled neural network controllers with closed-loop stability verifications (extended version)
Renjie Ma, Zhijian Hu, Rongni Yang, Ligang Wu
https://arxiv.org/abs/2506.18386

Aperiodic-sampled neural network controllers with closed-loop stability verifications (extended version)
In this paper, we synthesize two aperiodic-sampled deep neural network (DNN) control schemes, based on the closed-loop tracking stability guarantees. By means of the integral quadratic constraint coping with the input-output behaviour of system uncertainties/nonlinearities and the convex relaxations of nonlinear DNN activations leveraging their local sector-bounded attributes, we establish conditions to design the event- and self-triggered logics and to compute the ellipsoidal inner approximati…

Multi-Utterance Speech Separation and Association Trained on Short Segments
Yuzhu Wang, Archontis Politis, Konstantinos Drossos, Tuomas Virtanen
https://arxiv.org/abs/2507.02562

Multi-Utterance Speech Separation and Association Trained on Short Segments
Current deep neural network (DNN) based speech separation faces a fundamental challenge -- while the models need to be trained on short segments due to computational constraints, real-world applications typically require processing significantly longer recordings with multiple utterances per speaker than seen during training. In this paper, we investigate how existing approaches perform in this challenging scenario and propose a frequency-temporal recurrent neural network (FTRNN) that effective…

Identifying Alzheimer's Disease Prediction Strategies of Convolutional Neural Network Classifiers using R2* Maps and Spectral Clustering
Christian Tinauer, Maximilian Sackl, Stefan Ropele, Christian Langkammer
https://arxiv.org/abs/2506.03890

Identifying Alzheimer's Disease Prediction Strategies of Convolutional Neural Network Classifiers using R2* Maps and Spectral Clustering
Deep learning models have shown strong performance in classifying Alzheimer's disease (AD) from R2* maps, but their decision-making remains opaque, raising concerns about interpretability. Previous studies suggest biases in model decisions, necessitating further analysis. This study uses Layer-wise Relevance Propagation (LRP) and spectral clustering to explore classifier decision strategies across preprocessing and training configurations using R2* maps. We trained a 3D convolutional neural net…

A Novel Active Learning Approach to Label One Million Unknown Malware Variants
Ahmed Bensaoud, Jugal Kalita
https://arxiv.org/abs/2507.02959 https://

A Novel Active Learning Approach to Label One Million Unknown Malware Variants
Active learning for classification seeks to reduce the cost of labeling samples by finding unlabeled examples about which the current model is least certain and sending them to an annotator/expert to label. Bayesian theory can provide a probabilistic view of deep neural network models by asserting a prior distribution over model parameters and estimating the uncertainties by posterior distribution over these parameters. This paper proposes two novel active learning approaches to label one milli…

Near-optimal estimates for the $\ell^p$-Lipschitz constants of deep random ReLU neural networks
Sjoerd Dirksen, Patrick Finke, Paul Geuchen, Dominik St\"oger, Felix Voigtlaender
https://arxiv.org/abs/2506.19695

Near-optimal estimates for the $\ell^p$-Lipschitz constants of deep random ReLU neural networks
This paper studies the $\ell^p$-Lipschitz constants of ReLU neural networks $Φ: \mathbb{R}^d \to \mathbb{R}$ with random parameters for $p \in [1,\infty]$. The distribution of the weights follows a variant of the He initialization and the biases are drawn from symmetric distributions. We derive high probability upper and lower bounds for wide networks that differ at most by a factor that is logarithmic in the network's width and linear in its depth. In the special case of shallow networks, we …

Tunable Wavelet Unit based Convolutional Neural Network in Optical Coherence Tomography Analysis Enhancement for Classifying Type of Epiretinal Membrane Surgery
An Le, Nehal Mehta, William Freeman, Ines Nagel, Melanie Tran, Anna Heinke, Akshay Agnihotri, Lingyun Cheng, Dirk-Uwe Bartsch, Hung Nguyen, Truong Nguyen, Cheolhong An
https://

Tunable Wavelet Unit based Convolutional Neural Network in Optical Coherence Tomography Analysis Enhancement for Classifying Type of Epiretinal Membrane Surgery
In this study, we developed deep learning-based method to classify the type of surgery performed for epiretinal membrane (ERM) removal, either internal limiting membrane (ILM) removal or ERM-alone removal. Our model, based on the ResNet18 convolutional neural network (CNN) architecture, utilizes postoperative optical coherence tomography (OCT) center scans as inputs. We evaluated the model using both original scans and scans preprocessed with energy crop and wavelet denoising, achieving 72% acc…

Embedded FPGA Acceleration of Brain-Like Neural Networks: Online Learning to Scalable Inference
Muhammad Ihsan Al Hafiz, Naresh Ravichandran, Anders Lansner, Pawel Herman, Artur Podobas
https://arxiv.org/abs/2506.18530

Embedded FPGA Acceleration of Brain-Like Neural Networks: Online Learning to Scalable Inference
Edge AI applications increasingly require models that can learn and adapt on-device with minimal energy budget. Traditional deep learning models, while powerful, are often overparameterized, energy-hungry, and dependent on cloud connectivity. Brain-Like Neural Networks (BLNNs), such as the Bayesian Confidence Propagation Neural Network (BCPNN), propose a neuromorphic alternative by mimicking cortical architecture and biologically-constrained learning. They offer sparse architectures with local …

Analyzing partially-polarized light with a photonic deep random neural network
Alessandro Petrini, Claudio Conti, Davide Pierangeli
https://arxiv.org/abs/2506.17952

Analyzing partially-polarized light with a photonic deep random neural network
Optical neural networks are emerging as a powerful and versatile tool for processing optical signals directly in the optical domain with superior speed, integrability, and functionality. Their application to optical polarization enables neuromorphic polarization sensors, but their operation is limited to fully-polarized light. Here, we demonstrate single-shot analysis of partially-polarized beams with a photonic random neural network (PRNN). The PRNN is composed of a series of optical layers im…

A Tree-guided CNN for image super-resolution
Chunwei Tian, Mingjian Song, Xiaopeng Fan, Xiangtao Zheng, Bob Zhang, David Zhang
https://arxiv.org/abs/2506.02585

A Tree-guided CNN for image super-resolution
Deep convolutional neural networks can extract more accurate structural information via deep architectures to obtain good performance in image super-resolution. However, it is not easy to find effect of important layers in a single network architecture to decrease performance of super-resolution. In this paper, we design a tree-guided CNN for image super-resolution (TSRNet). It uses a tree architecture to guide a deep network to enhance effect of key nodes to amplify the relation of hierarchica…

This https://arxiv.org/abs/2505.04977 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csCR_…

ChainMarks: Securing DNN Watermark with Cryptographic Chain
With the widespread deployment of deep neural network (DNN) models, dynamic watermarking techniques are being used to protect the intellectual property of model owners. However, recent studies have shown that existing watermarking schemes are vulnerable to watermark removal and ambiguity attacks. Besides, the vague criteria for determining watermark presence further increase the likelihood of such attacks. In this paper, we propose a secure DNN watermarking scheme named ChainMarks, which genera…

Classification based deep learning models for lung cancer and disease using medical images
Ahmad Chaddad, Jihao Peng, Yihang Wu
https://arxiv.org/abs/2507.01279

Classification based deep learning models for lung cancer and disease using medical images
The use of deep learning (DL) in medical image analysis has significantly improved the ability to predict lung cancer. In this study, we introduce a novel deep convolutional neural network (CNN) model, named ResNet+, which is based on the established ResNet framework. This model is specifically designed to improve the prediction of lung cancer and diseases using the images. To address the challenge of missing feature information that occurs during the downsampling process in CNNs, we integrate …

Computation-resource-efficient Task-oriented Communications
Jingwen Fu, Ming Xiao, Chao Ren, Mikael Skoglund
https://arxiv.org/abs/2507.07422 https://

Computation-resource-efficient Task-oriented Communications
The rapid development of deep-learning enabled task-oriented communications (TOC) significantly shifts the paradigm of wireless communications. However, the high computation demands, particularly in resource-constrained systems e.g., mobile phones and UAVs, make TOC challenging for many tasks. To address the problem, we propose a novel TOC method with two models: a static and a dynamic model. In the static model, we apply a neural network (NN) as a task-oriented encoder (TOE) when there is no c…

This https://arxiv.org/abs/2410.00059 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csCR_…

IDEA: An Inverse Domain Expert Adaptation Based Active DNN IP Protection Method
Illegitimate reproduction, distribution and derivation of Deep Neural Network (DNN) models can inflict economic loss, reputation damage and even privacy infringement. Passive DNN intellectual property (IP) protection methods such as watermarking and fingerprinting attempt to prove the ownership upon IP violation, but they are often too late to stop catastrophic damage of IP abuse and too feeble against strong adversaries. In this paper, we propose IDEA, an Inverse Domain Expert Adaptation based…

A Deep Convolutional Neural Network-Based Novel Class Balancing for Imbalance Data Segmentation
Atifa Kalsoom, M. A. Iftikhar, Amjad Ali, Zubair Shah, Shidin Balakrishnan, Hazrat Ali
https://arxiv.org/abs/2506.18474

A Deep Convolutional Neural Network-Based Novel Class Balancing for Imbalance Data Segmentation
Retinal fundus images provide valuable insights into the human eye's interior structure and crucial features, such as blood vessels, optic disk, macula, and fovea. However, accurate segmentation of retinal blood vessels can be challenging due to imbalanced data distribution and varying vessel thickness. In this paper, we propose BLCB-CNN, a novel pipeline based on deep learning and bi-level class balancing scheme to achieve vessel segmentation in retinal fundus images. The BLCB-CNN scheme uses …

Automated anatomy-based post-processing reduces false positives and improved interpretability of deep learning intracranial aneurysm detection
Jisoo Kim, Chu-Hsuan Lin, Alberto Ceballos-Arroyo, Ping Liu, Huaizu Jiang, Shrikanth Yadav, Qi Wan, Lei Qin, Geoffrey S Young
https://arxiv.org/abs/2507.00832

Automated anatomy-based post-processing reduces false positives and improved interpretability of deep learning intracranial aneurysm detection
Introduction: Deep learning (DL) models can help detect intracranial aneurysms on CTA, but high false positive (FP) rates remain a barrier to clinical translation, despite improvement in model architectures and strategies like detection threshold tuning. We employed an automated, anatomy-based, heuristic-learning hybrid artery-vein segmentation post-processing method to further reduce FPs. Methods: Two DL models, CPM-Net and a deformable 3D convolutional neural network-transformer hybrid (3D-CN…

ReCoGNet: Recurrent Context-Guided Network for 3D MRI Prostate Segmentation
Ahmad Mustafa, Reza Rastegar, Ghassan AlRegib
https://arxiv.org/abs/2506.19687 …

ReCoGNet: Recurrent Context-Guided Network for 3D MRI Prostate Segmentation
Prostate gland segmentation from T2-weighted MRI is a critical yet challenging task in clinical prostate cancer assessment. While deep learning-based methods have significantly advanced automated segmentation, most conventional approaches-particularly 2D convolutional neural networks (CNNs)-fail to leverage inter-slice anatomical continuity, limiting their accuracy and robustness. Fully 3D models offer improved spatial coherence but require large amounts of annotated data, which is often imprac…