Tootfinder

Warum Augmented Reality auf der Stelle tritt
Was hält Augmented Reality zurück? Der AR-Pionier Kharis O'Connell hat der Technologie den Rücken gekehrt und spricht offen über seine Desillusion.
https://www…

Implementation and Assessment of an Augmented Training Curriculum for Surgical Robotics
Alberto Rota, Ke Fan, Elena De Momi
https://arxiv.org/abs/2507.07718

Implementation and Assessment of an Augmented Training Curriculum for Surgical Robotics
The integration of high-level assistance algorithms in surgical robotics training curricula may be beneficial in establishing a more comprehensive and robust skillset for aspiring surgeons, improving their clinical performance as a consequence. This work presents the development and validation of a haptic-enhanced Virtual Reality simulator for surgical robotics training, featuring 8 surgical tasks that the trainee can interact with thanks to the embedded physics engine. This virtual simulated e…

Breaking the Plane: Exploring Real-Time Visualization of 3D Surfaces in Augmented Reality with Handwritten Input
Liam Franco Esparraguera, Kristoffer Selberg, Brian Lou, Jenny Sun, Beza Desta, Andr\'es Monroy-Hern\'andez, Parastoo Abtahi
https://arxiv.org/abs/2507.05616

Breaking the Plane: Exploring Real-Time Visualization of 3D Surfaces in Augmented Reality with Handwritten Input
We introduce Breaking the Plane, an augmented reality (AR) application built for AR headsets that enables users to visualize 3D mathematical functions using handwritten input. Researchers have demonstrated overlaying 3D visualizations of mathematical concepts through AR enhances learning motivation and comprehension, and equation parsing makes the authoring of teaching materials more time-efficient for instructors. Previous works have developed AR systems that separately employ equation parsing…

Apple zur Vision Pro: Weiter "Volle Konzentration" auf Augmented Reality
Nach wie vor kostet Apples erstes Headset mindestens 4000 Euro. Offenbar werkelt der Konzern nur noch an der Software.

You can find The vOICe for Android on Google Play by searching for "seeingwithsound" or "sensory substitution" (including the double quotes!), or head directly to https://play.google.com/store/apps/details?id=vOICe.vOICe "sensory substitution" for…

The vOICe for Android - Apps on Google Play
Augmented Reality for the Blind: See with your Ears!

Light Pipe Holographic Display: Bandwidth-preserved Kaleidoscopic Guiding for AR Glasses
Minseok Chae, Chun Chen, Seung-Woo Nam, Yoonchan Jeong
https://arxiv.org/abs/2507.04374

Light Pipe Holographic Display: Bandwidth-preserved Kaleidoscopic Guiding for AR Glasses
In this paper, we present a holographic display using a light pipe for augmented reality, and the hologram rendering method via bandwidth-preserved kaleidoscopic guiding method. Conventional augmented reality displays typically share optical architectures where the light engine and image combiner are adjacent. Minimizing the size of both components is highly challenging, and most commercial and research prototypes of augmented reality displays are bulky, front-heavy and sight-obstructing. Here,…

PrivAR: Real-Time Privacy Protection for Location-Based Augmented Reality Applications
Shafizur Rahman Seeam, Ye Zheng, Zhengxiong Li, Yidan Hu
https://arxiv.org/abs/2508.02551 …

PrivAR: Real-Time Privacy Protection for Location-Based Augmented Reality Applications
Location-based augmented reality (LB-AR) applications, such as Pokémon Go, stream sub-second GPS updates to deliver responsive and immersive user experiences. However, this high-frequency location reporting introduces serious privacy risks. Protecting privacy in LB-AR is significantly more challenging than in traditional location-based services (LBS), as it demands real-time location protection with strong per-location and trajectory-level privacy guaranteed while maintaining low latency and h…

A Reference Architecture for Gamified Cultural Heritage Applications Leveraging Generative AI and Augmented Reality
Federico Martusciello, Henry Muccini, Antonio Bucchiarone
https://arxiv.org/abs/2506.04090

A Reference Architecture for Gamified Cultural Heritage Applications Leveraging Generative AI and Augmented Reality
The rapid advancement of Information and Communication Technologies is transforming Cultural Heritage access, experience, and preservation. However, many digital heritage applications lack interactivity, personalization, and adaptability, limiting user engagement and educational impact. This short paper presents a reference architecture for gamified cultural heritage applications leveraging generative AI and augmented reality. Gamification enhances motivation, artificial intelligence enables ad…

VR- und KI-Brillen sind nur Brücken: Der heimliche Star heißt Augmented Reality
Während VR lange Zeit lautstark um Aufmerksamkeit buhlte, schleicht sich AR in unser Leben, um zu bleiben – auf dem Rücken von Mixed Reality und Smart Glasses.

Teaching Sustainable Creative Technologies
Chelsea Thompto
https://arxiv.org/abs/2507.05320 https://arxiv.org/pdf/2507.05320

Teaching Sustainable Creative Technologies
Artists and especially new media artists contribute to public perceptions and adoption of new technologies through their own use of emerging media technologies such as augmented and virtual reality, generative image systems, and high-resolution displays in the production of their work. In this way, art and media production can be understood as part of the larger issue of unsustainable computational consumption. As such, it is critical for artists to develop, share, and promote new and more sust…

SVD: Spatial Video Dataset
M. H. Izadimehr, Milad Ghanbari, Guodong Chen, Wei Zhou, Xiaoshuai Hao, Mallesham Dasari, Christian Timmerer, Hadi Amirpour
https://arxiv.org/abs/2506.06037

SVD: Spatial Video Dataset
Stereoscopic video has long been the subject of research due to its capacity to deliver immersive three-dimensional content across a wide range of applications, from virtual and augmented reality to advanced human-computer interaction. The dual-view format inherently provides binocular disparity cues that enhance depth perception and realism, making it indispensable for fields such as telepresence, 3D mapping, and robotic vision. Until recently, however, end-to-end pipelines for capturing, enco…

EgoPrompt: Prompt Pool Learning for Egocentric Action Recognition
Huaihai Lyu, Chaofan Chen, Yuheng Ji, Changsheng Xu
https://arxiv.org/abs/2508.03266 https://

EgoPrompt: Prompt Pool Learning for Egocentric Action Recognition
Driven by the increasing demand for applications in augmented and virtual reality, egocentric action recognition has emerged as a prominent research area. It is typically divided into two subtasks: recognizing the performed behavior (i.e., verb component) and identifying the objects being acted upon (i.e., noun component) from the first-person perspective. However, most existing approaches treat these two components as independent classification tasks, focusing on extracting component-specific …

A Project Moohan benchmark gets spotted, and may have revealed the Android XR headset's key spec https://www.techradar.com/computing/virtual-reality-augmented-reality…

Assessing Workers Neuro-physiological Stress Responses to Augmented Reality Safety Warnings in Immersive Virtual Roadway Work Zones
Fatemeh Banani Ardecani, Omidreza Shoghli
https://arxiv.org/abs/2506.03113

Assessing Workers Neuro-physiological Stress Responses to Augmented Reality Safety Warnings in Immersive Virtual Roadway Work Zones
This paper presents a multi-stage experimental framework that integrates immersive Virtual Reality (VR) simulations, wearable sensors, and advanced signal processing to investigate construction workers neuro-physiological stress responses to multi-sensory AR-enabled warnings. Participants performed light- and moderate-intensity roadway maintenance tasks within a high-fidelity VR roadway work zone, while key stress markers of electrodermal activity (EDA), heart rate variability (HRV), and electr…

(image) Map of users of The vOICe for Android all over the world in the past 30 minutes https://play.google.com/store/apps/details?id=vOICe.vOICe

The vOICe for Android - Apps on Google Play
Augmented Reality for the Blind: See with your Ears!

SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splatting
Shengjie Lin, Jiading Fang, Muhammad Zubair Irshad, Vitor Campagnolo Guizilini, Rares Andrei Ambrus, Greg Shakhnarovich, Matthew R. Walter
https://arxiv.org/abs/2506.03594

SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splatting
Reconstructing articulated objects prevalent in daily environments is crucial for applications in augmented/virtual reality and robotics. However, existing methods face scalability limitations (requiring 3D supervision or costly annotations), robustness issues (being susceptible to local optima), and rendering shortcomings (lacking speed or photorealism). We introduce SplArt, a self-supervised, category-agnostic framework that leverages 3D Gaussian Splatting (3DGS) to reconstruct articulated ob…

🪩 HUSH: Holistic panoramic 3D scene understanding using spherical harmonics
#ai

HUSH: Holistic panoramic 3D scene understanding using spherical harmonics
An advanced artificial intelligence (AI) technology has been developed that can extract three-dimensional (3D) spatial structure and object information within indoor environments using just a single 360-degree panoramic photograph. This breakthrough is expected to significantly impact fields requiring precise spatial understanding, including augmented reality (AR), mixed reality (MR), and digital twin applications.

LightCom: A Generative AI-Augmented Framework for QoE-Oriented Communications
Chunmei Xu, Siqi Zhang, Yi Ma, Rahim Tafazolli
https://arxiv.org/abs/2507.17352 https://

LightCom: A Generative AI-Augmented Framework for QoE-Oriented Communications
Data-intensive and immersive applications, such as virtual reality, impose stringent quality of experience (QoE) requirements that challenge traditional quality of service (QoS)-driven communication systems. This paper presents LightCom, a lightweight encoding and generative AI (GenAI)-augmented decoding framework, designed for QoE-oriented communications under low signal-to-noise ratio (SNR) conditions. LightCom simplifies transmitter design by applying basic low-pass filtering for source codi…

Focus on the Experts: Co-designing an Augmented Reality Eye-Gaze Tracking System with Surgical Trainees to Improve Endoscopic Instruction
Jumanh Atoum, Jinkyung Park, Mamtaj Akter, Nicholas Kavoussi, Pamela Wisniewski, Jie Ying Wu
https://arxiv.org/abs/2506.21896

Focus on the Experts: Co-designing an Augmented Reality Eye-Gaze Tracking System with Surgical Trainees to Improve Endoscopic Instruction
The current apprenticeship model for surgical training requires a high level of supervision, which does not scale well to meet the growing need for more surgeons. Many endoscopic procedures are directly taught in the operating room (OR) while the attending surgeon and trainee operate on patients. The need to prioritize patient care limits the trainees' opportunities to experiment and receive feedback on their performance. Augmented reality (AR) has the potential to increase efficiency in endosc…

Network Digital Twin for 6G and Beyond: An End-to-End View Across Multi-Domain Network Ecosystems
Dinh-Hieu Tran, Nazar Waheed, Yuris Mulya Saputra, Xingqin Lin, Cong T. Nguyen, Tedros Salih Abdu, Van Nhan Vo, Van-Quan Pham, Madyan Alsenwi, Abuzar Babikir Mohammad Adam, Symeon Chatzinotas, Eva Lagaunas, Hung Tran, Tu Ho Dac, Nguyen Van Huynh
https://…

Network Digital Twin for 6G and Beyond: An End-to-End View Across Multi-Domain Network Ecosystems
With the rapid development of technology, the number of smart mobile users is increasing, accompanied by growing demands from applications such as virtual/augmented reality (VR/XR), remote surgery, autonomous vehicles, and real-time holographic communications, all of which require high transmission rates and ultra-low latency in 6G and beyond networks (6G+). This poses enormous challenges in efficiently deploying large-scale networks, including network design, planning, troubleshooting, optimiz…

HyperGaussians: High-Dimensional Gaussian Splatting for High-Fidelity Animatable Face Avatars
Gent Serifi, Marcel C. B\"uhler
https://arxiv.org/abs/2507.02803

HyperGaussians: High-Dimensional Gaussian Splatting for High-Fidelity Animatable Face Avatars
We introduce HyperGaussians, a novel extension of 3D Gaussian Splatting for high-quality animatable face avatars. Creating such detailed face avatars from videos is a challenging problem and has numerous applications in augmented and virtual reality. While tremendous successes have been achieved for static faces, animatable avatars from monocular videos still fall in the uncanny valley. The de facto standard, 3D Gaussian Splatting (3DGS), represents a face through a collection of 3D Gaussian pr…

UnMix-NeRF: Spectral Unmixing Meets Neural Radiance Fields
Fabian Perez, Sara Rojas, Carlos Hinojosa, Hoover Rueda-Chac\'on, Bernard Ghanem
https://arxiv.org/abs/2506.21884

UnMix-NeRF: Spectral Unmixing Meets Neural Radiance Fields
Neural Radiance Field (NeRF)-based segmentation methods focus on object semantics and rely solely on RGB data, lacking intrinsic material properties. This limitation restricts accurate material perception, which is crucial for robotics, augmented reality, simulation, and other applications. We introduce UnMix-NeRF, a framework that integrates spectral unmixing into NeRF, enabling joint hyperspectral novel view synthesis and unsupervised material segmentation. Our method models spectral reflecta…

Magic Leap: Wie der Traum von der Wunder-AR-Brille platzte
Zwischen Vision, Hype und Restrukturierung: Wie ein Augmented-Reality-Start-up mit Milliardenkapital beinahe kollabierte und heute neue Wege geht.
…

Identification of Design Recommendations for Augmented Reality Authors in Corporate Training
Stefan Graser, Martin Schrepp, Stephan B\"ohm
https://arxiv.org/abs/2507.21722 …

Identification of Design Recommendations for Augmented Reality Authors in Corporate Training
Innovative technologies, such as Augmented Reality (AR), introduce new interaction paradigms, demanding the identification of software requirements during the software development process. In general, design recommendations are related to this, supporting the design of applications positively and meeting stakeholder needs. However, current research lacks context-specific AR design recommendations. This study addresses this gap by identifying and analyzing practical AR design recommendations rel…

Robust and Resilient Networks with Integrated Sensing, Communication and Computation
Ming-Chun Lee, Christian Eckrich, Vahid Jamali, Yu-Chih Huang, Arash Asadi, Li-Chun Wang
https://arxiv.org/abs/2506.19518

Robust and Resilient Networks with Integrated Sensing, Communication and Computation
Emerging applications such as networked robotics, intelligent transportation, smart factories, and virtual and augmented reality demand integrated perception and connectivity enabled by wireless communication. This has driven growing interests in integrated sensing, communication, and computation (ISCC) systems, with a primary focus on their efficient co-designs. However, as ISCC systems increasingly support critical applications, they must not only deliver high performance but also demonstrate…

Sonify Anything: Towards Context-Aware Sonic Interactions in AR
Laura Sch\"utz, Sasan Matinfar, Ulrich Eck, Daniel Roth, Nassir Navab
https://arxiv.org/abs/2508.01789 https…

Sonify Anything: Towards Context-Aware Sonic Interactions in AR
In Augmented Reality (AR), virtual objects interact with real objects. However, the lack of physicality of virtual objects leads to the absence of natural sonic interactions. When virtual and real objects collide, either no sound or a generic sound is played. Both lead to an incongruent multisensory experience, reducing interaction and object realism. Unlike in Virtual Reality (VR) and games, where predefined scenes and interactions allow for the playback of pre-recorded sound samples, AR requi…

Do Music Source Separation Models Preserve Spatial Information in Binaural Audio?
Richa Namballa, Agnieszka Roginska, Magdalena Fuentes
https://arxiv.org/abs/2507.00155

Do Music Source Separation Models Preserve Spatial Information in Binaural Audio?
Binaural audio remains underexplored within the music information retrieval community. Motivated by the rising popularity of virtual and augmented reality experiences as well as potential applications to accessibility, we investigate how well existing music source separation (MSS) models perform on binaural audio. Although these models process two-channel inputs, it is unclear how effectively they retain spatial information. In this work, we evaluate how several popular MSS models preserve spat…

GHAR: GeoPose-based Handheld Augmented Reality for Architectural Positioning, Manipulation and Visual Exploration
Sabahat Israr, Dawar Khan, Zhanglin Cheng, Mukhtaj Khan, Kiyoshi Kiyokawa
https://arxiv.org/abs/2506.14414

GHAR: GeoPose-based Handheld Augmented Reality for Architectural Positioning, Manipulation and Visual Exploration
Handheld Augmented Reality (HAR) is revolutionizing the civil infrastructure application domain. The current trend in HAR relies on marker tracking technology. However, marker-based systems have several limitations, such as difficulty in use and installation, sensitivity to light, and marker design. In this paper, we propose a markerless HAR framework with GeoPose-based tracking. We use different gestures for manipulation and achieve 7 DOF (3 DOF each for translation and rotation, and 1 DOF for…

User Understanding of Privacy Permissions in Mobile Augmented Reality: Perceptions and Misconceptions
Viktorija Paneva, Verena Winterhalter, Franziska Augustinowski, Florian Alt
https://arxiv.org/abs/2506.20207

User Understanding of Privacy Permissions in Mobile Augmented Reality: Perceptions and Misconceptions
Mobile Augmented Reality (AR) applications leverage various sensors to provide immersive user experiences. However, their reliance on diverse data sources introduces significant privacy challenges. This paper investigates user perceptions and understanding of privacy permissions in mobile AR apps through an analysis of existing applications and an online survey of 120 participants. Findings reveal common misconceptions, including confusion about how permissions relate to specific AR functionali…

Uniting the World by Dividing it: Federated Maps to Enable Spatial Applications
Sagar Bharadwaj, Srinivasan Seshan, Anthony Rowe
https://arxiv.org/abs/2507.11437

Uniting the World by Dividing it: Federated Maps to Enable Spatial Applications
The emergence of the Spatial Web -- the Web where content is tied to real-world locations has the potential to improve and enable many applications such as augmented reality, navigation, robotics, and more. The Spatial Web is missing a key ingredient that is impeding its growth -- a spatial naming system to resolve real-world locations to names. Today's spatial naming systems are digital maps such as Google and Apple maps. These maps and the location-based services provided on top of these maps…

Room Impulse Response Generation Conditioned on Acoustic Parameters
Silvia Arellano, Chunghsin Yeh, Gautam Bhattacharya, Daniel Arteaga
https://arxiv.org/abs/2507.12136

Room Impulse Response Generation Conditioned on Acoustic Parameters
The generation of room impulse responses (RIRs) using deep neural networks has attracted growing research interest due to its applications in virtual and augmented reality, audio postproduction, and related fields. Most existing approaches condition generative models on physical descriptions of a room, such as its size, shape, and surface materials. However, this reliance on geometric information limits their usability in scenarios where the room layout is unknown or when perceptual realism (ho…

Context-Aware Semantic Communication for the Wireless Networks
Guangyuan Liu, Yinqiu Liu, Jiacheng Wang, Hongyang Du, Dusit Niyato, Jiawen Kang, Zehui Xiong, Abbas Jamalipour
https://arxiv.org/abs/2505.23249

Context-Aware Semantic Communication for the Wireless Networks
In next-generation wireless networks, supporting real-time applications such as augmented reality, autonomous driving, and immersive Metaverse services demands stringent constraints on bandwidth, latency, and reliability. Existing semantic communication (SemCom) approaches typically rely on static models, overlooking dynamic conditions and contextual cues vital for efficient transmission. To address these challenges, we propose CaSemCom, a context-aware SemCom framework that leverages a Large L…

Eyepiece-free pupil-optimized holographic near-eye displays
Jie Zhou, Shuyang Xie, Yang Wu, Lei Jiang, Yimou Luo, Jun Wang
https://arxiv.org/abs/2507.22420 https://

Eyepiece-free pupil-optimized holographic near-eye displays
Computer-generated holography (CGH) represents a transformative visualization approach for next-generation immersive virtual and augmented reality (VR/AR) displays, enabling precise wavefront modulation and naturally providing comprehensive physiological depth cues without the need for bulky optical assemblies. Despite significant advancements in computational algorithms enhancing image quality and achieving real-time generation, practical implementations of holographic near-eye displays (NEDs)…

ChatAR: Conversation Support using Large Language Model and Augmented Reality
Yuichiro Fujimoto
https://arxiv.org/abs/2506.16008 https://

ChatAR: Conversation Support using Large Language Model and Augmented Reality
Engaging in smooth conversations with others is a crucial social skill. However, differences in knowledge between conversation participants can sometimes hinder effective communication. To tackle this issue, this study proposes a real-time support system that integrates head-mounted display (HMD)-based augmented reality (AR) technology with large language models (LLMs). This system facilitates conversation by recognizing keywords during dialogue, generating relevant information using the LLM, r…

Replaced article(s) found for cs.CV. https://arxiv.org/list/cs.CV/new
[2/4]:
- TaoAvatar: Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Spl...
Jianchuan Chen, Jingchuan Hu, Gaige Wang, Zhonghua Jiang, Tiansong Zhou, Zhiwen Chen, Chengfei Lv

A Design Space for Visualization Transitions of 3D Spatial Data in Hybrid AR-Desktop Environments
Yucheng Lu, Tobias Rau, Benjamin Lee, Andreas K\"ohn, Michael Sedlmair, Christian Sandor, Tobias Isenberg
https://arxiv.org/abs/2506.22250

A Design Space for Visualization Transitions of 3D Spatial Data in Hybrid AR-Desktop Environments
We present a design space for animated transitions of the appearance of 3D spatial datasets in a hybrid Augmented Reality (AR)-desktop context. Such hybrid interfaces combine both traditional and immersive displays to facilitate the exploration of 2D and 3D data representations in the environment in which they are best displayed. One key aspect is to introduce transitional animations that change between the different dimensionalities to illustrate the connection between the different representa…

Advancing Digital Accessibility: Integrating AR/VR and Health Tech for Inclusive Healthcare Solutions
Vishnu Ramineni, Shivareddy Devarapalli, Balakrishna Pothineni, Prema Kumar Veerapaneni, Aditya Gupta, Pankaj Gupta
https://arxiv.org/abs/2505.24039

Advancing Digital Accessibility: Integrating AR/VR and Health Tech for Inclusive Healthcare Solutions
Modern healthcare domain incorporates a feature of digital accessibility to ensure seamless flow of online services for the patients. However, this feature of digital accessibility poses a challenge particularly for patients with disabilities. To eradicate this issue and provide immersive and user-friendly experiences, evolving technologies like Augmented Reality (AR) and Virtual Reality (VR) are integrated in medical applications to enhance accessibility. The present research paper aims to stu…

Binaural Speech Enhancement Using Complex Convolutional Recurrent Networks
Vikas Tokala, Eric Grinstein, Mike Brookes, Simon Doclo, Jesper Jensen, Patrick A. Naylor
https://arxiv.org/abs/2507.20023

Binaural Speech Enhancement Using Complex Convolutional Recurrent Networks
From hearing aids to augmented and virtual reality devices, binaural speech enhancement algorithms have been established as state-of-the-art techniques to improve speech intelligibility and listening comfort. In this paper, we present an end-to-end binaural speech enhancement method using a complex recurrent convolutional network with an encoder-decoder architecture and a complex LSTM recurrent block placed between the encoder and decoder. A loss function that focuses on the preservation of spa…

The vOICe for Android v2.76 released. Added support for Android 16. Added an experimental AI compatibility mode for Google Gemini Live (hi-res color camera preview), toggled by fast-swiping right on The vOICe main screen on your smartphone.
https://play.google.com/store/apps/detai…

The vOICe for Android - Apps on Google Play
Augmented Reality for the Blind: See with your Ears!

InGaN Nanopixel Arrays on Single Crystal GaN Substrate
Nirmal Anand, Sadat Tahmeed Azad, Christy Giji Jenson, Dipon Kumar Ghosh, Md Zunaid Baten, Pei-Cheng Ku, Grzegorz Muziol, Sharif Sadaf
https://arxiv.org/abs/2506.11408

InGaN Nanopixel Arrays on Single Crystal GaN Substrate
Indium gallium nitride (InGaN) quantum well (QW) micro- and nano-scale light-emitting diodes (LEDs) are vital to the next-generation optoelectronic applications such as ultrahigh-speed optical interconnects and near-eye augmented/virtual reality displays. However, scaling to nanoscale dimensions introduces several challenges, including an increased nonradiative recombination from surface states and defect-related emission degradation. In this work, we present a high-performance, strain-relaxed …

Point Cloud Streaming with Latency-Driven Implicit Adaptation using MoQ
Andrew Freeman, Michael Rudolph, Amr Rizk
https://arxiv.org/abs/2507.15673 https://…

Point Cloud Streaming with Latency-Driven Implicit Adaptation using MoQ
Point clouds are a promising video representation for next-generation multimedia experiences in virtual and augmented reality. Point clouds are notoriously high-bitrate, however, which limits the feasibility of live streaming systems. Prior methods have adopted traditional HTTP-based protocols for point cloud streaming, but they rely on explicit client-side adaptation to maintain low latency under congestion. In this work, we leverage the delivery timeout feature within the Media Over QUIC prot…

Accessible Gesture-Driven Augmented Reality Interaction System
Yikan Wang
https://arxiv.org/abs/2506.15189 https://arxiv.org/pdf/2506…

Accessible Gesture-Driven Augmented Reality Interaction System
Augmented reality (AR) offers immersive interaction but remains inaccessible for users with motor impairments or limited dexterity due to reliance on precise input methods. This study proposes a gesture-based interaction system for AR environments, leveraging deep learning to recognize hand and body gestures from wearable sensors and cameras, adapting interfaces to user capabilities. The system employs vision transformers (ViTs), temporal convolutional networks (TCNs), and graph attention netwo…

Denoising-While-Completing Network (DWCNet): Robust Point Cloud Completion Under Corruption
Keneni W. Tesema, Lyndon Hill, Mark W. Jones, Gary K. L. Tam
https://arxiv.org/abs/2507.16743

Denoising-While-Completing Network (DWCNet): Robust Point Cloud Completion Under Corruption
Point cloud completion is crucial for 3D computer vision tasks in autonomous driving, augmented reality, and robotics. However, obtaining clean and complete point clouds from real-world environments is challenging due to noise and occlusions. Consequently, most existing completion networks -- trained on synthetic data -- struggle with real-world degradations. In this work, we tackle the problem of completing and denoising highly corrupted partial point clouds affected by multiple simultaneous d…

Towards Effective Immersive Technologies in Medicine: Potential and Future Applications based on VR, AR, XR and AI solutions
Aliaksandr Marozau, Barbara Karpowicz, Tomasz Kowalewski, Pavlo Zinevych, Wiktor Stawski, Adam Kuzdrali\'nski, Wies{\l}aw Kope\'c
https://arxiv.org/abs/2507.19466

Towards Effective Immersive Technologies in Medicine: Potential and Future Applications based on VR, AR, XR and AI solutions
Mixed Reality (MR) technologies such as Virtual and Augmented Reality (VR, AR) are well established in medical practice, enhancing diagnostics, treatment, and education. However, there are still some limitations and challenges that may be overcome thanks to the latest generations of equipment, software, and frameworks based on eXtended Reality (XR) by enabling immersive systems that support safer, more controlled environments for training and patient care. Our review highlights recent VR and AR…

MobileHolo: A Lightweight Complex-Valued Deformable CNN for High-Quality Computer-Generated Hologram
Xie Shuyang, Zhou Jie, Xu Bo, Wang Jun, Xu Renjing
https://arxiv.org/abs/2506.14542

MobileHolo: A Lightweight Complex-Valued Deformable CNN for High-Quality Computer-Generated Hologram
Holographic displays have significant potential in virtual reality and augmented reality owing to their ability to provide all the depth cues. Deep learning-based methods play an important role in computer-generated holograms (CGH). During the diffraction process, each pixel exerts an influence on the reconstructed image. However, previous works face challenges in capturing sufficient information to accurately model this process, primarily due to the inadequacy of their effective receptive fiel…

Quality assessment of 3D human animation: Subjective and objective evaluation
Rim Rekik, Stefanie Wuhrer, Ludovic Hoyet, Katja Zibrek, Anne-H\'el\`ene Olivier
https://arxiv.org/abs/2505.23301

Quality assessment of 3D human animation: Subjective and objective evaluation
Virtual human animations have a wide range of applications in virtual and augmented reality. While automatic generation methods of animated virtual humans have been developed, assessing their quality remains challenging. Recently, approaches introducing task-oriented evaluation metrics have been proposed, leveraging neural network training. However, quality assessment measures for animated virtual humans that are not generated with parametric body models have yet to be developed. In this contex…

Vehicular Cloud Computing: A cost-effective alternative to Edge Computing in 5G networks
Rosario Patan\`e, Nadjib Achir, Andrea Araldo, Lila Boukhatem
https://arxiv.org/abs/2507.15670

Vehicular Cloud Computing: A cost-effective alternative to Edge Computing in 5G networks
Edge Computing (EC) is a computational paradigm that involves deploying resources such as CPUs and GPUs near end-users, enabling low-latency applications like augmented reality and real-time gaming. However, deploying and maintaining a vast network of EC nodes is costly, which can explain its limited deployment today. A new paradigm called Vehicular Cloud Computing (VCC) has emerged and inspired interest among researchers and industry. VCC opportunistically utilizes existing and idle vehicular …

Multimodal "Puppeteer": An Exploration of Robot Teleoperation Via Virtual Counterpart with LLM-Driven Voice and Gesture Interaction in Augmented Reality
Yuchong Zhang, Bastian Orthmann, Shichen Ji, Michael Welle, Jonne Van Haastregt, Danica Kragic
https://arxiv.org/abs/2506.13189…

Multimodal "Puppeteer": An Exploration of Robot Teleoperation Via Virtual Counterpart with LLM-Driven Voice and Gesture Interaction in Augmented Reality
The integration of robotics and augmented reality (AR) holds transformative potential for advancing human-robot interaction (HRI), offering enhancements in usability, intuitiveness, accessibility, and collaborative task performance. This paper introduces and evaluates a novel multimodal AR-based robot puppeteer framework that enables intuitive teleoperation via virtual counterpart through large language model (LLM)-driven voice commands and hand gesture interactions. Utilizing the Meta Quest 3,…

DiFuse-Net: RGB and Dual-Pixel Depth Estimation using Window Bi-directional Parallax Attention and Cross-modal Transfer Learning
Kunal Swami, Debtanu Gupta, Amrit Kumar Muduli, Chirag Jaiswal, Pankaj Kumar Bajpai
https://arxiv.org/abs/2506.14709

DiFuse-Net: RGB and Dual-Pixel Depth Estimation using Window Bi-directional Parallax Attention and Cross-modal Transfer Learning
Depth estimation is crucial for intelligent systems, enabling applications from autonomous navigation to augmented reality. While traditional stereo and active depth sensors have limitations in cost, power, and robustness, dual-pixel (DP) technology, ubiquitous in modern cameras, offers a compelling alternative. This paper introduces DiFuse-Net, a novel modality decoupled network design for disentangled RGB and DP based depth estimation. DiFuse-Net features a window bi-directional parallax atte…

Immersive Technologies in Training and Healthcare: From Space Missions to Psychophysiological Research
Barbara Karpowicz, Maciej Grzeszczuk, Adam Kuzdrali\'nski, Monika Kornacka, Aliaksandr Marozau, Wiktor Stawski, Pavlo Zinevych, Grzegorz Marcin W\'ojcik, Tomasz Kowalewski, Grzegorz Pochwatko, Wies{\l}aw Kope\'c
https://

Immersive Technologies in Training and Healthcare: From Space Missions to Psychophysiological Research
Virtual, Augmented, and eXtended Reality (VR/AR/XR) technologies are increasingly recognized for their applications in training, diagnostics, and psychological research, particularly in high-risk and highly regulated environments. In this panel we discuss how immersive systems enhance human performance across multiple domains, including clinical psychology, space exploration, and medical education. In psychological research and training, XR can offer a controlled yet ecologically valid setting …

DARAS: Dynamic Audio-Room Acoustic Synthesis for Blind Room Impulse Response Estimation
Chunxi Wang, Maoshen Jia, Wenyu Jin
https://arxiv.org/abs/2507.08135

DARAS: Dynamic Audio-Room Acoustic Synthesis for Blind Room Impulse Response Estimation
Room Impulse Responses (RIRs) accurately characterize acoustic properties of indoor environments and play a crucial role in applications such as speech enhancement, speech recognition, and audio rendering in augmented reality (AR) and virtual reality (VR). Existing blind estimation methods struggle to achieve practical accuracy. To overcome this challenge, we propose the dynamic audio-room acoustic synthesis (DARAS) model, a novel deep learning framework that is explicitly designed for blind RI…

InstaInpaint: Instant 3D-Scene Inpainting with Masked Large Reconstruction Model
Junqi You, Chieh Hubert Lin, Weijie Lyu, Zhengbo Zhang, Ming-Hsuan Yang
https://arxiv.org/abs/2506.10980

InstaInpaint: Instant 3D-Scene Inpainting with Masked Large Reconstruction Model
Recent advances in 3D scene reconstruction enable real-time viewing in virtual and augmented reality. To support interactive operations for better immersiveness, such as moving or editing objects, 3D scene inpainting methods are proposed to repair or complete the altered geometry. However, current approaches rely on lengthy and computationally intensive optimization, making them impractical for real-time or online applications. We propose InstaInpaint, a reference-based feed-forward framework t…

Beyond Wellbeing Apps: Co-Designing Immersive, Embodied, and Collective Digital Wellbeing Interventions for Healthcare Professionals
Zheyuan Zhang, Jingjing Sun, Dorian Peters, Rafael A. Calvo
https://arxiv.org/abs/2506.19524

Beyond Wellbeing Apps: Co-Designing Immersive, Embodied, and Collective Digital Wellbeing Interventions for Healthcare Professionals
Healthcare professionals (HCPs) face increasing levels of stress and burnout. Technological wellbeing interventions provide accessible and flexible support for HCPs. While most studies have focused on mobile- and web-based programs, alternative technologies like virtual reality (VR), augmented reality (AR), tangible interfaces, and embodied technologies are emerging as engaging and effective tools for wellbeing interventions. However, there is still a lack of research on how such technologies a…

Augmented Reality User Interfaces for First Responders: A Scoping Literature Review
Erin Argo, Tanim Ahmed, Sarah Gable, Callie Hampton, Jeronimo Grandi, Regis Kopper
https://arxiv.org/abs/2506.09236

Augmented Reality User Interfaces for First Responders: A Scoping Literature Review
During the past decade, there has been a significant increase in research focused on integrating AR User Interfaces into public safety applications, particularly for first responders in the domains of Emergency Medical Services, Firefighting, and Law Enforcement. This paper presents the results of a scoping review involving the application of AR user interfaces in the public safety domain and applies an established systematic review methodology to provide a comprehensive analysis of the current…

Vision-Based Assistive Technologies for People with Cerebral Visual Impairment: A Review and Focus Study
Bhanuka Gamage, Leona Holloway, Nicola McDowell, Thanh-Toan Do, Nicholas Price, Arthur Lowery, Kim Marriott
https://arxiv.org/abs/2505.22983

Vision-Based Assistive Technologies for People with Cerebral Visual Impairment: A Review and Focus Study
Over the past decade, considerable research has investigated Vision-Based Assistive Technologies (VBAT) to support people with vision impairments to understand and interact with their immediate environment using machine learning, computer vision, image enhancement, and/or augmented/virtual reality. However, this has almost totally overlooked a growing demographic: people with Cerebral Visual Impairment (CVI). Unlike ocular vision impairments, CVI arises from damage to the brain's visual process…

Show Me Your Best Side: Characteristics of User-Preferred Perspectives for 3D Graph Drawings
Lucas Joos, Gavin J. Mooney, Maximilian T. Fischer, Daniel A. Keim, Falk Schreiber, Helen C. Purchase, Karsten Klein
https://arxiv.org/abs/2506.09212

Show Me Your Best Side: Characteristics of User-Preferred Perspectives for 3D Graph Drawings
The visual analysis of graphs in 3D has become increasingly popular, accelerated by the rise of immersive technology, such as augmented and virtual reality. Unlike 2D drawings, 3D graph layouts are highly viewpoint-dependent, making perspective selection critical for revealing structural and relational patterns. Despite its importance, there is limited empirical evidence guiding what constitutes an effective or preferred viewpoint from the user's perspective. In this paper, we present a systema…