Tootfinder

Multimodal "Puppeteer": An Exploration of Robot Teleoperation Via Virtual Counterpart with LLM-Driven Voice and Gesture Interaction in Augmented Reality
Yuchong Zhang, Bastian Orthmann, Shichen Ji, Michael Welle, Jonne Van Haastregt, Danica Kragic
https://arxiv.org/abs/2506.13189…

Multimodal "Puppeteer": An Exploration of Robot Teleoperation Via Virtual Counterpart with LLM-Driven Voice and Gesture Interaction in Augmented Reality
The integration of robotics and augmented reality (AR) holds transformative potential for advancing human-robot interaction (HRI), offering enhancements in usability, intuitiveness, accessibility, and collaborative task performance. This paper introduces and evaluates a novel multimodal AR-based robot puppeteer framework that enables intuitive teleoperation via virtual counterpart through large language model (LLM)-driven voice commands and hand gesture interactions. Utilizing the Meta Quest 3,…

InGaN Nanopixel Arrays on Single Crystal GaN Substrate
Nirmal Anand, Sadat Tahmeed Azad, Christy Giji Jenson, Dipon Kumar Ghosh, Md Zunaid Baten, Pei-Cheng Ku, Grzegorz Muziol, Sharif Sadaf
https://arxiv.org/abs/2506.11408

InGaN Nanopixel Arrays on Single Crystal GaN Substrate
Indium gallium nitride (InGaN) quantum well (QW) micro- and nano-scale light-emitting diodes (LEDs) are vital to the next-generation optoelectronic applications such as ultrahigh-speed optical interconnects and near-eye augmented/virtual reality displays. However, scaling to nanoscale dimensions introduces several challenges, including an increased nonradiative recombination from surface states and defect-related emission degradation. In this work, we present a high-performance, strain-relaxed …

A Project Moohan benchmark gets spotted, and may have revealed the Android XR headset's key spec https://www.techradar.com/computing/virtual-reality-augmented-reality…

InstaInpaint: Instant 3D-Scene Inpainting with Masked Large Reconstruction Model
Junqi You, Chieh Hubert Lin, Weijie Lyu, Zhengbo Zhang, Ming-Hsuan Yang
https://arxiv.org/abs/2506.10980

InstaInpaint: Instant 3D-Scene Inpainting with Masked Large Reconstruction Model
Recent advances in 3D scene reconstruction enable real-time viewing in virtual and augmented reality. To support interactive operations for better immersiveness, such as moving or editing objects, 3D scene inpainting methods are proposed to repair or complete the altered geometry. However, current approaches rely on lengthy and computationally intensive optimization, making them impractical for real-time or online applications. We propose InstaInpaint, a reference-based feed-forward framework t…

A Reference Architecture for Gamified Cultural Heritage Applications Leveraging Generative AI and Augmented Reality
Federico Martusciello, Henry Muccini, Antonio Bucchiarone
https://arxiv.org/abs/2506.04090

A Reference Architecture for Gamified Cultural Heritage Applications Leveraging Generative AI and Augmented Reality
The rapid advancement of Information and Communication Technologies is transforming Cultural Heritage access, experience, and preservation. However, many digital heritage applications lack interactivity, personalization, and adaptability, limiting user engagement and educational impact. This short paper presents a reference architecture for gamified cultural heritage applications leveraging generative AI and augmented reality. Gamification enhances motivation, artificial intelligence enables ad…

Augmented Reality User Interfaces for First Responders: A Scoping Literature Review
Erin Argo, Tanim Ahmed, Sarah Gable, Callie Hampton, Jeronimo Grandi, Regis Kopper
https://arxiv.org/abs/2506.09236

Augmented Reality User Interfaces for First Responders: A Scoping Literature Review
During the past decade, there has been a significant increase in research focused on integrating AR User Interfaces into public safety applications, particularly for first responders in the domains of Emergency Medical Services, Firefighting, and Law Enforcement. This paper presents the results of a scoping review involving the application of AR user interfaces in the public safety domain and applies an established systematic review methodology to provide a comprehensive analysis of the current…

SVD: Spatial Video Dataset
M. H. Izadimehr, Milad Ghanbari, Guodong Chen, Wei Zhou, Xiaoshuai Hao, Mallesham Dasari, Christian Timmerer, Hadi Amirpour
https://arxiv.org/abs/2506.06037

SVD: Spatial Video Dataset
Stereoscopic video has long been the subject of research due to its capacity to deliver immersive three-dimensional content across a wide range of applications, from virtual and augmented reality to advanced human-computer interaction. The dual-view format inherently provides binocular disparity cues that enhance depth perception and realism, making it indispensable for fields such as telepresence, 3D mapping, and robotic vision. Until recently, however, end-to-end pipelines for capturing, enco…

(image) Map of users of The vOICe for Android all over the world in the past 30 minutes https://play.google.com/store/apps/details?id=vOICe.vOICe

The vOICe for Android - Apps on Google Play
Augmented Reality for the Blind: See with your Ears!

Assessing Workers Neuro-physiological Stress Responses to Augmented Reality Safety Warnings in Immersive Virtual Roadway Work Zones
Fatemeh Banani Ardecani, Omidreza Shoghli
https://arxiv.org/abs/2506.03113

Assessing Workers Neuro-physiological Stress Responses to Augmented Reality Safety Warnings in Immersive Virtual Roadway Work Zones
This paper presents a multi-stage experimental framework that integrates immersive Virtual Reality (VR) simulations, wearable sensors, and advanced signal processing to investigate construction workers neuro-physiological stress responses to multi-sensory AR-enabled warnings. Participants performed light- and moderate-intensity roadway maintenance tasks within a high-fidelity VR roadway work zone, while key stress markers of electrodermal activity (EDA), heart rate variability (HRV), and electr…

SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splatting
Shengjie Lin, Jiading Fang, Muhammad Zubair Irshad, Vitor Campagnolo Guizilini, Rares Andrei Ambrus, Greg Shakhnarovich, Matthew R. Walter
https://arxiv.org/abs/2506.03594

SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splatting
Reconstructing articulated objects prevalent in daily environments is crucial for applications in augmented/virtual reality and robotics. However, existing methods face scalability limitations (requiring 3D supervision or costly annotations), robustness issues (being susceptible to local optima), and rendering shortcomings (lacking speed or photorealism). We introduce SplArt, a self-supervised, category-agnostic framework that leverages 3D Gaussian Splatting (3DGS) to reconstruct articulated ob…

Network Digital Twin for 6G and Beyond: An End-to-End View Across Multi-Domain Network Ecosystems
Dinh-Hieu Tran, Nazar Waheed, Yuris Mulya Saputra, Xingqin Lin, Cong T. Nguyen, Tedros Salih Abdu, Van Nhan Vo, Van-Quan Pham, Madyan Alsenwi, Abuzar Babikir Mohammad Adam, Symeon Chatzinotas, Eva Lagaunas, Hung Tran, Tu Ho Dac, Nguyen Van Huynh
https://…

Network Digital Twin for 6G and Beyond: An End-to-End View Across Multi-Domain Network Ecosystems
With the rapid development of technology, the number of smart mobile users is increasing, accompanied by growing demands from applications such as virtual/augmented reality (VR/XR), remote surgery, autonomous vehicles, and real-time holographic communications, all of which require high transmission rates and ultra-low latency in 6G and beyond networks (6G+). This poses enormous challenges in efficiently deploying large-scale networks, including network design, planning, troubleshooting, optimiz…

Show Me Your Best Side: Characteristics of User-Preferred Perspectives for 3D Graph Drawings
Lucas Joos, Gavin J. Mooney, Maximilian T. Fischer, Daniel A. Keim, Falk Schreiber, Helen C. Purchase, Karsten Klein
https://arxiv.org/abs/2506.09212

Show Me Your Best Side: Characteristics of User-Preferred Perspectives for 3D Graph Drawings
The visual analysis of graphs in 3D has become increasingly popular, accelerated by the rise of immersive technology, such as augmented and virtual reality. Unlike 2D drawings, 3D graph layouts are highly viewpoint-dependent, making perspective selection critical for revealing structural and relational patterns. Despite its importance, there is limited empirical evidence guiding what constitutes an effective or preferred viewpoint from the user's perspective. In this paper, we present a systema…

Context-Aware Semantic Communication for the Wireless Networks
Guangyuan Liu, Yinqiu Liu, Jiacheng Wang, Hongyang Du, Dusit Niyato, Jiawen Kang, Zehui Xiong, Abbas Jamalipour
https://arxiv.org/abs/2505.23249

Context-Aware Semantic Communication for the Wireless Networks
In next-generation wireless networks, supporting real-time applications such as augmented reality, autonomous driving, and immersive Metaverse services demands stringent constraints on bandwidth, latency, and reliability. Existing semantic communication (SemCom) approaches typically rely on static models, overlooking dynamic conditions and contextual cues vital for efficient transmission. To address these challenges, we propose CaSemCom, a context-aware SemCom framework that leverages a Large L…

Advancing Digital Accessibility: Integrating AR/VR and Health Tech for Inclusive Healthcare Solutions
Vishnu Ramineni, Shivareddy Devarapalli, Balakrishna Pothineni, Prema Kumar Veerapaneni, Aditya Gupta, Pankaj Gupta
https://arxiv.org/abs/2505.24039

Advancing Digital Accessibility: Integrating AR/VR and Health Tech for Inclusive Healthcare Solutions
Modern healthcare domain incorporates a feature of digital accessibility to ensure seamless flow of online services for the patients. However, this feature of digital accessibility poses a challenge particularly for patients with disabilities. To eradicate this issue and provide immersive and user-friendly experiences, evolving technologies like Augmented Reality (AR) and Virtual Reality (VR) are integrated in medical applications to enhance accessibility. The present research paper aims to stu…

Quality assessment of 3D human animation: Subjective and objective evaluation
Rim Rekik, Stefanie Wuhrer, Ludovic Hoyet, Katja Zibrek, Anne-H\'el\`ene Olivier
https://arxiv.org/abs/2505.23301

Quality assessment of 3D human animation: Subjective and objective evaluation
Virtual human animations have a wide range of applications in virtual and augmented reality. While automatic generation methods of animated virtual humans have been developed, assessing their quality remains challenging. Recently, approaches introducing task-oriented evaluation metrics have been proposed, leveraging neural network training. However, quality assessment measures for animated virtual humans that are not generated with parametric body models have yet to be developed. In this contex…

Vision-Based Assistive Technologies for People with Cerebral Visual Impairment: A Review and Focus Study
Bhanuka Gamage, Leona Holloway, Nicola McDowell, Thanh-Toan Do, Nicholas Price, Arthur Lowery, Kim Marriott
https://arxiv.org/abs/2505.22983

Vision-Based Assistive Technologies for People with Cerebral Visual Impairment: A Review and Focus Study
Over the past decade, considerable research has investigated Vision-Based Assistive Technologies (VBAT) to support people with vision impairments to understand and interact with their immediate environment using machine learning, computer vision, image enhancement, and/or augmented/virtual reality. However, this has almost totally overlooked a growing demographic: people with Cerebral Visual Impairment (CVI). Unlike ocular vision impairments, CVI arises from damage to the brain's visual process…