g

Haptic-Augmented Visual Feedback to Improve Depth Accuracy in Optical See-Through AR Interaction

Authors

  • Michael Thompson

    School of Interactive Arts and Technology, Simon Fraser University, Surrey, BC V3T 0A3, Canada
    Author
  • Daniel Patel

    School of Interactive Arts and Technology, Simon Fraser University, Surrey, BC V3T 0A3, Canada
    Author
  • Emily Chen

    School of Interactive Arts and Technology, Simon Fraser University, Surrey, BC V3T 0A3, Canada
    Author

DOI:

https://doi.org/10.71465/jgs53

Keywords:

Optical see-through AR, haptic feedback, multimodal interaction, depth perception, usability, human-computer interaction

Abstract

Visual cues alone may be insufficient for precise depth judgment in OST-AR. This study integrates vibrotactile feedback to reinforce spatial alignment cues. Twenty-six participants completed a fine alignment task under visual-only and visual-plus-haptic conditions. Mean alignment error decreased from 10.7 mm to 5.9 mm with multimodal feedback (44.9% improvement). Task time decreased by 18.3%, and NASA-TLX workload scores were reduced by 22.7%. Multimodal augmentation significantly enhances depth accuracy and interaction usability in OST-AR environments.

References

1. Liu, S., & Yim, J. (2025). Research on Generative AI Creation Systems Based on Visual Language Modeling: Human-Machine Collaboration and Cognitive Feedback Mechanisms. Available at SSRN 6139770.

2. Egger, J., Gsaxner, C., Luijten, G., Chen, J., Chen, X., Bian, J., ... & Puladi, B. (2024). Is the apple vision pro the ultimate display? A first perspective and survey on entering the wonderland of precision medicine. JMIR Serious Games, 12(1), e52785.

3. Yang, Y., Xie, X., Wang, X., Zhang, H., Yu, C., Xiong, X., ... & Baik, F. (2025, October). Impact of target and tool visualization on depth perception and usability in optical see-through AR. In 2025 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (pp. 700-703). IEEE.

4. Westermeier, F., Brübach, L., Wienrich, C., & Latoschik, M. E. (2024). Assessing depth perception in vr and video see-through ar: A comparison on distance judgment, performance, and preference. IEEE Transactions on Visualization and Computer Graphics, 30(5), 2140-2150.

5. Yu, X. (2026). Enhancing Search Efficiency through LLM-Based User Memory Systems for Query Matching and Intent Modeling.

6. McAnally, K., Wallis, G., & Grove, P. (2024). Visually guided movement in virtual reality is tolerant of the vergence-accommodation conflict. Displays, 82, 102668.

7. Xiao, H., Zhu, W., Qiu, Z., Zeng, Z., Zhang, S., & Xiao, R. (2025, September). Anti-Drosophila Habituation Clustering for Enhanced Anomaly Detection in Data Streams. In 2025 10th International Conference on Computer and Information Processing Technology (ISCIPT) (pp. 636-644). IEEE.

8. Kohm, K., Babu, S. V., Pagano, C., & Robb, A. (2022). Objects may be farther than they appear: depth compression diminishes over time with repeated calibration in virtual reality. IEEE transactions on visualization and computer graphics, 28(11), 3907-3916.

9. Wang, Y., Chen, J., Arias, R., Wang, Y., & Yin, X. (2026). Development and Validation of a Patient-Friendly Digital Assessment Platform for Precision Screening of Oral Anti-Obesity Medications (AOMs).

10. Ashtiani, O., Guo, H. J., & Prabhakaran, B. (2023). Impact of motion cues, color, and luminance on depth perception in optical see-through AR displays. Frontiers in Virtual Reality, 4, 1243956.

11. Gao, G., Ma, X., Lu, C., & Gao, R. (2026). Reliability Analysis and Application Research of SMS Communication Systems in Medical Notification Scenarios.

12. Westermeier, F., Brübach, L., Wienrich, C., & Latoschik, M. E. (2024). Assessing depth perception in vr and video see-through ar: A comparison on distance judgment, performance, and preference. IEEE Transactions on Visualization and Computer Graphics, 30(5), 2140-2150.

13. Wang, Y., Chen, J., Wang, Y., & Yin, X. (2026). Application of Obtainable Biological Agent Characteristics in Efficacy Stratification of Oral Anti-Obesity Drugs.

14. Daling, L. M., & Schlittmeier, S. J. (2024). Effects of augmented reality-, virtual reality-, and mixed reality–based training on objective performance measures and subjective evaluations in manual assembly tasks: a scoping review. Human factors, 66(2), 589-626.

15. Zhang, Y., Gu, W., & Wang, J. (2026). Construction of Wind Farm Asset Health Index Based on Multi-Dimensional Indicators and Analytic Hierarchy Process and Its Correlation with Operational Performance. Authorea Preprints.

16. Emami, M., Bayat, A., Tafazolli, R., & Quddus, A. (2024). A survey on haptics: Communication, sensing and feedback. IEEE Communications Surveys & Tutorials, 27(3), 2006-2050.

17. Wang, Y., Wen, Y., Wu, X., & Cai, H. (2024). Comprehensive Evaluation of GLP1 Receptor Agonists in Modulating Inflammatory Pathways and Gut Microbiota.

18. Sa’adon, M. N. I., Sunar, M. S., & Ali, K. N. (2023, December). Multi-platform virtual reality interaction with hand gestures for precise object manipulation and multi-user collaboration. In 2023 3rd International Conference on Intelligent Cybernetics Technology & Applications (ICICyTA) (pp. 312-317). IEEE.

19. Wang, Y., Wen, Y., Wu, X., Wang, L., & Cai, H. (2025). Assessing the Role of Adaptive Digital Platforms in Personalized Nutrition and Chronic Disease Management.

20. Clarke, T. J., Mayer, W., Zucco, J. E., Matthews, B. J., & Smith, R. T. (2022, October). Adapting VST AR X-Ray Vision Techniques to OST AR. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (pp. 495-500). IEEE.

21. Zhang, Y., & Wang, J. (2026). Design and Implementation of a Computer-Aided Full Lifecycle Quality Management System for Wind Farms in Upgrades, Renovations, and Subcontractor Supervision.

22. Dritsas, E., Trigka, M., Troussas, C., & Mylonas, P. (2025). Multimodal interaction, interfaces, and communication: a survey. Multimodal Technologies and Interaction, 9(1), 6.

23. Jiao, Y., Zhao, B., Wang, A., & Shi, T. (2026). Construction and Empirical Study of a Modularized Teaching System for Art Courses Based on a Unified Training Pathway.

24. Lazaro, M. J., & Kim, S. (2025). Review of multimodal interaction in optical see-through augmented reality. International Journal of Human–Computer Interaction, 41(17), 11227-11243.

25. Jiao, Y., Wang, A., Zhao, B., & Shi, T. (2026). The Impact of Visual Language Strategies in Public Art Creation on Community Spatial Perception and Public Behavior.

26. Schmid, D. (2024). The Effects of Cognitive-Motor Entrainment on Long-Term Memory Across Two Physical Activity Modalities (Doctoral dissertation, University of Georgia).

27. Liu, S., Liu, X., & Feng, H. (2025, November). Research on AI-Driven Visual Design and Immersive Interactive Experiences Based on Multimodal Cognition and User. In Proceedings of the 2025 International Conference on Digital Society and Intelligent Computing (pp. 734-740).

28. Tivadar, R. I., Arnold, R. C., Turoman, N., Knebel, J. F., & Murray, M. M. (2022). Digital haptics improve speed of visual search performance in a dual-task setting. Scientific reports, 12(1), 9728.

29. Chen, J., Xiao, H., Zeng, Z., Du, X., & Xiao, R. (2026). Diffusion-step attention consistency for multivariate time series anomaly detection. Knowledge-Based Systems, 115716.

Downloads

Published

2026-05-20