Theoretical Foundations and Architectural Frameworks of Spatial Computing in Medicine: Perceptual Ergonomics, Clinical Efficacy, and Immersive Paradigms across VR, AR, and MR

Author

Devikrishna MU, Prof. Riya K Prakash, Dr. L.C. Manikandan


Abstract

 Medical visualization and human-computer interaction (HCI) are undergoing a fundamental paradigm shift from two-dimensional planar slice reconstructions to spatially registered, three-dimensional computing environments. Spatial computing—an overarching technological framework encompassing Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR)—enables computational machinery to maintain and manipulate continuous spatial references to physical objects, environments, and human anatomies. This comprehensive paper establishes the theoretical, computational, and clinical basics of spatial computing across healthcare pedagogy, surgical planning, intraoperative navigation, and patient self-care. We contrast legacy medical visualization systems (characterized by 2D orthogonal PACS slices, cadaveric specimen scarcity, and high cognitive transformation loads) with modern 6-Degree-of-Freedom (6-DoF) spatial pipelines powered by Simultaneous Localization and Mapping (SLAM), real-time sensor fusion, and spatial anchoring. Drawing upon rigorous perceptual models—including the tri-factor Augmentation Quality construct (Design, Interaction, and Embedding Quality), the psychological state of Local Presence, Gibsonian affordance theory, and Dual-Process Cognitive Theory—we provide a systematic analysis of spatial HCI. Furthermore, we synthesize empirical findings from recent controlled trials (including the Handheld Augmented Reality Usability Scale [HARUS] evaluations and the METACARE population study across the Seven Pillars of Self-Care), evaluate critical adoption barriers (latency budgets, optical physics, vergence-accommodation conflict, EHR interoperability, and biometric telemetry privacy), and outline future trajectories for AI-integrated generative anatomical digital twins.



Keywords

Spatial Computing, Augmented Reality (AR), Virtual Reality (VR), Mixed Reality (MR), Extended Reality (XR), Medical Education, Surgical Navigation, Augmentation Quality, Local Presence, HARUS Usability Scale, SLAM, Cognitive Load Theory



Full Text:

Download Paper PDF


References


  1.  Akers, J., Zimmermann, J., Trutoiu, L., Schowengerdt, B., & Kemelmacher-Shlizerman, I. (2020). Mixed Reality Spatial Computing in a Remote Learning Classroom. Proc. ACM SUI '20, 1–3.
  2.  Alizadehsalehi, S., Hadavi, A., & Huang, J. C. (2020). From BIM to extended reality in AEC industry. Automation in Construction, 116, 103254.
  3.  Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., & MacIntyre, B. (2001). Recent advances in augmented reality. IEEE Computer Graphics and Applications, 21(6), 34–47.
  4.  Babin, B. J., Darden, W. R., & Griffin, M. (1994). Work and/or fun: Measuring hedonic and utilitarian shopping value. Journal of Consumer Research, 20(4), 644–656.
  5.  Biocca, F., Harms, C., & Burgoon, J. K. (2003). Toward a more robust theory and measure of social presence. Presence: Teleoperators & Virtual Environments, 12(5), 456–480.
  6. Cutolo, F., Meola, A., Carbone, M., et al. (2017). Head-mounted display-based augmented reality system in neurosurgical oncology. Computer Assisted Surgery, 22(1), 39–53.
  7. Daassi, M., & Debbabi, S. (2021). Intention to reuse AR-based apps: Immersion, product presence, and realism. Information & Management, 58(4), 103453.
  8. El-Osta, A., Qiu, C., Alaa, A., Adam, M., & Altalib, S. (2026). Public perceptions of spatial computing in health: Opportunities and barriers. Research Square / BMC Public Health.
  9. Evans, J. S. B., & Stanovich, K. E. (2013). Dual-Process Theories of Higher Cognition: Advancing the Debate. Perspectives on Psychological Science, 8(3), 223–241.
  10. Giaretta, A. (2024). Security and privacy in virtual reality: a literature survey. Virtual Reality, 29(1), 10.
  11. Gibson, J. J. (1986). The Ecological Approach to Visual Perception. Psychology Press Classic Editions.
  12. Goudman, L., Jansen, J., Billot, M., et al. (2022). Virtual reality applications in chronic pain management: Systematic review and meta-analysis. JMIR Serious Games, 10(2), e34402.
  13. Greenwold, S. (2003). Spatial Computing(Master's thesis). Massachusetts Institute of Technology.
  14. Gül, L. F., Halıcı, S. M., & Alaçam, S. (2026). Comparative Study of Handheld and Head-Mounted Displays Using Spatial Computing. Journal of Metaverse, 6, 41–56.
  15. Hartmann, T., Wirth, W., Schramm, H., et al. (2015). The Spatial Presence Experience Scale (SPES). Journal of Media Psychology, 28(1), 1–15.
  16. Hilken, T., de Ruyter, K., Chylinski, M., et al. (2017). Augmenting the eye of the beholder: Exploring strategic potential of AR. Journal of the Academy of Marketing Science, 45(6), 884–905.
  17. Iqbal, A. I., Aamir, A., Hammad, A., et al. (2024). Immersive Technologies in Healthcare: In-Depth Exploration of VR and AR. Journal of Primary Care & Community Health, 15, 21501319241293311.
  18. Kruijff, E., Swan, J. E., & Feiner, S. (2010). Perceptual issues in augmented reality revisited. IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 3–12.
  19. Lake, K., McKittrick, A., Desselle, M., et al. (2024). Cybersecurity and privacy issues in XR healthcare applications. JMIR XR and Spatial Computing, 1(1), e59409.
  20. Laver, K. E., Lange, B., George, S., et al. (2025). Virtual reality for stroke rehabilitation. Cochrane Database of Systematic Reviews, 6(6), CD008349.
  21. Magalhães, R., Oliveira, A., Terroso, D., et al. (2024). Mixed Reality in the Operating Room: A Systematic Review. Journal of Medical Systems, 48(1), 76.
  22. Mallari, B., Spaeth, E. K., Goh, H., & Boyd, B. S. (2019). Virtual reality as an analgesic for acute and chronic pain. Journal of Pain Research, 12, 2053–2085.
  23. Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE Transactions on Information and Systems, 77(12), 1321–1329.
  24. Nielsen, J. (1994). Usability Engineering. Morgan Kaufmann.
  25. Schein, K. E., Rauschnabel, P. A., Praxmarer-Carus, S., & Babin, B. J. (2025). Unpacking augmentation quality and local presence in AR. Journal of the Academy of Marketing Science, 54, 49–69.
  26. Sharma, D. (2024). Minimally invasive approaches in emergency abdominal surgery. British Journal of Surgery, 111(2), 145–154.
  27. Shneiderman, B., Plaisant, C., Cohen, M., Jacobs, S., Elmqvist, N., & Diakopoulos, N. (2016). Designing the User Interface: Strategies for Effective Human-Computer Interaction(6th ed.). Pearson.
  28. Salimov, A. (2026). Immersive 3D Spatial Modeling in Anatomical and Surgical Education. International Journal of Medical Education & Simulation, 18(2), 112–124.

 

 

 

Share your valuable work from Social Media Buttons