AFFORDABLE AUGMENTED REALITY FOR SPINE SURGERY: AN EMPIRICAL INVESTIGATION INTO IMPROVING VISUALIZATION AND SURGICAL ACCURACY
Iqra Aslam
Riphah International University (Pakistan)
Muhammad Jasim Saeed
Riphah International University (Pakistan)
https://orcid.org/0000-0003-4736-2263
Zarmina Jahangir
Riphah International University (Pakistan)
https://orcid.org/0009-0002-1240-1357
Kanza Zafar
Riphah International University (Pakistan)
Muhammad Awais Sattar
awais.sattar@riphah.edu.pkRiphah International University (Pakistan)
https://orcid.org/0000-0002-2431-8182
Abstract
The minimally invasive spine surgery, sometimes referred to as MISS, has changed spinal therapy by minimizing the length of time required for recovery, as well as the amount of worry and suffering that patients experience. Before we can consider the surgery to have been successful, there is a critical problem that has to be addressed. The use of augmented reality technology has been gaining traction over the course of the last few years as a method of improving the accuracy of MISS management. This research has a significant focus on the applications of augmented reality in minimally invasive spine surgery as its core investigation. The use of augmented reality (AR) technology, which supports medical professionals in performing difficult spine procedures, allows for the provision of real-time placement suggestions as well as information that is specific to the patient. This has a number of major benefits, some of which include improved vision, more accurate tool placement, and less problems. In order to include augmented reality into MISS, it was necessary to have a user interface that was easy to use, a data integration system that was comprehensive, and recording mechanisms that were reliable. It is necessary to make the necessary modifications to the registration process, delays, and physical issues before bringing it into clinical practice. This procedure must be completed before it can be implemented. In the context of this research project, an application for smartphones that is integrated with augmented reality is currently being created with the purpose of boosting minimally invasive spine surgery. "The innovation of this research is the creation of a mobile AR interface that bridges the gap between accessibility and high-quality surgical visualization tools, offering an alternative to traditional AR systems." This AR smartphone application is the first of its type to combine cost, accessibility, and sophisticated visualization features, resulting in a whole new approach to surgical help that is unlike any other surgical procedure.Using Unity3D, the Vuforia AR camera, and C#, the software is able to create an augmented reality (AR) experience for mobile devices. This objective is realized via the utilization of these three components. Technology that are regarded to be industry standards include HoloLens and head-mounted displays (HMDs), which are examples of augmented reality technology. On the other hand, the vast majority of people are unable to make use of them because of the tremendous cost that they carry. When it comes to visualizing three-dimensional MRI spine pictures, this technology offers an approach that is more efficient and economical. Taking into consideration the results of this study, it would seem that surveys and formal evaluations that make use of MISS and augmented reality might possibly be beneficial. By using augmented reality (AR), medical practitioners may be able to more effectively see important structures, plan surgical operations, and identify the required equipment, which may eventually result in improved patient outcomes. Increasing the capabilities of augmented reality technology, finding new uses for it, and incorporating artificial intelligence-driven decision improvement are the goals of the researchers.
Keywords:
Augmented Reality, Minimally Invasive Spine Surgery, surgical accuracy, patient outcomesReferences
[1] Avrumova F., Lebl D. R.: Augmented reality for minimally invasive spinal surgery. Frontiers in Surgery 9, 2023, 1086988 [https://doi.org/10.3389/fsurg.2022.1086988].
DOI: https://doi.org/10.3389/fsurg.2022.1086988
Google Scholar
[2] Benmahdjoub M., van Walsum T., van Twisk P., Wolvius E. B.: Augmented reality in craniomaxillofacial surgery: Added value and proposed recommendations through a systematic review of the literature. Int. J. Oral Maxillofac. Surg. 50, 2021, 969–978.
DOI: https://doi.org/10.1016/j.ijom.2020.11.015
Google Scholar
[3] Brebant V., Heine N., Lamby P., Heidekrueger P. I., Forte A. J., Prantl L., Aung T.: Augmented reality of indocyanine green fluorescence in simplified lymphovenous anastomosis in lymphatic surgery. Clin. Hemorheol. Microcirc. 3, 2019, 125–133.
DOI: https://doi.org/10.3233/CH-199220
Google Scholar
[4] Brockmeyer P., Wiechens B., Schliephake H.: The role of augmented reality in the advancement of minimally invasive surgery procedures: A scoping review. Bioengineering 10(4), 2023, 501 [https://doi.org/10.3390/bioengineering10040501].
DOI: https://doi.org/10.3390/bioengineering10040501
Google Scholar
[5] Butler A. J., Colman M. W., Lynch J., Phillips F. M.: Augmented reality in minimally invasive spine surgery: Early efficiency and complications of percutaneous pedicle screw instrumentation. Spine J. 23, 2023, 27–33.
DOI: https://doi.org/10.1016/j.spinee.2022.09.008
Google Scholar
[6] Chauvet P. et al.: Augmented reality with diffusion tensor imaging and tractography during laparoscopic myomectomies. J. Minim. Invasive Gynecol. 27, 2020, 973–976.
DOI: https://doi.org/10.1016/j.jmig.2019.11.007
Google Scholar
[7] Chen F., Cui X., Han B., Liu J., Zhang X., Liao H.: Augmented reality navigation for minimally invasive knee surgery using enhanced arthroscopy. Comput. Methods Programs Biomed. 201, 2021, 105952.
DOI: https://doi.org/10.1016/j.cmpb.2021.105952
Google Scholar
[8] Eckert M., Volmerg J. S., Friedrich C. M.: Augmented reality in medicine: Systematic and bibliographic review. JMIR Mhealth Uhealth. 7(4), 2019, e10967 [https://doi.org/10.2196/10967].
DOI: https://doi.org/10.2196/10967
Google Scholar
[9] Felix B. et al.: Augmented reality spine surgery navigation: Increasing pedicle screw insertion accuracy for both open and minimally invasive spine surgeries. Spine. 47, 2022, 865–872.
DOI: https://doi.org/10.1097/BRS.0000000000004338
Google Scholar
[10] Forte M. P., Gourishetti R., Javot B., Engler T., Gomez E. D., Kuchenbecker K. J.: Design of interactive augmented reality functions for robotic surgery and evaluation in dry-lab lymphadenectomy. Int. J. Med. Robot. 18, 2022, e2351.
DOI: https://doi.org/10.1002/rcs.2351
Google Scholar
[11] Godzik J., Farber S. H., Urakov T., Steinberger J., Knipscher L. J., Ehredt R. B., Tumialán L. M., Uribe J. S.: "Disruptive technology" in spine surgery and education: Virtual and augmented reality. Oper. Neurosurg. 21, 2021, S85–S93.
DOI: https://doi.org/10.1093/ons/opab114
Google Scholar
[12] Gholizadeh M. et al.: Minimally invasive and invasive liver surgery based on augmented reality training: a review of the literature. J Robot Surg. 17(3), 2023, 753–763 [https://doi.org/10.1007/s11701-022-01499-2].
DOI: https://doi.org/10.1007/s11701-022-01499-2
Google Scholar
[13] Gribaudo M., Piazzolla P., Porpiglia F., Vezzetti E., Violante M. G.: 3D augmentation of the surgical video stream: Toward a modular approach. Comput. Methods Programs Biomed. 191, 2020, 105505.
DOI: https://doi.org/10.1016/j.cmpb.2020.105505
Google Scholar
[14] Hersh A. et al.: Augmented reality in spine surgery: A narrative review. HSS J. 17(3), 2021, 351–358 [https://doi.org/10.1177/15563316211028595].
DOI: https://doi.org/10.1177/15563316211028595
Google Scholar
[15] Huang X. et al.: Augmented reality surgical navigation in minimally invasive spine surgery: A preclinical study. Bioengineering 10, 2023, 1094 [https://doi.org/10.3390/bioengineering10091094].
DOI: https://doi.org/10.3390/bioengineering10091094
Google Scholar
[16] Hussain R., Lalande A., Guigou C., Bozorg-Grayeli A.: Contribution of augmented reality to minimally invasive computer-assisted cranial base surgery. IEEE J. Biomed. Health Inform. 24, 2020, 2093–2106.
DOI: https://doi.org/10.1109/JBHI.2019.2954003
Google Scholar
[17] Jia T., Taylor Z. A., Chen X.: Long term and robust 6DoF motion tracking for highly dynamic stereo endoscopy videos. Comput. Med. Imaging Graph. 94, 2021, 101995.
DOI: https://doi.org/10.1016/j.compmedimag.2021.101995
Google Scholar
[18] Lecointre L. et al.: Robotically assisted augmented reality system for identification of targeted lymph nodes in laparoscopic gynecological surgery: A first step toward the identification of sentinel node. Surg. Endosc. 36, 2022, 9224–9233.
DOI: https://doi.org/10.1007/s00464-022-09409-1
Google Scholar
[19] Lee C., Wong G. K.: Virtual reality and augmented reality in the management of intracranial tumors: A review. J. Clin. Neurosci. 62, 2019, 14–20 [https://doi.org/10.1016/j.jocn.2018.12.036].
DOI: https://doi.org/10.1016/j.jocn.2018.12.036
Google Scholar
[20] Lee D., Yi J. W., Hong J., Chai Y. J., Kim H. C., Kong H. J.: Augmented reality to localize individual organ in surgical procedure. Healthc Inform Res. 24(4), 2018, 394-401 [https://doi.org/10.4258/hir.2018.24.4.394].
DOI: https://doi.org/10.4258/hir.2018.24.4.394
Google Scholar
[21] Liang S.: Research proposal on reviewing augmented reality applications for supporting ageing population. Procedia Manufacturing 3, 2015, 219-226 [https://doi.org/10.1016/j.promfg.2015.07.132].
DOI: https://doi.org/10.1016/j.promfg.2015.07.132
Google Scholar
[22] Li R. et al.: Accurate and robust feature description and dense point-wise matching based on feature fusion for endoscopic images. Comput. Med. Imaging Graph. 94, 2021, 102007.
DOI: https://doi.org/10.1016/j.compmedimag.2021.102007
Google Scholar
[23] Pelargos P. E. et al.: Utilizing virtual and augmented reality for educational and clinical enhancements in neurosurgery. J. Clin. Neurosci. 35, 2017, 1–4 [https://doi.org/10.1016/j.jocn.2016.09.002].
DOI: https://doi.org/10.1016/j.jocn.2016.09.002
Google Scholar
[24] Pratt P., Arora A.: Transoral robotic surgery: Image guidance and augmented reality. ORL J. Otorhinolaryngol. Relat. Spec. 80, 2018, 204–212.
DOI: https://doi.org/10.1159/000489467
Google Scholar
[25] Rush A. J. 3rd., Shepard N., Nolte M., Siemionow K., Phillips F.: Augmented reality in spine surgery: Current state of the art. Int. J. Spine Surg. 16, 2022, S22–S27.
DOI: https://doi.org/10.14444/8273
Google Scholar
[26] Spirina Y., Samoilova I., Kazimova D., Selezneva R., Polupan K.: Using the Unity 3D environment and the Vuforia plugin to develop an AR application. Trudy Universiteta 1(90), 2023, 378–384 [https://doi.org/10.52209/1609-1825_2023_1_378].
DOI: https://doi.org/10.52209/1609-1825_2023_1_378
Google Scholar
[27] Stewart C. L. et al.: Study on augmented reality for robotic surgery bedside assistants. J. Robot. Surg. 16, 2022, 1019–1026.
DOI: https://doi.org/10.1007/s11701-021-01335-z
Google Scholar
[28] Thabit A. et al.: Augmented reality navigation for minimally invasive craniosynostosis surgery: A phantom study. Int. J. Comput. Assist. Radiol. Surg. 17, 2022, 1453–1460.
DOI: https://doi.org/10.1007/s11548-022-02634-y
Google Scholar
[29] Wang R., Zhang M., Meng X., Geng Z., Wang F.Y.: 3-D tracking for augmented reality using combined region and dense cues in endoscopic surgery. IEEE J. Biomed. Health Inform. 22, 2018, 1540–1551.
DOI: https://doi.org/10.1109/JBHI.2017.2770214
Google Scholar
[30] Wendler T., van Leeuwen F. W. B., Navab N., van Oosterom M. N.: How molecular imaging will enable robotic precision surgery: The role of artificial intelligence, augmented reality, and navigation. Eur. J. Nucl. Med. Mol. Imaging. 48, 2021, 4201–4224.
DOI: https://doi.org/10.1007/s00259-021-05445-6
Google Scholar
[31] Wild C. et al.: Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: A randomized controlled study. Surg. Endosc. 36, 2022, 7453–7461.
DOI: https://doi.org/10.1007/s00464-022-09158-1
Google Scholar
[32] Xu L. et al.: Information loss challenges in surgical navigation systems: From information fusion to AI-based approaches. Inf. Fusion. 92, 2023, 13–36.
DOI: https://doi.org/10.1016/j.inffus.2022.11.015
Google Scholar
[33] Yuk F. J., Maragkos G. A., Sato K., Steinberger J.: Current innovation in virtual and augmented reality in spine surgery. Ann. Transl. Med. 9, 2021, 94.
DOI: https://doi.org/10.21037/atm-20-1132
Google Scholar
Authors
Iqra AslamRiphah International University Pakistan
Holds an M.Sc. in computer science from Riphah International University, Lahore Campus, and a B.Sc. in computer science from Lahore College for Women University, Lahore. With a solid academic background, her key interests include application development, computer vision, and machine learning. Passionate about using her skills in these areas to create new technology solutions and support research in computer science.
Authors
Muhammad Jasim SaeedRiphah International University Pakistan
https://orcid.org/0000-0003-4736-2263
Received the M.Sc. degree in computer science from Liverpool John Moores University, U.K., and the Ph.D. degree in computer communications and networks from Manchester Metropolitan University, U.K. Currently, he holds the position of an assistant professor and the Head of the Department of Computing, Riphah International University, Lahore Campus, Pakistan.
Authors
Zarmina JahangirRiphah International University Pakistan
https://orcid.org/0009-0002-1240-1357
Has an extensive background in computer science with an M.Sc. degree from FAST-NU and a Ph.D. scholar specializing in Software Engineering from COMSATS. With a strong academic foundation and a passion for research, her key interests lie in Software Engineering and Machine Learning.
Authors
Kanza ZafarRiphah International University Pakistan
A Ph.D. Scholar in Computing at Riphah International University. She has done B.Sc. and M.Sc. in Computer Engineering from Sir Syed University of Engineering Technology, Karachi. Currently, she is serving as Senior Lecturer at Riphah International University, Lahore Campus. Her research areas are Computer Networks and Information & Cyber Secuirty.
Authors
Muhammad Awais Sattarawais.sattar@riphah.edu.pk
Riphah International University Pakistan
https://orcid.org/0000-0002-2431-8182
Statistics
Abstract views: 51PDF downloads: 33
Most read articles by the same author(s)
- Atika Islam, Faisal Bukhari, Muhammad Awais Sattar, Ayesha Kashif, DETERMINING STUDENT'S ONLINE ACADEMIC PERFORMANCE USING MACHINE LEARNING TECHNIQUES , Informatyka, Automatyka, Pomiary w Gospodarce i Ochronie Środowiska: Vol. 14 No. 3 (2024)
