Application of AI integrated semi-autonomous robotics in spine surgery: A review

Research Article
Open access

Application of AI integrated semi-autonomous robotics in spine surgery: A review

Sihao Wang 1*
  • 1 College of Engineering, University of Washington, 1410 NE Campus Pkwy, Seattle, WA 98195, United States    
  • *corresponding author sw2219@uw.edu
Published on 10 September 2024 | https://doi.org/10.54254/2755-2721/71/20241670
ACE Vol.71
ISSN (Print): 2755-273X
ISSN (Online): 2755-2721
ISBN (Print): 978-1-83558-481-1
ISBN (Online): 978-1-83558-482-8

Abstract

Spine surgery is a high-risk surgery associated with high precision and accuracy. Artificial intelligence (AI) and semi-autonomous robotics can benefit the surgery. This paper explores the impact of AI and robotics on improving surgical precision, accuracy, and safety with details on preoperative planning, optimal screw placement, and intraoperative real-time monitoring. In addition, the potential of AI-driven simulation spaces for training and skill assessment was evaluated. Various AI models and robotic systems have improved surgical outcomes by providing precise guidance and reducing human error. This review aims to summarize the recent developments and highlight the challenges of AI and semi-autonomous robotics in spine surgery.

Keywords:

Spinal surgery, Preoperative planning, Surgical simulation

Wang,S. (2024). Application of AI integrated semi-autonomous robotics in spine surgery: A review. Applied and Computational Engineering,71,231-235.
Export citation

1. Introduction

Spinal surgery is one of the most challenging operations in medical field due to the requirement of high risk and precision. The success rate of the surgery is not only depending on the surgeon’s skill level, but also associate with the accuracy and safety of the surgical process.

Integrating AI with semi-autonomous robotics in spine surgery enhances precision, safety, and efficiency by providing real-time feedback and guidance during procedures. AI algorithms help in precise planning and accurate placement of implants, while robotic systems reduce surgeon fatigue by handling repetitive tasks. Continuous monitoring by AI ensures patient safety and allows for adaptive adjustments during surgery, leading to improved outcomes and faster recovery times. This integration also supports training through realistic simulations, ultimately contributing to better overall surgical care [1].

D'Souza et al. discussed the history of spinal robotics and focused on analyzing currently available robotic systems, comparing them to conventional spine surgery in terms of accuracy and safety [2]. McKenzie et al. systematically discussed the benefits and outcome measures of robotic-assisted surgery from different areas, including accuracy, indications, and the surgical learning curve, by analyzing 34 pieces of literature [3]. Galbusera et al. introduced five applications of AI and its subsets of technologies related to spine research, and briefly discussed the ethical issues of AI in the medicine field [4]. Zhou et al. explored the use of AI in spinal surgery, emphasizing its role in standardizing diagnosis and treatment plans through clinical transformation platforms [5]. Rasouli et al. concisely analyzed and discussed the vast potential of AI in the field of spine surgery in both the research and clinical arenas [6].

In recent years, existing medical robots have been widely used in certain surgical procedures. but research on their application in spine surgery is still insufficient, especially the combined application of artificial intelligence technology and semi-robots has not been fully explored. This review is to explore the application of AI and robotics systems in spinal surgery, with a focus on analysing their impact on surgical accuracy and safety. By summarizing and evaluating the research results and cases in recent years, show the latest progress and challenges in this field, and then discuss application.

2. Background on spine surgery

Spine surgery always faces the problem of precision and safety because the spinal nerves are located next to the vertebrae. A small deviation in the location of the perforation and screw implantation can cause serious complications or even paralyze the patient. Surgeons with the highest level of skill still make mistakes, so the entire surgical process requires more precise and reliable methods to improve the safety and effectiveness of spinal surgery.

Artificial intelligence and semi-autonomous robotics can provide solutions for preoperative planning and intraoperative decision of spine surgery. Artificial intelligence algorithms can analyze detailed preoperative imaging, suggest optimal screw trajectories and predict potential complications. During surgery, robotic systems can assist in executing these plans with high precision, reducing the likelihood of human error. The combination of artificial intelligence and robotics can help standardize surgery, minimize risk, achieve more predictable and reproducible results, improving overall surgical outcomes, and providing significant advantages over traditional techniques that rely solely on the manual skills of the surgeon.

3. Applications of AI and semi-robotics in spine surgery

3.1. Diagnosis and preoperative planning

The application of AI and robotics in spine surgery is a rapidly advancing field. ML is applied in diagnostic imaging of the spine to address various disorders [4]. AI and robotic technology can better help surgeon to analyze the position of the vertebral body, the degree of deformity, and the detection of tumors from the images, and to plan the route of the implant.

Suri et al. developed a deep learning neural network and trained it on MR, CT, and X-ray imaging data collected over a period of 15 years since 2005 to allow the system to quickly and automatically segment vertebrae to aid in radiomics studies and to gather information about underlying spinal diseases or diagnoses [7]. Fang et al. introduced a deep convolutional neural network for automatic vertebral localization and segmentation with the assessment of bone mineral density in CT images for early osteoporosis diagnosis [8]. Jamaludin et al. proposed a Convolutional Neural Network framework capable of automatically grading spinal lumbar MRIs radiologically and localizing predicted pathology hotspots with a potential application in other medical task require weak supervision [9]. Pal et al. combined random forest and fuzzy c-means algorithms to improve the accuracy of tumor type segmentation, classification, and localization in T2 MRI lumbar spine images for improved diagnosis planning and treatment outcomes [10]. Chu et al. presented a learning-based framework combining random forest regression and classification to fully automate the localization and segmentation of vertebral bodies from 3D CT and 3D T2-weighted TSE MR images with smaller average error [11]. Elsayed et al. provided a spatial computing (SC) case study that described how SC can assess graft size, trajectory planning, and psoas muscle position for critical neurovascular structures, improving surgical accuracy and limiting potential complications [12].

In addition to these basic diagnoses, most spinal surgeries require the placement of implants, and it becomes important to plan for the placement of implants prior to surgery. Wi et al. developed a simulator that provides 3D imaging and multiplanar reconstruction to assist with preoperative planning. Surgeons can directly select or modify the appropriate screw size and implant trajectory within the simulator, which helps less experienced doctors and aids in analyzing special cases [13]. Ma et al. developed an AI model called "Bone's Trajectory" to optimize pedicle screw trajectory planning, providing higher pull-out force to prevent screw loosening associated with osteoporosis. The model is also expected to be integrated into robotic surgical navigation systems [14].

The integration of AI and semi-autonomous robotics has already demonstrated improvements in preoperative planning. Machine learning algorithms is used for image segmentation, spine tumor detection, and surgical planning. There remain several challenges and limitations. For example, how to measure cumulative radiation dose to a patient during Preoperative CT image acquisition and alignment, ensuring the generalizability of AI systems across different clinical settings and imaging equipment.

3.2. Optimal screw placement position and decision

Implants are frequently used in spinal surgery. It is particularly important to select the appropriate screw, route of implantation and determine its accuracy and safety. AI and robotic technologies have shown remarkable progress in optimizing screw placement positions and surgical decision-making in spine surgery.

Jia et al. demonstrated that an AI model (Surgiplan AI) would outperform freehand selection in choosing screw length and diameter. The AI resulted 4-7 minutes faster in screw selection compared to manually and ensures the safety of the screw size parameters it chooses [15]. Lieberman et al. provided a complete surgical procedure using preoperative planning software and robotic guidance system for pedicle screw placement and conclude that it facilitated the feasibility and accuracy of the surgical plan and reduced the risk of catastrophic complications due to surgical complexity [16]. Fatima et al. confirmed the accuracy and safety of robotic pedicle screw placement through a meta-analysis. The results indicated that patients undergoing robot-assisted pedicle screw placement are more likely to achieve "perfect" accuracy compared to freehand methods. Additionally, the robot-assisted approach significantly reduces complication rates, intraoperative radiation exposure, and proximal facet joint violation compared to the traditional freehand technique [17].

Furthermore, real-time monitoring of screw placement accuracy during surgery plays a crucial role. Ahmed et al. provided the first detailed surgical procedure using real-time image-guided, robot-assisted spine surgery with a system called ExcelsisuGPS [18]. Jia et al. described that during real-time monitoring of screw placement accuracy, the AI model confirmed whether the selected screws lead to vertebral body breakage, and the AI results provided a quick reference for determining screw length and diameter [15]. Ao et al. proposed an intraoperative planning method for robotic spine surgery based on safe deep reinforcement learning (DRL). This method utilizes real-time observations for drilling path planning and trains the DRL agent using simulated surgical data to establish a foundation for future intraoperative decision-making [19].

The application of AI and robotic systems can provide accurate screw selection, real-time monitoring, and intraoperative planning. Questions like how can use AI to eliminate errors from image and equipment acquisition and registration. Also, there is uncertainty about if surgeons can follow standardized robotic surgery procedures to operative surgery. The standardization of robotic surgical procedures needs to be clarified.

3.3. Simulation space for training and practice

AI and robotic technologies provide a realistic virtual environment that surgeons can practice complex surgeries without the risks associated with real surgery. During a virtual simulation, AI can help surgeon develop their skills by using ML or other model to collect and analyze the data. Virtual practice is invaluable to both experienced surgeons and trainees as it increases their proficiency and confidence. In addition, these simulation systems can provide feedback to identify areas for improvement, thereby promoting continuous learning. Winkler-Schwartz et al. developed a checklist that provides a framework for the study of virtual reality surgical simulation and ML to bridge the knowledge gap between computer science and medicine and to facilitate the development of surgical education [20].

Abboudi et al. provided a systematic overview of several robotic surgery simulators available at the time, discussing the advantages and disadvantages of various platforms from different perspectives. They concluded that the combination of simulator and traditional training can be beneficial for the future training of robotic surgeons [21]. Lam et al. analyzed 66 studies related to the assessment of surgical technical skills using machine learning. Among these studies, 31 reported high accuracy in determining the performance of at least one task, highlighting the potential of ML-based surgical performance assessments and show that machine learning can accurately, reliably, and objectively track surgeon performance. The precise surgical performance assessment may be integrated into surgical training [22]. Mirchi et al. developed the Virtual Operative Assistant (VOA), an AI-driven tutoring system that provides learners with objective and automated feedback. This system integrates expertise classification, proficiency-based feedback, and instructor input into a cohesive learning framework [23]. Fazlollahi et al. compared remote expert guidance with the VOA tutoring system to determine which method better helps learners achieve higher performance in simulated training. They concluded that simulation surgery with feedback from the AI tutor was more effective than remote expert guidance [24]. Park et al. discussed the key facts of enhancing surgical simulation using AI-driven technologies. They summarized and discussed the current state of AI in surgical simulation and suggested future improvements in terms of technology, cost, and regulatory. According to their findings, the assessment of surgical skills using simulated tabletop tasks may not accurately reflect trainees' performance in operating room due to the complexity of real surgical environments [25].

Farah et al. evaluated the educational effectiveness of simulation-based models in resident spine surgery training and suggested enhancing simulator development to provide a list of intricate pathologies [26]. While many virtual environments effectively aid surgeons in training their surgical techniques, they are often not tailored for spinal surgery. AI algorithms still lack valid evaluation criteria to accurately assess participant performance. A large amount of surgical data is required to effectively train machine learning algorithms.

4. Summary

AI and robotics improve precision, accuracy, and safety in spine surgery. AI algorithms can analyze diagnostic images, predict complications, and optimize implant trajectories during preoperative planning. Robotic systems provide optimal screw placement and real-time feedback during surgery which is significantly reducing the risk of complications. In addition, simulations can allow surgeons to improve their skills in a risk-free environment. However, more data is required to evaluate the AI algorithms. The standardization of robotic surgery also needs to be clarified. Continued research and development are essential to solve these issues.


References

[1]. C. Zhang, M. S. Hallbeck, H. Salehinejad, and C. Thiels, “The integration of artificial intelligence in robotic surgery: A narrative review,” Surgery, Mar. 2024.

[2]. M. D’Souza, J. Gendreau, A. Feng, L. H. Kim, A. L. Ho, and A. Veeravagu, “RoboticAssisted Spine Surgery: History, Efficacy, Cost, And Future Trends,” Robotic Surgery: Research and Reviews, vol. 6, pp. 9–23, Nov. 2019.

[3]. D. M. McKenzie et al., “Robotics in spine surgery: A systematic review,” Journal of Clinical Neuroscience, vol. 89, pp. 1–7, Jul. 2021.

[4]. F. Galbusera, G. Casaroli, and T. Bassani, “Artificial intelligence and machine learning in spine research,” JOR SPINE, vol. 2, no. 1, p. e1044, 2019.

[5]. S. Zhou et al., “The application of artificial intelligence in spine surgery,” Front. Surg., vol. 9, Aug. 2022.

[6]. J. J. Rasouli, J. Shao, S. Neifert, W. N. Gibbs, G. Habboub, M. P. Steinmetz, and T. E. Mroz, "Artificial intelligence and robotics in spine surgery," Global Spine Journal, vol. 11, no. 4, pp. 556-564, 2021.

[7]. A. Suri, et al., "A deep learning system for automated, multi-modality 2D segmentation of vertebral bodies and intervertebral discs," Bone, vol. 149, p. 115972, 2021.

[8]. Y. Fang, et al., "Opportunistic osteoporosis screening in multi-detector CT images using deep convolutional neural networks," European Radiology, vol. 31, pp. 1831-1842, 2021.

[9]. A. Jamaludin, T. Kadir, and A. Zisserman, "SpineNet: automated classification and evidence visualization in spinal MRIs," Medical Image Analysis, vol. 41, pp. 63-73, 2017.

[10]. R. Pal, et al., "Lumbar Spine Tumor Segmentation and Localization in T2 MRI Images Using AI," arXiv preprint arXiv:2405.04023, 2024.

[11]. C. Chu, et al., "Fully automatic localization and segmentation of 3D vertebral bodies from CT/MR images via a learning-based method," PloS One, vol. 10, no. 11, p. e0143327, 2015.

[12]. G. A. Elsayed et al., “Spatial Computing for preoperative planning and postoperative evaluation of single-position lateral approaches in spinal revision surgery,” Journal of Craniovertebral Junction and Spine, vol. 14, no. 2, p. 208, Jun. 2023.

[13]. W. Wi, S.-M. Park, and B.-S. Shin, "Computed tomography-based preoperative simulation system for pedicle screw fixation in spinal surgery," Journal of Korean Medical Science, vol. 35, no. 18, 2020.

[14]. C. Ma, et al., "A novel surgical planning system using an AI model to optimize planning of pedicle screw trajectories with highest bone mineral density and strongest pullout force," Neurosurgical Focus, vol. 52, no. 4, p. E10, 2022.

[15]. S. Jia, et al., "Performance evaluation of an AI-based preoperative planning software application for automatic selection of pedicle screws based on computed tomography images," Frontiers in Surgery, vol. 10, p. 1247527, 2023.

[16]. I. H. Lieberman, S. Kisinde, and S. Hesselbacher, “Robotic-Assisted Pedicle Screw Placement During Spine Surgery,” JBJS Essential Surgical Techniques, vol. 10, no. 2, p. e0020, Jun. 2020.

[17]. N. Fatima, E. Massaad, M. Hadzipasic, G. M. Shankar, and J. H. Shin, “Safety and accuracy of robot-assisted placement of pedicle screws compared to conventional free-hand technique: a systematic review and meta-analysis,” The Spine Journal, vol. 21, no. 2, pp. 181–192, Feb. 2021.

[18]. A. K. Ahmed et al., “First spine surgery utilizing real-time image-guided robotic assistance,” Computer Assisted Surgery, vol. 24, no. 1, pp. 13–17, Jan. 2019.

[19]. Y. Ao, et al., "Safe Deep RL for Intraoperative Planning of Pedicle Screw Placement," arXiv preprint arXiv:2305.05354, 2023.

[20]. A. Winkler-Schwartz, et al., "Artificial intelligence in medical education: best practices using machine learning to assess surgical expertise in virtual reality simulation," Journal of Surgical Education, vol. 76, no. 6, pp. 1681-1690, 2019.

[21]. H. Abboudi, et al., "Current status of validation for robotic surgery simulators–a systematic review," BJU International, vol. 111, no. 2, pp. 194-205, 2013.

[22]. K. Lam et al., “Machine learning for technical skill assessment in surgery: a systematic review,” npj Digit. Med., vol. 5, no. 1, pp. 1–16, Mar. 2022.

[23]. N. Mirchi, et al., "The Virtual Operative Assistant: An explainable artificial intelligence tool for simulation-based training in surgery and medicine," PloS One, vol. 15, no. 2, p. e0229596, 2020.

[24]. A. M. Fazlollahi, et al., "Effect of artificial intelligence tutoring vs expert instruction on learning simulated surgical skills among medical students: a randomized clinical trial," JAMA Network Open, vol. 5, no. 2, pp. e2149008-e2149008, 2022.

[25]. J. J. Park, J. Tiefenbach, and A. K. Demetriades, “The role of artificial intelligence in surgical simulation,” Front. Med. Technol., vol. 4, Dec. 2022.

[26]. G. J. Farah et al., “Resident Training in Spine Surgery: A Systematic Review of Simulation-Based Educational Models” World Neurosurgery, vol. 174, pp. 81–115, Jun. 2023.


Cite this article

Wang,S. (2024). Application of AI integrated semi-autonomous robotics in spine surgery: A review. Applied and Computational Engineering,71,231-235.

Data availability

The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.

Disclaimer/Publisher's Note

The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

About volume

Volume title: Proceedings of the 6th International Conference on Computing and Data Science

ISBN:978-1-83558-481-1(Print) / 978-1-83558-482-8(Online)
Editor:Alan Wang, Roman Bauer
Conference website: https://www.confcds.org/
Conference date: 12 September 2024
Series: Applied and Computational Engineering
Volume number: Vol.71
ISSN:2755-2721(Print) / 2755-273X(Online)

© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license. Authors who publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See Open access policy for details).

References

[1]. C. Zhang, M. S. Hallbeck, H. Salehinejad, and C. Thiels, “The integration of artificial intelligence in robotic surgery: A narrative review,” Surgery, Mar. 2024.

[2]. M. D’Souza, J. Gendreau, A. Feng, L. H. Kim, A. L. Ho, and A. Veeravagu, “RoboticAssisted Spine Surgery: History, Efficacy, Cost, And Future Trends,” Robotic Surgery: Research and Reviews, vol. 6, pp. 9–23, Nov. 2019.

[3]. D. M. McKenzie et al., “Robotics in spine surgery: A systematic review,” Journal of Clinical Neuroscience, vol. 89, pp. 1–7, Jul. 2021.

[4]. F. Galbusera, G. Casaroli, and T. Bassani, “Artificial intelligence and machine learning in spine research,” JOR SPINE, vol. 2, no. 1, p. e1044, 2019.

[5]. S. Zhou et al., “The application of artificial intelligence in spine surgery,” Front. Surg., vol. 9, Aug. 2022.

[6]. J. J. Rasouli, J. Shao, S. Neifert, W. N. Gibbs, G. Habboub, M. P. Steinmetz, and T. E. Mroz, "Artificial intelligence and robotics in spine surgery," Global Spine Journal, vol. 11, no. 4, pp. 556-564, 2021.

[7]. A. Suri, et al., "A deep learning system for automated, multi-modality 2D segmentation of vertebral bodies and intervertebral discs," Bone, vol. 149, p. 115972, 2021.

[8]. Y. Fang, et al., "Opportunistic osteoporosis screening in multi-detector CT images using deep convolutional neural networks," European Radiology, vol. 31, pp. 1831-1842, 2021.

[9]. A. Jamaludin, T. Kadir, and A. Zisserman, "SpineNet: automated classification and evidence visualization in spinal MRIs," Medical Image Analysis, vol. 41, pp. 63-73, 2017.

[10]. R. Pal, et al., "Lumbar Spine Tumor Segmentation and Localization in T2 MRI Images Using AI," arXiv preprint arXiv:2405.04023, 2024.

[11]. C. Chu, et al., "Fully automatic localization and segmentation of 3D vertebral bodies from CT/MR images via a learning-based method," PloS One, vol. 10, no. 11, p. e0143327, 2015.

[12]. G. A. Elsayed et al., “Spatial Computing for preoperative planning and postoperative evaluation of single-position lateral approaches in spinal revision surgery,” Journal of Craniovertebral Junction and Spine, vol. 14, no. 2, p. 208, Jun. 2023.

[13]. W. Wi, S.-M. Park, and B.-S. Shin, "Computed tomography-based preoperative simulation system for pedicle screw fixation in spinal surgery," Journal of Korean Medical Science, vol. 35, no. 18, 2020.

[14]. C. Ma, et al., "A novel surgical planning system using an AI model to optimize planning of pedicle screw trajectories with highest bone mineral density and strongest pullout force," Neurosurgical Focus, vol. 52, no. 4, p. E10, 2022.

[15]. S. Jia, et al., "Performance evaluation of an AI-based preoperative planning software application for automatic selection of pedicle screws based on computed tomography images," Frontiers in Surgery, vol. 10, p. 1247527, 2023.

[16]. I. H. Lieberman, S. Kisinde, and S. Hesselbacher, “Robotic-Assisted Pedicle Screw Placement During Spine Surgery,” JBJS Essential Surgical Techniques, vol. 10, no. 2, p. e0020, Jun. 2020.

[17]. N. Fatima, E. Massaad, M. Hadzipasic, G. M. Shankar, and J. H. Shin, “Safety and accuracy of robot-assisted placement of pedicle screws compared to conventional free-hand technique: a systematic review and meta-analysis,” The Spine Journal, vol. 21, no. 2, pp. 181–192, Feb. 2021.

[18]. A. K. Ahmed et al., “First spine surgery utilizing real-time image-guided robotic assistance,” Computer Assisted Surgery, vol. 24, no. 1, pp. 13–17, Jan. 2019.

[19]. Y. Ao, et al., "Safe Deep RL for Intraoperative Planning of Pedicle Screw Placement," arXiv preprint arXiv:2305.05354, 2023.

[20]. A. Winkler-Schwartz, et al., "Artificial intelligence in medical education: best practices using machine learning to assess surgical expertise in virtual reality simulation," Journal of Surgical Education, vol. 76, no. 6, pp. 1681-1690, 2019.

[21]. H. Abboudi, et al., "Current status of validation for robotic surgery simulators–a systematic review," BJU International, vol. 111, no. 2, pp. 194-205, 2013.

[22]. K. Lam et al., “Machine learning for technical skill assessment in surgery: a systematic review,” npj Digit. Med., vol. 5, no. 1, pp. 1–16, Mar. 2022.

[23]. N. Mirchi, et al., "The Virtual Operative Assistant: An explainable artificial intelligence tool for simulation-based training in surgery and medicine," PloS One, vol. 15, no. 2, p. e0229596, 2020.

[24]. A. M. Fazlollahi, et al., "Effect of artificial intelligence tutoring vs expert instruction on learning simulated surgical skills among medical students: a randomized clinical trial," JAMA Network Open, vol. 5, no. 2, pp. e2149008-e2149008, 2022.

[25]. J. J. Park, J. Tiefenbach, and A. K. Demetriades, “The role of artificial intelligence in surgical simulation,” Front. Med. Technol., vol. 4, Dec. 2022.

[26]. G. J. Farah et al., “Resident Training in Spine Surgery: A Systematic Review of Simulation-Based Educational Models” World Neurosurgery, vol. 174, pp. 81–115, Jun. 2023.