Download pdf
Research on endoscopic surgery based on SLAM
- 1 Harbin Institute of Technology (Weihai Campus)
* Author to whom correspondence should be addressed.
Abstract
The Simultaneous Localization and Mapping (SLAM) method is widely used in the positioning and mapping of robots. In the medical field, SLAM is used in auxiliary medical robots and surgical robots. In endoscopic surgery, SLAM performs endoscopic positioning and scene graph construction for the surgical environment based on the information collected by the endoscope. For research on endoscopic SLAM, this article will first introduce the application of SLAM in endoscopic surgery in recent years. This paper summarizes the innovations and future work of relevant literature in recent years and identifies existing problems in SLAM in endoscopic surgery. Next, this article will introduce the combination of deep learning and SLAM in endoscopic surgery and list some specific applications. Finally, this paper will give a prospect for the future application of SLAM in endoscopic surgery. The research in this paper will be of great value to applying SLAM in endoscopic surgery and conducive to the development of future endoscopic SLAM.
Keywords
endoscopy, SLAM, surgery.
[1]. Gao, X. (2017). 14 Lectures on Visual SLAM: From Theory to Practice. (Beijing: Publishing House of Electronics Industry)
[2]. Huo, J., Zhou, C., Yuan, B., Yang, Q., & Wang, L. (2023). Real-Time Dense Reconstruction with Binocular Endoscopy Based on StereoNet and ORB-SLAM. Sensors, 23(4), 2074. https://doi.org/10.3390/s23042074
[3]. Gomez Rodriguez, J. J., Montiel, J. M. M., & Tardos, J. D. (2022). Tracking monocular camera pose and deformation for SLAM inside the human body. 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 5278–5285. https://doi.org/10.1109/IROS47612.2022.9981203
[4]. Batlle, V. M., Montiel, J. M. M., & Tardos, J. D. (2022). Photometric single-view dense 3D reconstruction in endoscopy. 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 4904–4910. https://doi.org/10.1109/IROS47612.2022.9981742
[5]. Liu, X., Li, Z., Ishii, M., Hager, G. D., Taylor, R. H., & Unberath, M. (2022). SAGE: SLAM with Appearance and Geometry Prior for Endoscopy. 2022 International Conference on Robotics and Automation (ICRA), 5587–5593. https://doi.org/10.1109/ICRA46639.2022.9812257
[6]. Yang, Z., Pan, J., Li, R., & Qin, H. (2022). Scene-graph-driven semantic feature matching for monocular digestive endoscopy. Computers in Biology and Medicine, 146, 105616. https://doi.org/10.1016/j.compbiomed.2022.105616
[7]. Wu, H., Zhao, J., Xu, K., Zhang, Y., Xu, R., Wang, A., & Iwahori, Y. (2022). Semantic SLAM Based on Deep Learning in Endocavity Environment. Symmetry, 14(3), 614. https://doi.org/10.3390/sym14030614
[8]. Recasens, D., Lamarca, J., Facil, J. M., Montiel, J. M. M., & Civera, J. (2021). Endo-Depth-and-Motion: Reconstruction and Tracking in Endoscopic Videos Using Depth Networks and Photometric Constraints. IEEE Robotics and Automation Letters, 6(4), 7225–7232. https://doi.org/10.1109/LRA.2021.3095528
[9]. Lamarca, J., Parashar, S., Bartoli, A., & Montiel, J. M. M. (2021). DefSLAM: Tracking and Mapping of Deforming Scenes From Monocular Sequences. IEEE Transactions on Robotics, 37(1), 291–303. https://doi.org/10.1109/TRO.2020.3020739
[10]. Xie, C., Yao, T., Wang, J., & Liu, Q. (2020). Endoscope localization and gastrointestinal feature map construction based on monocular SLAM technology. Journal of Infection and Public Health, 13(9), 1314–1321. https://doi.org/10.1016/j.jiph.2019.06.028
[11]. Yang, Y., Shao, S., Yang, T., Wang, P., Yang, Z., Wu, C., & Liu, H. (2023). A geometry-aware deep network for depth estimation in monocular endoscopy. Engineering Applications of Artificial Intelligence, 122, 105989. https://doi.org/10.1016/j.engappai.2023.105989
[12]. Ali, S. (2022). Where do we stand in AI for endoscopic image analysis? Deciphering gaps and future directions. Npj Digital Medicine, 5(1), 184. https://doi.org/10.1038/s41746-022-00733-3
Cite this article
Zhang,Z. (2023). Research on endoscopic surgery based on SLAM. Applied and Computational Engineering,12,58-64.
Data availability
The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.
Disclaimer/Publisher's Note
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
About volume
Volume title: Proceedings of the 2023 International Conference on Mechatronics and Smart Systems
© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and
conditions of the Creative Commons Attribution (CC BY) license. Authors who
publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons
Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this
series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published
version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial
publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and
during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See
Open access policy for details).