A Deep Learning based Human Detection and Tracking for Security Surveillance Systems

Tahira Irshad; Muhammad Asif; Arfa Hassan; Umair Bin Ahmad; Toqeer Mahmood; Rehan Ashraf; C.M. Nadeem Faisal

doi:10.54254/2755-2721/2/20220606

Research Article

Open access

Published on 22 March 2023

Download pdf

Irshad,T.;Asif,M.;Hassan,A.;Ahmad,U.B.;Mahmood,T.;Ashraf,R.;Faisal,C.N. (2023). A Deep Learning based Human Detection and Tracking for Security Surveillance Systems. Applied and Computational Engineering,2,541-549.

Export citation

A Deep Learning based Human Detection and Tracking for Security Surveillance Systems

Tahira Irshad ¹, Muhammad Asif ², Arfa Hassan ³, Umair Bin Ahmad ⁴, Toqeer Mahmood *^,5, Rehan Ashraf ⁶, C.M. Nadeem Faisal ⁷

¹ Department of Computer Science, Lahore Garrison University, Lahore, Pakistan
² Department of Computer Science, Lahore Garrison University, Lahore, Pakistan
³ Department of Computer Science, Lahore Garrison University, Lahore, Pakistan
⁴ Department of Computer Science, Lahore Garrison University, Lahore, Pakistan
⁵ Faculty of Computer Science, National Textile University, Faisalabad, Pakistan
⁶ Faculty of Computer Science, National Textile University, Faisalabad, Pakistan
⁷ Faculty of Computer Science, National Textile University, Faisalabad, Pakistan

* Author to whom correspondence should be addressed.

https://doi.org/10.54254/2755-2721/2/20220606

Abstract

All around the world, the crime rate has been increasing day by day, causing a rise in security issues. Closed-Circuit Television (CCTV) cameras have been installed throughout the world with the aim of decreasing crime and increasing public safety. The usage of CCTV cameras helps to increase crime detection accuracy significantly. Daily, a considerable amount of data has been recorded through CCTV cameras. Detection and recognition of culprits in the recorded data is a challenging task as it takes a lot of time, and human interaction is also involved. So, there is a need to develop a system that performs real-time detection and tracking of humans. This paper proposes a human detection and tracking system based on deep learning that assigns a unique ID to humans who enter the video scene. Multi-Task Cascaded Convolutional Neural Networks (MTCNN) and FaceNet models are used to achieve the desired target. The MTCNN model is trained on the WIDER SPACE dataset to perform human detection. FaceNet is used for human identification that is trained on the LFW dataset. The proposed system has been evaluated on 50 video sequences captured in different environments and achieved 97% average accuracy.

Keywords

CCTV, FaceNet, human detection, tracking, security and surveillance, MTCNN

View pdf

References

[1]. Jonathan, O. E., Olusola, A. J., Bernadin, T. C. A., & Inoussa, T. M. (2021). Impacts of Crime on Socio-Economic Development. Mediterranean Journal of Social Sciences, 12(5), 71-71.

[2]. Ul Haq, H. B., Asif, M., Ahmad, M. B., Ashraf, R., & Mahmood, T. (2022). An Effective Video Summarization Framework Based on the Object of Interest Using Deep Learning. Mathematical Problems in Engineering, 2022.

[3]. Taylor, R. B. (1995). The impact of crime on communities. The Annals of the American Academy of Political and Social Science, 539(1), 28-45.

[4]. Abbas, S., Shouping, L., Sidra, F., & Sharif, A. (2018). Impact of Crime on Socio-Economic Development: A Study of Karachi. Malaysian Journal of Social Sciences and Humanities (MJSSH), 3(3), 148-159.

[5]. Gajjar, V., Gurnani, A., & Khandhediya, Y. (2017). Human detection and tracking for video surveillance: A cognitive science approach. In Proceedings of the IEEE international con-ference on computer vision workshops (pp. 2805-2809).

[6]. Harrendorf, S., & Heiskanen, M. (2010). International statistics on crime and justice. S. Malby (Ed.). Helsinki: European Institute for Crime Prevention and Control, affiliated with the United Nations (HEUNI).

[7]. La Vigne, N. G., Lowry, S. S., Dwyer, A. M., & Markman, J. A. (2011). Using public surveil-lance systems for crime control and prevention: A practical guide for law enforcement and their municipal partners.

[8]. Space and Naval Warfare Systems Center Atlantic, (2013). System Assessment and Validation for Emergency Responders (SAVER) Handbook: CCTV Technology.

[9]. Stelfox, P. (2013). Criminal investigation: An introduction to principles and practice. Willan., DOI: 10.4324/9781315880730.

[10]. Ashiq, F., Asif, M., Ahmad, M. B., Zafar, S., Masood, K., Mahmood, T., ... & Lee, I. H. (2022). CNN-based object recognition and tracking system to assist visually impaired people. IEEE Access, 10, 14819-14834.

[11]. Visakha, K., & Prakash, S. S. (2018, July). Detection and tracking of human beings in a video using haar classifier. In 2018 International Conference on Inventive Research in Computing Applications (ICIRCA) (pp. 1-4). IEEE.

[12]. Jin, K., Xie, X., Wang, F., Han, X., & Shi, G. (2019, July). Human Identification Recognition in Surveillance Videos. In 2019 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) (pp. 162-167). IEEE.

[13]. Ojha, S., & Sakhare, S. (2015, January). Image processing techniques for object tracking in video surveillance-A survey. In 2015 International Conference on Pervasive Computing (ICPC) (pp. 1-6). IEEE.

[14]. Prabhakar, G., & Ramasubramanian, B. (2012). An efficient approach for real time tracking of intruder and abandoned object in video surveillance system. International Journal of Com-puter Applications, 54(17), 22-27.

[15]. Akama, S., Matsufuji, A., Sato-Shimokawara, E., Yamamoto, S., & Yamaguchi, T. (2018, No-vember). Successive Human Tracking and Posture Estimation with Multiple Omnidirection-al Cameras. In 2018 Conference on Technologies and Applications of Artificial Intelligence (TAAI) (pp. 46-49). IEEE.

[16]. Chang, K. C., & Liu, P. K. (2017, October). Design and optimization of multiple heads detec-tion for embedded system. In 2017 IEEE 6th Global Conference on Consumer Electronics (GCCE) (pp. 1-2). IEEE.

[17]. Kang, B. D., Jeon, K. H., Kyoung, D., Kim, S. H., & Hwang, J. H. (2011, October). Multiple human body tracking using the fusion of CCD and thermal image sensor. In 2011 IEEE Ap-plied Imagery Pattern Recognition Workshop (AIPR) (pp. 1-4). IEEE.

[18]. D Dinama, D. M., A’yun, Q., Syahroni, A. D., Sulistijono, I. A., & Risnumawan, A. (2019, September). Human detection and tracking on surveillance video footage using convolu-tional neural networks. In 2019 International Electronics Symposium (IES) (pp. 534-538). IEEE.

[19]. Shehzed, A., Jalal, A., & Kim, K. (2019, August). Multi-person tracking in smart surveillance system for crowd counting and normal/abnormal events detection. In 2019 international conference on applied and engineering mathematics (ICAEM) (pp. 163-168). IEEE.

[20]. Jin, K., Xie, X., Wang, F., Han, X., & Shi, G. (2019, July). Human Identification Recognition in Surveillance Videos. In 2019 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) (pp. 162-167). IEEE.

[21]. Othman, N. A., & Aydin, I. (2017, September). A new IoT combined body detection of people by using computer vision for security application. In 2017 9th International Conference on Computational Intelligence and Communication Networks (CICN) (pp. 108-112). IEEE.

[22]. Liu, W., Camps, O., & Sznaier, M. (2017). Multi-camera multi-object tracking. arXiv preprint arXiv:1709.07065, doi: 10.48550/arxiv.1709.07065.

[23]. Ko, M., Kim, S., Lee, K., Kim, M., & Kim, K. (2017, August). Single camera based 3D track-ing for outdoor fall detection toward smart healthcare. In 2017 2nd International Conference on Bio-engineering for Smart Technologies (BioSMART) (pp. 1-4). IEEE.

[24]. Zhang, K., Zhang, Z., Li, Z., & Qiao, Y. (2016). Joint face detection and alignment using mul-titask cascaded convolutional networks. IEEE signal processing letters, 23(10), 1499-1503.

[25]. Schroff, F., Kalenichenko, D., & Philbin, J. (2015). Facenet: A unified embedding for face recognition and clustering. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 815-823).

[26]. Ali, M., Asghar, M. Z., Shah, M., & Mahmood, T. (2022). A simple and effective sub-image separation method. Multimedia Tools and Applications, 81(11), 14893-14910.

[27]. Mahmood, T., Shah, M., Rashid, J., Saba, T., Nisar, M. W., & Asif, M. (2020). A passive technique for detecting copy-move forgeries by image feature matching. Multimedia Tools and Applications, 79(43), 31759-31782.

[28]. Asif, M., Bin Ahmad, M., Mushtaq, S., Masood, K., Mahmood, T., & Ali Nagra, A. (2021). Long multi-digit number recognition from images empowered by deep convolutional neural networks. The Computer Journal.

[29]. Hussain, A., Asif, M., Ahmad, M. B., Mahmood, T., & Raza, M. A. (2022). Malware Detec-tion Using Machine Learning Algorithms for Windows Platform. In Proceedings of Interna-tional Conference on Information Technology and Applications (pp. 619-632). Springer, Singapore.

[30]. Javed, S. H., Ahmad, M. B., Asif, M., Almotiri, S. H., Masood, K., & Ghamdi, M. A. A. (2022). An Intelligent System to Detect Advanced Persistent Threats in Industrial Internet of Things (I-IoT). Electronics, 11(5), 742.

Cite this article

Data availability

The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.

Disclaimer/Publisher's Note

The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

About volume

Volume title: Proceedings of the 4th International Conference on Computing and Data Science (CONF-CDS 2022)

Conference website: https://www.confcds.org/

ISBN：978-1-915371-19-5(Print) / 978-1-915371-20-1(Online)

Conference date: 16 July 2022

Editor：Alan Wang

Series: Applied and Computational Engineering

Volume number: Vol.2

ISSN：2755-2721(Print) / 2755-273X(Online)

© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license. Authors who publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See Open access policy for details).