Emotion-Based Music Movie and TV Series Recommendation System Using Deep Learning Algorithm

Research Article
Open access

Emotion-Based Music Movie and TV Series Recommendation System Using Deep Learning Algorithm

D. Deepa 1* D.M. Vijayalakshmi 2, B. Shanmathi 3, A.Sherlip Evelin 4, K.Tamil Elakkiya 5
  • 1 Department of Computer Science and Engineering, Kongu    
  • 2 Department of Computer Science and Engineering, Kongu    
  • 3 Department of Computer Science and Engineering, Kongu    
  • 4 Department of Computer Science and Engineering, Kongu    
  • 5 Department of Computer Science and Engineering, Kongu    
  • *corresponding author deepadresearch@gmail.com
Published on 22 March 2023 | https://doi.org/10.54254/2755-2721/2/20220656
ACE Vol.2
ISSN (Print): 2755-273X
ISSN (Online): 2755-2721
ISBN (Print): 978-1-915371-19-5
ISBN (Online): 978-1-915371-20-1

Abstract

It can be challenging to decide which music or movies to listen to from a huge number of options. The major purpose of our music and movie recommendation system is to provide clients with selections that fit their tastes. An assessment of a user's facial expression may provide insight into their current emotional or mental state. More than 60% of users anticipate that the number of songs in their music collection will grow to the point where they will be unable to find the song they need to play at some point in the future. It is feasible to assist a user in picking which music or movie to listen to or watch, by building a suggestion system. The face of the user is detected using the webcam. The snapshot of the user is taken based on their mood or feeling. It recognizes six facial expressions: angry, sad, fearful, joyful, surprised, and neutral. Based on the expression classification, the users are given three categories of recommendation as movies, music, or series based on their feelings. Seven different human facial expressions are classified using the Convolutional Neural Network (CNN) model. The Haar Cascade is an Object Detection Algorithm for recognizing faces in images and real-time video.

Keywords:

Haar Cascade Frontal Face Classifier., Convolutional Neural Network, H5 Model

Deepa,D.;Vijayalakshmi,D.;Shanmathi,B.;Evelin,A.;Elakkiya,K. (2023). Emotion-Based Music Movie and TV Series Recommendation System Using Deep Learning Algorithm. Applied and Computational Engineering,2,360-367.
Export citation

References

[1]. Carla Viegas "Two-stage emotion recognition using Frame level and Video level Features", 15th IEEE International Conference on Automatic Face and Gesture Recognition, pp.912-915,2020.

[2]. Renuka R. Londhe, Vrushshen P. Pawar "Analysis of Facial Expression and Recognition Based on Statistical Approach", International Journal of Soft Computing and Engineer-ing((IJSCE), vol.2, pp.391-394,2012.

[3]. Varsha Verma, Ninad Marathe, Parth Sanghavi, Dr. Prashant Nitnaware “Music Recommenda-tion System Using Machine Learning”, International Journal of Scientific Research, vol.7, no.6, pp.80-88, 2021.

[4]. Ibrahim A. Adeyanju and Elijah “Performance Evaluation of Different Support Vector Machine Kernels for Facial Emotion Recognition”, SAI Intelligent Systems Conference, vol.6, pp.804-806, 2015.

[5]. F. Kong, “Facial Expression Recognition Method based on Deep Convolutional Neural Net-work Combined with Improved LBP Features”, Personal and Ubiquitous Computing, vol.23, no.4, pp.531-539,2019.

[6]. Hongli Zhang, Alireza Jolfaei and Mamoun Alazab. “A Face Emotion Recognition Method Using Convolutional Neural Network an Image Edge Computing”, 2949741,2019.

[7]. Lu Lingling Liu, “Human Face Expression Recognition Based on Deep Learning-Deep Convo-lutional Neural Network”, 2019 International Conference on Smart Grid and Electrical Au-tomation (ICSGEA).

[8]. Sharmeen S. Saleem Abdullah,Siddeeq Y. Ameen,Mohammed A. M. Sadeeq, Subhi R. M.Zeebaree et al, “Multimodal Emotion Recognition Using Deep Learning ,” International Journal of Information Management, vol.02, No. 02, pp.52-58,2021.

[9]. Lee, J., Shin, S., Jang, D., Jang, S. J., & Yoon, K. (2015, January). Music recommendation system based on usage history and automatic genre classification. In Consumer Electronics (ICCE), IEEE International Conference pp. 134-135,2015.

[10]. S. H. Chang, A. Abdul, J. Chen, and H. Y. Liao, “A personalized music recommendation sys-tem using convolutional neural networks approach”. IEEE International Conference on Ap-plied System Invention (ICASI), pp. 47-49,2018,

[11]. Wahsheh, Heider AM, and Mohammed S. Al-Zahrani. "Secure real-time computational intelli-gence system against malicious QR code links." International Journal of Computers, Com-munications and Control 16.3 (2021).

[12]. Sathishkumar V E, Changsun Shin, Youngyun Cho, “Efficient energy consumption prediction model for a data analytic-enabled industry building in a smart city”, Building Research & Information, Vol. 49. no. 1, pp. 127-143, 2021.

[13]. Sathishkumar V E, Youngyun Cho, “A rule-based model for Seoul Bike sharing demand pre-diction using Weather data”, European Journal of Remote Sensing, Vol. 52, no. 1, pp. 166-183, 2020.

[14]. Sathishkumar V E, Jangwoo Park, Youngyun Cho, “Seoul Bike Trip duration prediction using data mining techniques”, IET Intelligent Transport Systems, Vol. 14, no. 11, pp. 1465-1474, 2020.

[15]. Sathishkumar V E, Jangwoo Park, Youngyun Cho, “Using data mining techniques for bike sharing demand prediction in Metropolitan city”, Computer Communications, Vol. 153, pp. 353-366, 2020.

[16]. Sathishkumar V E, Yongyun Cho, “Season wise bike sharing demand analysis using random forest algorithm”, Computational Intelligence, pp. 1-26, 2020.

[17]. Sathishkumar, V. E., Wesam Atef Hatamleh, Abeer Ali Alnuaim, Mohamed Abdelhady, B. Venkatesh, and S. Santhoshkumar. "Secure Dynamic Group Data Sharing in Semi-trusted Third Party Cloud Environment." Arabian Journal for Science and Engineering (2021): 1-9.

[18]. Chen, J., Shi, W., Wang, X., Pandian, S., & Sathishkumar, V. E. (2021). Workforce optimisa-tion for improving customer experience in urban transportation using heuristic mathematical model. International Journal of Shipping and Transport Logistics, 13(5), 538-553.

[19]. Pavithra, E., Janakiramaiah, B., Narasimha Prasad, L. V., Deepa, D., Jayapandian, N., & Sathishkumar, V. E., Visiting Indian Hospitals Before, During and After Covid. Interna-tional Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 30 (1), 111-123, 2022.

[20]. Easwaramoorthy, S., Moorthy, U., Kumar, C. A., Bhushan, S. B., & Sadagopan, V. (2017, January). Content based image retrieval with enhanced privacy in cloud using apache spark. In International Conference on Data Science Analytics and Applications (pp. 114-128). Springer, Singapore.

[21]. Sathishkumar, V. E., Agrawal, P., Park, J., & Cho, Y. (2020, April). Bike Sharing Demand Prediction Using Multiheaded Convolution Neural Networks. In Basic & Clinical Pharma-cology & Toxicology (Vol. 126, pp. 264-265). 111 RIVER ST, HOBOKEN 07030-5774, NJ USA: WILEY.

[22]. Subramanian, M., Shanmuga Vadivel, K., Hatamleh, W. A., Alnuaim, A. A., Abdelhady, M., & VE, S. (2021). The role of contemporary digital tools and technologies in Covid‐19 cri-sis: An exploratory analysis. Expert systems.

[23]. Babu, J. C., Kumar, M. S., Jayagopal, P., Sathishkumar, V. E., Rajendran, S., Kumar, S., ... & Mahseena, A. M. (2022). IoT-Based Intelligent System for Internal Crack Detection in Building Blocks. Journal of Nanomaterials, 2022.

[24]. Subramanian, M., Kumar, M. S., Sathishkumar, V. E., Prabhu, J., Karthick, A., Ganesh, S. S., & Meem, M. A. (2022). Diagnosis of retinal diseases based on Bayesian optimization deep learning network using optical coherence tomography images. Computational Intelligence and Neuroscience, 2022.

[25]. Liu, Y., Sathishkumar, V. E., & Manickam, A. (2022). Augmented reality technology based on school physical education training. Computers and Electrical Engineering, 99, 107807.

[26]. Sathishkumar, V. E., Rahman, A. B. M., Park, J., Shin, C., & Cho, Y. (2020, April). Using machine learning algorithms for fruit disease classification. In Basic & clinical pharmacolo-gy & toxicology (Vol. 126, pp. 253-253). 111 RIVER ST, HOBOKEN 07030-5774, NJ USA: WILEY.

[27]. Sathishkumar, V. E., Venkatesan, S., Park, J., Shin, C., Kim, Y., & Cho, Y. (2020, April). Nutrient water supply prediction for fruit production in greenhouse environment using artifi-cial neural networks. In Basic & Clinical Pharmacology & Toxicology (Vol. 126, pp. 257-258). 111 RIVER ST, HOBOKEN 07030-5774, NJ USA: WILEY.

[28]. Sathishkumar, V. E., & Cho, Y. (2019, December). Cardiovascular disease analysis and risk assessment using correlation based intelligent system. In Basic & clinical pharmacology & toxicology (Vol. 125, pp. 61-61). 111 RIVER ST, HOBOKEN 07030-5774, NJ USA: WILEY.

[29]. Kotha, S. K., Rani, M. S., Subedi, B., Chunduru, A., Karrothu, A., Neupane, B., & Sathish-kumar, V. E. (2021). A comprehensive review on secure data sharing in cloud environment. Wireless Personal Communications, 1-28.

Cite this article

Deepa,D.;Vijayalakshmi,D.;Shanmathi,B.;Evelin,A.;Elakkiya,K. (2023). Emotion-Based Music Movie and TV Series Recommendation System Using Deep Learning Algorithm. Applied and Computational Engineering,2,360-367.

Data availability

The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.

Disclaimer/Publisher's Note

The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

About volume

Volume title: Proceedings of the 4th International Conference on Computing and Data Science (CONF-CDS 2022)

ISBN：978-1-915371-19-5(Print) / 978-1-915371-20-1(Online)
Editor：Alan Wang
Conference website: https://www.confcds.org/
Conference date: 16 July 2022
Series: Applied and Computational Engineering
Volume number: Vol.2
ISSN：2755-2721(Print) / 2755-273X(Online)

© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license. Authors who publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See Open access policy for details).

References

[1]. Carla Viegas "Two-stage emotion recognition using Frame level and Video level Features", 15th IEEE International Conference on Automatic Face and Gesture Recognition, pp.912-915,2020.

[2]. Renuka R. Londhe, Vrushshen P. Pawar "Analysis of Facial Expression and Recognition Based on Statistical Approach", International Journal of Soft Computing and Engineer-ing((IJSCE), vol.2, pp.391-394,2012.

[3]. Varsha Verma, Ninad Marathe, Parth Sanghavi, Dr. Prashant Nitnaware “Music Recommenda-tion System Using Machine Learning”, International Journal of Scientific Research, vol.7, no.6, pp.80-88, 2021.

[4]. Ibrahim A. Adeyanju and Elijah “Performance Evaluation of Different Support Vector Machine Kernels for Facial Emotion Recognition”, SAI Intelligent Systems Conference, vol.6, pp.804-806, 2015.

[5]. F. Kong, “Facial Expression Recognition Method based on Deep Convolutional Neural Net-work Combined with Improved LBP Features”, Personal and Ubiquitous Computing, vol.23, no.4, pp.531-539,2019.

[6]. Hongli Zhang, Alireza Jolfaei and Mamoun Alazab. “A Face Emotion Recognition Method Using Convolutional Neural Network an Image Edge Computing”, 2949741,2019.

[7]. Lu Lingling Liu, “Human Face Expression Recognition Based on Deep Learning-Deep Convo-lutional Neural Network”, 2019 International Conference on Smart Grid and Electrical Au-tomation (ICSGEA).

[8]. Sharmeen S. Saleem Abdullah,Siddeeq Y. Ameen,Mohammed A. M. Sadeeq, Subhi R. M.Zeebaree et al, “Multimodal Emotion Recognition Using Deep Learning ,” International Journal of Information Management, vol.02, No. 02, pp.52-58,2021.

[9]. Lee, J., Shin, S., Jang, D., Jang, S. J., & Yoon, K. (2015, January). Music recommendation system based on usage history and automatic genre classification. In Consumer Electronics (ICCE), IEEE International Conference pp. 134-135,2015.

[10]. S. H. Chang, A. Abdul, J. Chen, and H. Y. Liao, “A personalized music recommendation sys-tem using convolutional neural networks approach”. IEEE International Conference on Ap-plied System Invention (ICASI), pp. 47-49,2018,

[11]. Wahsheh, Heider AM, and Mohammed S. Al-Zahrani. "Secure real-time computational intelli-gence system against malicious QR code links." International Journal of Computers, Com-munications and Control 16.3 (2021).

[12]. Sathishkumar V E, Changsun Shin, Youngyun Cho, “Efficient energy consumption prediction model for a data analytic-enabled industry building in a smart city”, Building Research & Information, Vol. 49. no. 1, pp. 127-143, 2021.

[13]. Sathishkumar V E, Youngyun Cho, “A rule-based model for Seoul Bike sharing demand pre-diction using Weather data”, European Journal of Remote Sensing, Vol. 52, no. 1, pp. 166-183, 2020.

[14]. Sathishkumar V E, Jangwoo Park, Youngyun Cho, “Seoul Bike Trip duration prediction using data mining techniques”, IET Intelligent Transport Systems, Vol. 14, no. 11, pp. 1465-1474, 2020.

[15]. Sathishkumar V E, Jangwoo Park, Youngyun Cho, “Using data mining techniques for bike sharing demand prediction in Metropolitan city”, Computer Communications, Vol. 153, pp. 353-366, 2020.

[16]. Sathishkumar V E, Yongyun Cho, “Season wise bike sharing demand analysis using random forest algorithm”, Computational Intelligence, pp. 1-26, 2020.

[17]. Sathishkumar, V. E., Wesam Atef Hatamleh, Abeer Ali Alnuaim, Mohamed Abdelhady, B. Venkatesh, and S. Santhoshkumar. "Secure Dynamic Group Data Sharing in Semi-trusted Third Party Cloud Environment." Arabian Journal for Science and Engineering (2021): 1-9.

[18]. Chen, J., Shi, W., Wang, X., Pandian, S., & Sathishkumar, V. E. (2021). Workforce optimisa-tion for improving customer experience in urban transportation using heuristic mathematical model. International Journal of Shipping and Transport Logistics, 13(5), 538-553.

[19]. Pavithra, E., Janakiramaiah, B., Narasimha Prasad, L. V., Deepa, D., Jayapandian, N., & Sathishkumar, V. E., Visiting Indian Hospitals Before, During and After Covid. Interna-tional Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 30 (1), 111-123, 2022.

[20]. Easwaramoorthy, S., Moorthy, U., Kumar, C. A., Bhushan, S. B., & Sadagopan, V. (2017, January). Content based image retrieval with enhanced privacy in cloud using apache spark. In International Conference on Data Science Analytics and Applications (pp. 114-128). Springer, Singapore.

[21]. Sathishkumar, V. E., Agrawal, P., Park, J., & Cho, Y. (2020, April). Bike Sharing Demand Prediction Using Multiheaded Convolution Neural Networks. In Basic & Clinical Pharma-cology & Toxicology (Vol. 126, pp. 264-265). 111 RIVER ST, HOBOKEN 07030-5774, NJ USA: WILEY.

[22]. Subramanian, M., Shanmuga Vadivel, K., Hatamleh, W. A., Alnuaim, A. A., Abdelhady, M., & VE, S. (2021). The role of contemporary digital tools and technologies in Covid‐19 cri-sis: An exploratory analysis. Expert systems.

[23]. Babu, J. C., Kumar, M. S., Jayagopal, P., Sathishkumar, V. E., Rajendran, S., Kumar, S., ... & Mahseena, A. M. (2022). IoT-Based Intelligent System for Internal Crack Detection in Building Blocks. Journal of Nanomaterials, 2022.

[24]. Subramanian, M., Kumar, M. S., Sathishkumar, V. E., Prabhu, J., Karthick, A., Ganesh, S. S., & Meem, M. A. (2022). Diagnosis of retinal diseases based on Bayesian optimization deep learning network using optical coherence tomography images. Computational Intelligence and Neuroscience, 2022.

[25]. Liu, Y., Sathishkumar, V. E., & Manickam, A. (2022). Augmented reality technology based on school physical education training. Computers and Electrical Engineering, 99, 107807.

[26]. Sathishkumar, V. E., Rahman, A. B. M., Park, J., Shin, C., & Cho, Y. (2020, April). Using machine learning algorithms for fruit disease classification. In Basic & clinical pharmacolo-gy & toxicology (Vol. 126, pp. 253-253). 111 RIVER ST, HOBOKEN 07030-5774, NJ USA: WILEY.

[27]. Sathishkumar, V. E., Venkatesan, S., Park, J., Shin, C., Kim, Y., & Cho, Y. (2020, April). Nutrient water supply prediction for fruit production in greenhouse environment using artifi-cial neural networks. In Basic & Clinical Pharmacology & Toxicology (Vol. 126, pp. 257-258). 111 RIVER ST, HOBOKEN 07030-5774, NJ USA: WILEY.

[28]. Sathishkumar, V. E., & Cho, Y. (2019, December). Cardiovascular disease analysis and risk assessment using correlation based intelligent system. In Basic & clinical pharmacology & toxicology (Vol. 125, pp. 61-61). 111 RIVER ST, HOBOKEN 07030-5774, NJ USA: WILEY.

[29]. Kotha, S. K., Rani, M. S., Subedi, B., Chunduru, A., Karrothu, A., Neupane, B., & Sathish-kumar, V. E. (2021). A comprehensive review on secure data sharing in cloud environment. Wireless Personal Communications, 1-28.

For authors
Guide for authors Policies for authors Aims and scope Subscription Open access policy
For editors
Policies for editors Editorial board
For reviewers
Policies for reviewers Privacy policy

Cookies are used by this site.
Copyright © 2024 EWA Publishing, its licensors, and contributors. All rights reserved, including text and data mining, AI training, and similar technologies.