Download pdf
Procedural content generation for VR educational applications: The investigation of AI-based approaches for improving learning experience
- 1 University of Pennsylvania
* Author to whom correspondence should be addressed.
Abstract
In recent years, artificial intelligence (AI) has witnessed significant advancements in the field of education, with its ability to personalize and adapt content to individual student needs. In parallel, virtual reality (VR) has emerged as a powerful tutorial tool, providing immersive and interactive experiential learning experiences which has the advantages of improving students' motivation and engagement. Previous researchers have demonstrated the potential of ML algorithms, particularly RL, for generating educational content and VR environments. To create high-quality content, researchers have started exploring the integration of Machine Learning (ML) and Reinforcement Learning (RL) algorithms into Procedural Content Generation (PCG) methods for automatically generating both textual and non-textual content such as practice questions, quizzes, VR learning environments, etc., which have the potential to increase the efficiency and effectiveness of educational interventions. Nonetheless, the development of these techniques requires addressing several challenges. Significant advancements are yet to be made in developing and refining these algorithms to produce high-quality and effective educational content for VR applications. This article provides a comprehensive overview of the current state of research in reinforcement AI learning content generation for VR educational applications. For each area, it discusses the state-of-the-art techniques, applications, limitations, and challenges faced in development, covering the use of natural language processing, reinforcement learning, and machine learning algorithms. The review concludes by highlighting some of the key opportunities for future research in this field, including the development of more sophisticated models and the exploration of new applications of machine learning in educational technology.
Keywords
procedural content generation, reinforcement learning, machine learning, VR educational applications
[1]. Guttentag D A 2010 Virtual reality: Applications and implications for tourism Tourism management 31(5) 637-651
[2]. Choi S Jung K & Noh S D 2015 Virtual reality applications in manufacturing industries: Past research, present findings, and future directions. Concurrent Engineering 23(1) 40-63
[3]. Jensen L Konradsen F 2018 A review of the use of virtual reality head-mounted displays in education and training Education and Information Technologies 23 1515-1529
[4]. Kavanagh S Luxton-Reilly A Wuensche B Plimmer B 2017 A systematic review of virtual reality in education Themes in Science and Technology Education 10(2) 85-119
[5]. Dickey M D 2005 Brave new (interactive) worlds: A review of the design affordances and constraints of two 3D virtual worlds as interactive learning environments Interactive learning environments 13(1-2) 121-137
[6]. Dawley L Dede C 2014 Situated learning in virtual worlds and immersive simulations Handbook of research on educational communications and technology 723-734
[7]. Çaliskan O 2011 Virtual field trips in education of earth and environmental sciences Procedia-Social and Behavioral Sciences 15 3239-3243
[8]. Barata P N A et al 2015 Consolidating learning in power systems: Virtual reality applied to the study of the operation of electric power transformers IEEE Transactions on Education 58(4) 255-261
[9]. Witmer B G Singer M J 1998 Measuring presence in virtual environments: A presence questionnaire Presence 7(3) 225-240
[10]. Winn W et al 2002 When does immersion in a virtual environment help students construct understanding In Proceedings of the International Conference of the Learning Sciences, ICLS Vol. 206 pp. 497-503
[11]. Alhalabi W 2016 Virtual reality systems enhance students’ achievements in engineering education Behaviour & Information Technology,35(11) 919-925
[12]. Liu L et al 2009 Automated Generation of Example Contexts for Helping Children Learn Vocabulary In International Workshop on Speech and Language Technology in Education
[13]. Chen W Mostow J 2011 Using Automatic Question Generation to Evaluate Questions Generated by Children In 2011 AAAI Fall Symposium Series
[14]. Mostow J et al 2017 Developing, evaluating, and refining an automatic generator of diagnostic multiple choice cloze questions to assess children's comprehension while reading. Natural Language Engineering 23(2) 245-294
[15]. Mostow J et al 2015 Automatic Identification of Nutritious Contexts for Learning Vocabulary Words. International Educational Data Mining Society
[16]. Lopez C E et al 2019 Reinforcement learning content generation for virtual reality applications. In International Design Engineering Technical Conferences and Computers and Information in Engineering Conference Vol. 59179 p V001T02A009 American Society of Mechanical Engineers
[17]. López C E et al 2020 Deep reinforcement learning for procedural content generation of 3d virtual environments Journal of Computing and Information Science in Engineering 20(5)
[18]. Tsaramirsis G et al 2016 Towards simulation of the classroom learning experience: Virtual reality approach In 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom) pp 1343-1346 IEEE
[19]. Akçayır M et al 2017 Advantages and challenges associated with augmented reality for education: A systematic review of the literature Educational research review 20 1-11
[20]. Mikropoulos T A et al 2011 Educational virtual environments: A ten-year review of empirical research (1999–2009) Computers & education 56(3) 769-780
[21]. Arulkumaran K et al 2017 Deep reinforcement learning: A brief survey IEEE Signal Processing Magazine 34(6) 26-38
[22]. Mostow J Beck J 2006 Some useful tactics to modify, map and mine data from intelligent tutors. Natural Language Engineering 12(2) 195-208
[23]. Beck J E et al 2008 Does help help? Introducing the Bayesian Evaluation and Assessment methodology. In Intelligent Tutoring Systems: 9th International Conference, ITS 2008, Montreal Canada June 23-27 2008 Proceedings 9 pp. 383-394 Springer Berlin Heidelberg
[24]. Mostow J et al 1999 Giving help and praise in a reading tutor with imperfect listening—because automated speech recognition means never being able to say you're certain CALICO journal, 407-424
[25]. Kaelbling L P et al 1996 Reinforcement learning: A survey. Journal of artificial intelligence research 4 237-285
[26]. Xu X et al 2014 Reinforcement learning algorithms with function approximation: Recent advances and applications. Information sciences 261 1-31
[27]. Wang, P et al 2017 Interactive Narrative Personalization with Deep Reinforcement Learning In IJCAI pp 3852-3858
[28]. Rowe J et al 2018 Toward automated scenario generation with deep reinforcement learning in gift In Proceedings of the Sixth Annual GIFT User Symposium pp 65-74
[29]. Cunningham J et al 2020 Multi-context generation in virtual reality environments using deep reinforcement learning In International Design Engineering Technical Conferences and Computers and Information in Engineering Conference Vol 83983 p V009T09A072 American Society of Mechanical Engineers
[30]. Hullett K Mateas M 2009 Scenario generation for emergency rescue training games. In Proceedings of the 4th International Conference on Foundations of Digital Games pp 99-106
[31]. Smith A M et al 2012 A case study of expressively constrainable level design automation tools for a puzzle game. In Proceedings of the International Conference on the Foundations of Digital Games pp 156-163
[32]. Rodrigues L et al 201 A math educacional computer game using procedural content generation In Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE) Vol 28 No 1 p 756
[33]. Hooshyar D et al 2018 A procedural content generation-based framework for educational games: Toward a tailored data-driven game for developing early English reading skills Journal of Educational Computing Research 56(2) 293-310
[34]. Hooshyar D et al 2018 A data‐driven procedural‐content‐generation approach for educational games Journal of Computer Assisted Learning 34(6) 731-739
[35]. Spain R et al 2022 A reinforcement learning approach to adaptive remediation in online training The Journal of Defense Modeling and Simulation 19(2) 173-193
[36]. Corno L Mandinach E B 1983 The role of cognitive engagement in classroom learning and motivation. Educational psychologist 18(2) 88-108
[37]. Chao T et al 2016 Using digital resources for motivation and engagement in learning mathematics: Reflections from teachers and students Digital Experiences in Mathematics Education 2 253-277
Cite this article
Wang,Y. (2023). Procedural content generation for VR educational applications: The investigation of AI-based approaches for improving learning experience. Applied and Computational Engineering,17,23-31.
Data availability
The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.
Disclaimer/Publisher's Note
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
About volume
Volume title: Proceedings of the 5th International Conference on Computing and Data Science
© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and
conditions of the Creative Commons Attribution (CC BY) license. Authors who
publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons
Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this
series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published
version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial
publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and
during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See
Open access policy for details).