A review of research on the utilization of deep learning in adaptive learning 2014-2024

Research Article
Open access

A review of research on the utilization of deep learning in adaptive learning 2014-2024

Qingye Yuan 1*
  • 1 UCSD    
  • *corresponding author qingye.yuan@pku.org.cn
Published on 12 October 2024 | https://doi.org/10.54254/2755-2721/90/20241720
ACE Vol.90
ISSN (Print): 2755-273X
ISSN (Online): 2755-2721
ISBN (Print): 978-1-83558-609-9
ISBN (Online): 978-1-83558-610-5

Abstract

Deep learning is a highly popular and rapidly advancing technology in today's world. Adaptive Learning based on learner’s individual needs shed lights in education. The combination of them may be the pivotal point in the future. This is a review mainly concerns the application of deep learning(DL) in adaptive learning(AL). The search is carried on Web of Science and Scopus. The author proceeds the research by asking several questions regarding the category of deep learning application in Adaptive Learning, the strength and weakness of those publications and the gap for future scientific research concerning deep learning in AL. This study finds some patterns in research category, figure out the most of the current researches resides in KT. One of the key advantages of deep learning is its capacity to closely mimic the structure and operational mechanisms of the brain. While it has weakness in computation cost, hardness in interpretation and data collection and so forth. This study points out the gap of research may lie in how to use deep learning to find the representation and leverage LLM in adaptive learning.

Keywords:

adaptive learning, personalized learning, deep learning, DL, AI, machine learning, DKT

Yuan,Q. (2024). A review of research on the utilization of deep learning in adaptive learning 2014-2024. Applied and Computational Engineering,90,66-72.
Export citation

1. Introduction

1.1. Adaptive learning

The world operates in a non-linear fashion; hence, learning should be designed to effectively align with this complexity to enhance adaptability. Therefore, the learning process itself must also embrace a non-linear structure. Engaging in a linear pattern of learning can result in advanced learners redundantly revisiting knowledge they have already mastered, leading to inefficiencies in time and effort. Furthermore, the absence of interactive elements in linear learning environments may hinder the provision of prompt feedback and assistance. Additionally, segmented or decomposed learning content still lacks way to transition to subsequent stages or topics further exacerbates this issue.

Educational Artificial Intelligence is a field combine with AI and education. It has two goals: one is to promote the implementation of AI tools in education with high efficiency, high flexibility and individuation. Another is to use precise calculating and explicit form to express some ambiguous knowledge in Education, Psychology and Sociology. Artificial Intelligence (AI) has emerged as a pivotal tool in unraveling the enigmas of cognitive learning within the human brain.

The study introduces the concept of adaptive learning, which is a research branch of e-learning, Adaptive learning refers to a personalized educational approach that tailors learning experiences based on the individual needs, preferences, and abilities of learners. It utilizes various technologies and data analytics to create customized learning paths, thereby enhancing the educational experience. The primary feature of adaptive learning is the continuous assessment and adaptation of learning materials, which allows for the recommendation of personalized learning items such as lectures and exercises. This method helps educators provide more effective support to large groups of learners, particularly in massive open online courses (MOOCs)

However, relying solely on adaptive learning to enable scholars to achieve self-driven learning, improve meta-cognitive levels, and comprehensively enhance learning capabilities may be impractical.

1.2. Deep learning

Deep learning is a specialized branch of machine learning that utilizes artificial neural networks to model and solve complex problems. It is heavily inspired by the structure and function of the human brain, particularly the inter-connectedness of neurons. This advanced approach allows deep learning algorithms to learn from vast amounts of data, making it effective for tasks such as image recognition, natural language processing, and more.

1.3. Deep learning in adaptive learning

The utilizing of deep learning in adaptive learning enables the provision of personalized educational pathways and content recommendations. Leveraging deep learning techniques, the system can automatically adjust learning materials and progression based on students' learning behaviors, abilities, and requirements. Adaptive learning, driven by students' feedback and performance, tailors the learning path accordingly, while deep learning aids in a better comprehension of students' learning states and needs, facilitating the delivery of more personalized and effective learning experiences. This amalgamation serves to enhance learning efficiency and outcomes.

2. Literature Review

2.1. Different type/strategy of adaptive learning

When it comes to adaptive learning, there are three types need to be specified here:

1. Adaptive content: adjusts to individual learner needs, offering personalized

educational material. Tailored to user proficiency and preferences, it enhances engagement and learning outcomes by delivering relevant and targeted information, fostering a dynamic and adaptive learning experience.

2. Adaptive assessment: tailors evaluation methods to individual learner abilities and knowledge levels. By dynamically adjusting question difficulty and content based on responses, it provides accurate and detailed insights into each learner's strengths and weaknesses, enhancing the assessment process's effectiveness and precision.

3. adaptive sequencing: organizes learning materials based on learner progress and performance. It dynamically adjusts the order and complexity of content delivery

to optimize comprehension and retention, ensuring a personalized and effective learning path for each individual.

The research conducted by Delgado encompasses a wide range of perspectives in the field[1]. In addition, several other studies have introduced alternative viewpoints, such as the examination of AI-supported personalized teaching strategies and the exploration of Adaptive Learning Path Construction[2,3]. These diverse lines of inquiry collectively contribute to a more nuanced understanding of the subject, highlighting the multifaceted nature of the research landscape.

2.2. Building block

The present adaptive learning systems or platforms can be constructed using various frameworks, each comprising distinct components. Zhao & Wang center their analysis on a framework consisting of three primary modules: the knowledge network model, the cognitive level model, and the adaptive recommendation model[4]. This particular framework serves as the foundation for various adaptive learning systems.

In addition, other scholarly articles and books discuss an alternative, widely recognized framework that encompasses several essential adaptive learning components. These include the learner model, also referred to as the user model, which structures the student's characteristics, the knowledge domain model, the instruction model, the adaptive model, and the user interface[5,6,7]. Collectively, these elements form a robust structure that supports the design and implementation of effective adaptive learning systems. The user model is currently considered as the key part of it, it could base on learning style (LS), learning objectives, cognitive level, emotion status, and learning environment.

This part has attracted a significant number of scholars to conduct research.

2.3. Data and algorithm

From the perspective of adaptive learning technologies, the core algorithms employed in adaptive learning encompass the K-means clustering algorithm, ant colony algorithm, Memetic algorithm, Bayesian algorithm, collaborative filtering algorithm, and hybrid algorithms [8,9,10,11,12,13]. Among prevalent recommendation models are collaborative filtering recommendation, knowledge-based recommendation, association rule recommendation and hybrid recommendation. Collaborative filtering, the earliest and most widely applied pattern in recommendation systems, primarily determines suitable knowledge for target users by assessing the similarity between the target user and a group of neighboring users.

Considering learning styles, there are algorithms based on ant colony optimization (ACS), association rule mining (IDEAL), Honey and Mumford's learning style model (INSPIRE), Felder-Silverman's learning style model, Tangow, MANIC, MASPLANG and LSAS, among others.

From a cognitive level perspective, there exist algorithms based on genetic algorithms (PELS) and association rule algorithms (ELM-ART).

3. Methodology

3.1. Protocol

This research aims to comprehensively document and trace the research regarding applying deep learning in adaptive learning; publications were collected in two large bibliographic databases: Web of Science (WOS) and Scopus; since they are esteemed for their large repository of scholarly publications. Additionally, known for their exceptional quality and academic rigor.

The time scope of the publications to be concerned is published from 2014 onwards; as result of getting some latest research results; and this research is carried on around July and August in 2024, so the end time for the collections is set to August 15,2024.

The investigation is carried on with topic (title, abstract and keywords) as search field and the collection of publications is exported to EndNote software in order to remove duplication, the author does some further inspection to make sure the article is on-topic based on some criteria.

Afterwards the author does some classification inside the collection.

The author makes the search phrase:("adaptive* *learning") AND ("deep learning" OR"DL" OR "deep neural* network" OR "deep network”) AND "education". This study does the search of publications separately in WOS and Scopus

The search result is 75 articles from Scopus and 21 from WOS; combine them comes out the collection of 96 articles, then the author removes duplicated work, leaves 76 articles remaining, then the author removes the ones off topic, off topic means the article is either not involve adaptive learning or not related to deep learning or both. After one-by-one coding there are 39 articles left. Please see the fig 1

fig1

Figure 1. document process

3.2. Research Questions

RQ1: How should publications be categorized according to a taxonomy.

RQ2: What are the strengths, limitation and main concerns of applying deep learning in adaptive learning.

RQ3: What are the key research gaps should be investigated according to the existing works?

4. Result

The study shows the result of RQ1 in table 1 attached, the most of articles (7) are doing research on deep learning with knowledge tracing, that is to get the learner's master level of the knowledge, which is indeed critical. The deep learning with RNN is also popular, which is related to the sequence understanding or sequence generating. There are three works investigate the use of deep learning in emotion recognition. Moreover,some scientists examine the application of deep learning with gaming, since there are two attempts to investigate game strategy and mechanism in adaptive learning. Surprisingly,It may be expected there are many works regarding the deep learning with robot in adaptive learning but there is not substantial quantity of them, actually only two involved. The study on deep learning in EEG is a great attempt since it directly examines "read human mind" as the way to implement adaptive learning strategy. The deep learning in representation and deep learning in GPT has two and one publications collected, respectively.

Table 1. research result

research topic

count

representative work

deep learning with KT

7

Evaluating Deep Sequential Knowledge Tracing Models for Predicting Student Performance[14]

deep learning with RNN

3

Are We There Yet? Evaluating the Effective-

ness of a Recurrent Neural Network-Based

Stopping Algorithm for an Adaptive Assessment[15]

deep learning with gaming

2

Modeling Learners to Early Predict Their

Performance in Educational Computer

Games[16]

deep learning in robot

2

Robust Model for Rural Education Using

Deep Learning and Robotics[17]

deep learning in emotion recognition

3

An optimized deep convolutional neural net-

work for adaptive learning using feature fusion in multimodal data[18]

deep learning in EEG

1

Prediction of Cognitive Load from Electroen-

cephalography Signals Using Long Short-

Term Memory Network[19]

deep learning in representation

2

A case study on the use of semantic web

technologies for learner guidance[20]

deep learning in GPT

1

AI Tutor Enhanced with Prompt Engineer-

ing and Deep Knowledge Tracing[21]

AS for the RQ2, deep learning already plays a key role in knowledge tracing. It has the characteristic of mimic human brain's mechanism which make it could simulate our brain's functionality and decipher the complex activity of our thinking or reasoning process. It also has the strength to get better precision when doing some predictions which are conventionally handled by basic machine learning or rule-based algorithm. Use deep learning in robot to get some feedback and interaction with computer is also a very fascinating part of the research. The limitation lies in deep learning is it asking for great computing efforts, which may lead to large amount of computing resource cost. Another problem is deep learning is hard in interpreting how it works, which sometimes called "black box", unlike human build model like Bayesian knowledge tracing, which can always be explicitly elucidated that how it provide us the specified answer. The last but not least limitation is that deep learning need a lot of data which is generated continuously, not all adapt learning platform can produce such great amount of data.

As for the RQ3, one essential role of deep learning is to unravel the representation of something, as the cognitive tool of understanding unstructured information, especially for some relationship or concept hardly perceived by human being. More scientists are expected to do some exploration on employing deep learning in representation (only two in list). Which may be a research gap the author looks forward to bridge. Lastly, this study wants to explore GPT, the large language model (LLM) already has application everywhere, however, seems in adaptive learning, how to use its power is still some field we need to explore.

5. Discuss

In the search the author didn't use CNN or RNN as key words (as alternative to deep learning), which may bring in more result. But that related to computer vision and nature language process, and the development of those may be more general than just in adaptive learning.

As for the limitation of lack of tremendous data for training deep learning model, one can think of the wearable device. The use of wearable devices in adaptive learning is promising. These devices have the potential to monitor students' real-time physiological states, attention levels, and learning progress, providing more precise data support for personalized learning. By integrating data from wearable devices with deep learning algorithms, it is possible to adjust learning content and pacing based on students' bodily feedback, offering a more effective learning experience. This integration is poised to bring about a more intelligent and personalized learning approach in the education sector, enhancing learning outcomes and teaching quality.

Finally, the author intends to address the importance of combining research in psychology, machine learning and education science. Numerous theories and discoveries abound in the realms of psychology and educational science. Among these, the Information Processing Theory dissects human thought processes akin to a computer; Cognitive Semiotics delves into the conveyance of meaning through symbols; and Cognitive Load Theory probes the mechanisms by which information is stored in our memory. Scientists could bring them together into adaptive learning, along with deep learning, to get better result of future education.


References

[1]. Delgado, H. O. K., de Azevedo Fay, A., Sebastiany, M. J., & Silva, A. D. C. (2020). Artificial intelligence adaptive learning tools: the teaching of english in focus. BELT-Brazilian English Language Teaching Journal, 11(2), e38749-e38749.

[2]. OLAIDE, A. A. O. A. A., NATHANIEL, S., OYESOLA, O. A. O. O. A., & ABAYOMI, A. K. A. A. K. (2024). Artificial intelligence with agile teaching strategies for personalized learning. Nigerian Online Journal of Educational Sciences and Technology, 6(1), 364-379.

[3]. Esteves, A. M. d. S., Filho, A. H., Raabe, A. L., & Dazzi, R. L. (2020). An adaptive system architecture model for the study of logic and programming with learning paths. In Proceedings of the 22nd international conference on enterprise information systems (Vol. 1, pp. 679-690).

[4]. Zhao, L., & Wang, H. (2019). Research on adaptive learning system based on three core modules. In 2019 10th international conference on information technology in medicine and education (itme) (pp. 447-452).

[5]. Nguyen, L. (2014). A user modeling system for adaptive learning. In 2014 international conference on interactive collaborative learning (icl) (p. 864-866). doi: 10.1109/ICL.2014.7017887

[6]. Idris, N., Hashim, S. Z. M., Samsudin, R., & Ahmad, N. B. H. (2017). Intelligent learning model based on significant weight of domain knowledge concept for adaptive e-learning. Int. J. Adv. Sci. Eng. Inf. Technol, 7(4-2), 1486.

[7]. Chen, S., & Zhang, J. (2008). The adaptive learning system based on learning style and cognitive state. In 2008 international symposium on knowledge acquisition and modeling (p. 302-306). doi: 10.1109/KAM.2008.60

[8]. Troussas, C., Krouska, A., & Virvou, M. (2019). Adaptive e-learning interactions using dynamic clustering of learners' characteristics. In 2019 10th international conference on information, intelligence, systems and applications (iisa) (p. 1-7). doi: 10.1109/IISA.2019.8900722

[9]. Wang, T.-I., Wang, K.-T., & Huang, Y.-M. (2008). Using a style-based ant colony system for adaptive learning. Expert Systems with applications, 34(4), 2449-2464.

[10]. Acampora, G., Gaeta, M., & Loia, V. (2011). Combining multi-agent paradigm and memetic computing for personalized and adaptive learning experiences. Computational Intelligence, 27(2), 141-165.

[11]. Gnadlinger, F., Selmanagic, A., Simbeck, K., & Kriglstein, S. (2023). Adapting is difficult! introducing a generic adaptive learning framework for learner modeling and task recommendation based on dynamic bayesian networks. In Csedu (1) (pp.272-280).

[12]. Riad, B., Ali, S., Mourad, H., & Hamid, S. (2012). An adaptive learning based on ant colony and collaborative filtering. In Proceedings of the world congress on engineering (Vol. 2, pp. 851-855).

[13]. Costa, J., Silva, C., Antunes, M., & Ribeiro, B. (2017). Adaptive learning for dynamic environments: A comparative approach. Engineering Applications of Artificial Intelligence, 65 , 336-345.

[14]. Mandlazi, J., Jadhav, A., & Ajoodha, R. (2021). Evaluating deep sequential knowledge tracing models for predicting student performance. In 2021 ieee asia-pacific conference on computer science and data engineering (csde) (pp. 1-6).

[15]. Matayoshi, J., Cosyn, E., & Uzun, H. (2021). Are we there yet? evaluating the effectiveness of a recurrent neural network-based stopping algorithm for an adaptive assessment. International Journal of Artificial Intelligence in Education,31(2), 304-336.

[16]. Hooshyar, D., El Mawas, N., Milrad, M., & Yang, Y. (2023). Modeling learners to early predict their performance in educational computer games. IEEE Access, 11 , 20399-20417.

[17]. Iyer, S. (2022). Robust model for rural education using deep learning and robotics. In Advances in deep learning, artificial intelligence and robotics: Proceedings of the2nd international conference on deep learning, artificial intelligence and robotics,(icdlair) 2020 (pp. 175-182).

[18]. Gupta, S., Kumar, P., & Tekchandani, R. (2023). An optimized deep convolutional neural network for adaptive learning using feature fusion in multimodal data. Decision Analytics Journal, 8 , 100277.

[19]. Yoo, G., Kim, H., & Hong, S. (2023). Prediction of cognitive load from electroencephalography signals using long short-term memory network. Bioengineering, 10(3), 361.

[20]. Zielinski, A., & Bock, J. (2015). A case study on the use of semantic web technologies for learner guidance. In Proceedings of the 24th international conference on world wide web (pp. 1425-1430).

[21]. Makharia, R., Kim, Y. C., Jo, S. B., Kim, M. A., Jain, A., Agarwal, P., . . . Agarwal, P. (2024). Ai tutor enhanced with prompt engineering and deep knowledge tracing. In 2024 ieee international conference on interdisciplinary approaches in technology and management for social innovation (iatmsi) (Vol. 2, pp. 1-6).


Cite this article

Yuan,Q. (2024). A review of research on the utilization of deep learning in adaptive learning 2014-2024. Applied and Computational Engineering,90,66-72.

Data availability

The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.

Disclaimer/Publisher's Note

The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

About volume

Volume title: Proceedings of the 6th International Conference on Computing and Data Science

ISBN:978-1-83558-609-9(Print) / 978-1-83558-610-5(Online)
Editor:Alan Wang, Ammar Alazab
Conference website: https://2024.confcds.org/
Conference date: 12 September 2024
Series: Applied and Computational Engineering
Volume number: Vol.90
ISSN:2755-2721(Print) / 2755-273X(Online)

© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license. Authors who publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See Open access policy for details).

References

[1]. Delgado, H. O. K., de Azevedo Fay, A., Sebastiany, M. J., & Silva, A. D. C. (2020). Artificial intelligence adaptive learning tools: the teaching of english in focus. BELT-Brazilian English Language Teaching Journal, 11(2), e38749-e38749.

[2]. OLAIDE, A. A. O. A. A., NATHANIEL, S., OYESOLA, O. A. O. O. A., & ABAYOMI, A. K. A. A. K. (2024). Artificial intelligence with agile teaching strategies for personalized learning. Nigerian Online Journal of Educational Sciences and Technology, 6(1), 364-379.

[3]. Esteves, A. M. d. S., Filho, A. H., Raabe, A. L., & Dazzi, R. L. (2020). An adaptive system architecture model for the study of logic and programming with learning paths. In Proceedings of the 22nd international conference on enterprise information systems (Vol. 1, pp. 679-690).

[4]. Zhao, L., & Wang, H. (2019). Research on adaptive learning system based on three core modules. In 2019 10th international conference on information technology in medicine and education (itme) (pp. 447-452).

[5]. Nguyen, L. (2014). A user modeling system for adaptive learning. In 2014 international conference on interactive collaborative learning (icl) (p. 864-866). doi: 10.1109/ICL.2014.7017887

[6]. Idris, N., Hashim, S. Z. M., Samsudin, R., & Ahmad, N. B. H. (2017). Intelligent learning model based on significant weight of domain knowledge concept for adaptive e-learning. Int. J. Adv. Sci. Eng. Inf. Technol, 7(4-2), 1486.

[7]. Chen, S., & Zhang, J. (2008). The adaptive learning system based on learning style and cognitive state. In 2008 international symposium on knowledge acquisition and modeling (p. 302-306). doi: 10.1109/KAM.2008.60

[8]. Troussas, C., Krouska, A., & Virvou, M. (2019). Adaptive e-learning interactions using dynamic clustering of learners' characteristics. In 2019 10th international conference on information, intelligence, systems and applications (iisa) (p. 1-7). doi: 10.1109/IISA.2019.8900722

[9]. Wang, T.-I., Wang, K.-T., & Huang, Y.-M. (2008). Using a style-based ant colony system for adaptive learning. Expert Systems with applications, 34(4), 2449-2464.

[10]. Acampora, G., Gaeta, M., & Loia, V. (2011). Combining multi-agent paradigm and memetic computing for personalized and adaptive learning experiences. Computational Intelligence, 27(2), 141-165.

[11]. Gnadlinger, F., Selmanagic, A., Simbeck, K., & Kriglstein, S. (2023). Adapting is difficult! introducing a generic adaptive learning framework for learner modeling and task recommendation based on dynamic bayesian networks. In Csedu (1) (pp.272-280).

[12]. Riad, B., Ali, S., Mourad, H., & Hamid, S. (2012). An adaptive learning based on ant colony and collaborative filtering. In Proceedings of the world congress on engineering (Vol. 2, pp. 851-855).

[13]. Costa, J., Silva, C., Antunes, M., & Ribeiro, B. (2017). Adaptive learning for dynamic environments: A comparative approach. Engineering Applications of Artificial Intelligence, 65 , 336-345.

[14]. Mandlazi, J., Jadhav, A., & Ajoodha, R. (2021). Evaluating deep sequential knowledge tracing models for predicting student performance. In 2021 ieee asia-pacific conference on computer science and data engineering (csde) (pp. 1-6).

[15]. Matayoshi, J., Cosyn, E., & Uzun, H. (2021). Are we there yet? evaluating the effectiveness of a recurrent neural network-based stopping algorithm for an adaptive assessment. International Journal of Artificial Intelligence in Education,31(2), 304-336.

[16]. Hooshyar, D., El Mawas, N., Milrad, M., & Yang, Y. (2023). Modeling learners to early predict their performance in educational computer games. IEEE Access, 11 , 20399-20417.

[17]. Iyer, S. (2022). Robust model for rural education using deep learning and robotics. In Advances in deep learning, artificial intelligence and robotics: Proceedings of the2nd international conference on deep learning, artificial intelligence and robotics,(icdlair) 2020 (pp. 175-182).

[18]. Gupta, S., Kumar, P., & Tekchandani, R. (2023). An optimized deep convolutional neural network for adaptive learning using feature fusion in multimodal data. Decision Analytics Journal, 8 , 100277.

[19]. Yoo, G., Kim, H., & Hong, S. (2023). Prediction of cognitive load from electroencephalography signals using long short-term memory network. Bioengineering, 10(3), 361.

[20]. Zielinski, A., & Bock, J. (2015). A case study on the use of semantic web technologies for learner guidance. In Proceedings of the 24th international conference on world wide web (pp. 1425-1430).

[21]. Makharia, R., Kim, Y. C., Jo, S. B., Kim, M. A., Jain, A., Agarwal, P., . . . Agarwal, P. (2024). Ai tutor enhanced with prompt engineering and deep knowledge tracing. In 2024 ieee international conference on interdisciplinary approaches in technology and management for social innovation (iatmsi) (Vol. 2, pp. 1-6).