Advancements in driver fatigue detection: A comprehensive analysis of eye movement and facial feature approaches

Research Article
Open access

Advancements in driver fatigue detection: A comprehensive analysis of eye movement and facial feature approaches

Qinan Li 1*
  • 1 Changchun University of Science and Technology    
  • *corresponding author 2020000936@mails.cust.edu.cn
ACE Vol.65
ISSN (Print): 2755-273X
ISSN (Online): 2755-2721
ISBN (Print): 978-1-83558-427-9
ISBN (Online): 978-1-83558-428-6

Abstract

This article goes into sophisticated tiredness detection methods that make use of computer vision algorithms, including the Eye Movement and Facial Feature approaches. Eye movement analysis, which emphasizes blink frequency, Scanning speed, and gaze length, excels in tasks requiring sustained visual attention, which is critical in high-attention vocations. Facial Feature detection, on the other hand, monitors changes in expressions, muscle activity, and emotions, providing flexibility across a wide range of settings. Eye movement enables accurate indications, real-time responsiveness, and task-specific precision, which is especially important in high-attention occupations. Facial Feature is ideal for a variety of scenarios since it gives complete assessments, flexibility, contextual analysis, and non-intrusiveness. Case examples show how eye-tracking and convolutional neural networks may be used to improve accuracy. This study helps to weariness management by detailing the advantages and disadvantages of Eye Movement and Facial Feature methods. Given the pervasiveness of fatigue, knowing these sensing systems is critical for maintaining safety, productivity, and general well-being in a variety of professional and everyday life scenarios.

Keywords:

Driver Fatigue Detection, Eye Movement, Facial Feature

Li,Q. (2024). Advancements in driver fatigue detection: A comprehensive analysis of eye movement and facial feature approaches. Applied and Computational Engineering,65,75-80.
Export citation

1. Introduction

Driver weariness has become a significant factor in traffic accidents as the number and use of transportation vehicles rises. Driven by advances in contemporary technology, researchers are concentrating on creating advanced systems for detecting driver weariness in order to improve traffic safety [1]. Fatigue detection is critical in protecting human well-being and enhancing performance across a wide range of areas, from transportation safety to workplace productivity. In recent years, two significant strategies for evaluating fatigue have developed as successful methods: Eye Movement Fatigue Detection and Facial Feature Fatigue Detection. These approaches make use of modern technology, namely computer vision algorithms, to monitor and evaluate physiological indications related to weariness [2].

First, this paper focus on an eye-tracking data-based tiredness detection technique. Eye Movement Fatigue Detection is based on analyzing patterns of eye activity, such as blink frequency, Scanning speed, and gaze length. These factors are direct measures of a person’s attentiveness and response. The approach excels at activities that need prolonged visual attention, making it especially useful in important situations such as long-distance transportation, machine operation, and decision-making scenarios. Next, this paper shifts the attention to yet another method: Facial Feature Fatigue Detection provides a complete technique by monitoring changes in facial expressions and muscular activity. It takes into account things like eye movements, facial muscle contractions, and overall facial emotions. Because of its flexibility to various face expressions, this technology is relevant in a wide range of settings, from workplace safety to healthcare monitoring and even the entertainment sectors. In this study, this paper compares and contrast these two tiredness detection approaches. Our investigation looks into the monitoring measures used by each approach, their applicability across different settings, and the intricacies that influence their accuracy. Furthermore, this paper evaluates the possible synergies that may result from combining various strategies to improve overall efficacy. As fatigue continues to pose problems in key areas and disrupt daily activities, it is vital to have a thorough grasp of the strengths and limits of different fatigue detection systems. This work intends to add useful insights to the growing landscape of fatigue management by unraveling the complexities of Eye Movement Fatigue Detection and Facial Feature Fatigue Detection, with consequences for safety, productivity, and general human well-being.

2. Theoretical Frameworks in Driver Fatigue Detection

2.1. Working principle of Eye Movement Fatigue Detection

Eye Movement exhaustion Detection employs complex algorithms to evaluate patterns in eye movements, which are a crucial signal of exhaustion. The system provides a baseline for alertness by measuring metrics such as blink rate, scan, and gaze length. These measurements, such as extended blinks and decreased eye movement speed, show distinct changes when weariness sets in. The device can dynamically examine these fluctuations and detect symptoms of weariness thanks to real-time monitoring. Driver monitoring, workplace safety, and healthcare all benefit from this technology. It plays an important role in minimizing accidents, increasing productivity, and boosting general well-being by delivering early signals of fatigue-related impairment. The incorporation of Eye Movement tiredness Detection into a variety of scenarios emphasizes its importance as a proactive tiredness management tool, leading to safer and more efficient operations [2, 3]. Eye Movement Fatigue Detection is shown in figure 1.

/word/media/image1.png/word/media/image2.png

Figure 1. Eye movement fatigue detection [3]

2.2. Working principle of Facial Feature Fatigue Detection

Facial Feature weariness Detection examines facial expressions to detect indicators of weariness using sophisticated computer vision methods. It measures small changes in important face traits such as eye movements, muscular activity, and overall facial emotions using complex algorithms. The technology creates a baseline for a rested condition and continually analyzes real-time data to detect variations that indicate exhaustion. This non-intrusive technique is beneficial in a variety of fields, such as transportation safety, healthcare, and workplace efficiency. The system improves safety standards, avoids accidents, and promotes well-being by sending early notifications when indications of weariness develop. Its adaptability extends to applications like as driver monitoring systems, workforce fatigue management, and healthcare monitoring, making it a powerful tool for maintaining attention and alertness in a variety of situations [4, 5]. Facial Feature Fatigue Detection.is shown in figure 2.

/word/media/image3.png

Figure 2. Facial Feature Fatigue Detection [5]

3. Comparative Analysis

3.1. Monitoring Metrics

Eye Movement Fatigue Detection: Blink Frequency: The frequency with which a person blinks. Blink frequency may decrease during weariness, resulting in decreased eye surface moisture [3]. Scanning speed: The rate at which the eyes swiftly travel from one location to another. Fatigue can cause a decrease in Scanning speed, indicating a delayed reaction to incoming information [5]. Gaze Duration: The amount of time that the eyes remain fixed on a certain spot. In a tired condition, gaze length may rise, indicating that you are paying close attention to a certain target [5]. Facial Feature Fatigue Detection: Eye Movements: Examines the trajectory of eye movements, including changes in gaze locations and speed. Fatigue can cause changes in eye movement patterns [6]. Face Muscle Activity: Monitors the contractions and relaxations of face muscles, particularly those associated with expressions. Facial muscular activation might be diminished as a result of fatigue [6].

Overall Facial Expressions: Examines variations in overall facial expressions such as brow positioning and lip motions. Facial expressions may become more stiff or lose vibrancy when tired [7]. Eye movement fatigue detection outperforms facial feature fatigue detection in activities that require visual concentration, while facial feature fatigue detection gives a more thorough evaluation of overall exhaustion.

3.2. Accuracy

The accuracy of eye tracking and face recognition in the context of driver tiredness detection can be affected by individual technological implementations, device quality, weather circumstances, and other factors. In general, the accuracy of these two technologies may vary depending on the scenario. The following are some potential points of view, however keep in mind that these points of view may need to be validated based on particular study or technology implementations.[8]Given the tight relationship between eye movements and attention, the advantage of eye tracking is its capacity to offer a direct evaluation of the driver’s attention level. However, eye tracking may be affected by environmental factors such as strong light, spectacles, and pupil size, among others, thereby reducing its accuracy.For example: Fatima B has presented a low-cost approach for detecting driver drowsiness based on micro-sleep patterns. They used two algorithms to ensure accurate identification of the driver’s face and eyes, even when the motorist is not facing the camera or has closed eyelids, by positioning the camera on the extreme left side of the driver. They discovered micro-sleep patterns and triggered an alarm when necessary by using SVM and Adaboost to classify the status of the right eye. Their technique obtained 99.9% accuracy for face detection and 98.7% accuracy for eye detection across several subject datasets. SVM and AdaBoost have an average accuracy of 96.5% and 95.4%, respectively.[9] In contrast, the power of face recognition resides in its capacity to detect indicators of exhaustion through the study of facial expressions, eye movements, and other traits that may manifest in addition to eye tracking. Nonetheless, problems with facial recognition include facial occlusion and variability in facial characteristics.For example:Li K combined the morphological characteristics of the eye and mouth areas, delving into tiredness detection concerns such as feature quantity, classifiers, and modeling parameters. In 10-fold cross-validation, the suggested method, “REcognizing the Drowsy Expression (REDE),” obtained an accuracy of 96.07% while processing each image in around 21 milliseconds. REDE outperformed four previous experiments in terms of tiredness detection accuracy and processing time, exhibiting adequate speed to handle real-time fatigue monitoring activities at a rate of 30 frames per second. The study also offered raw data and feature matrices to aid future tiredness detection studies.[10]In their particular settings, eye-tracking and face recognition may attain high levels of detection accuracy. As a result, detecting methods should be chosen depending on particular technology implementations, device quality, weather conditions, and other aspects relevant to the background.choosing the right technology and taking into account real-world application situations and ambient circumstances are critical for efficient driver tiredness detection.

3.3. Case analysis

The use of blink frequency as an indication in the identification of eye movement fatigue. Zhang W uses sophisticated eye movement fatigue detection techniques to improve driver safety. For precise location, a strong facial localization technology, AdaBoost-based face detector, is used first. Following that, the Active Shape Model (ASM) algorithm pinpoints human eyeballs in front-view photos. The ASM method, a statistical tool for deformable objects, is being refined to increase resilience to changes in lighting and posture. An important innovation is the use of a self-quotient picture to offset the negative impact of lighting variations on ASM’s accuracy. This illumination-free self-quotient picture, created from convolution and smoothing operations on the original image, improves the resilience and accuracy of the ASM technique. The research demonstrates how lighting conditions and face position affect the ASM algorithm and how the updated ASM approach improves tolerance. Further refinement is done by using deformable templates to correctly define the eyes. The Mean-Shift technique, which analyzes density distribution using self-quotient pictures, is used to track the eyes. The Mean-Shift technique improves eye recognition speed and resilience to fluctuations in driver position, which is critical for real-time applications. The study concludes with an examination of eye movement characteristics in order to establish several measurements such as PERCLOS, Blink Frequency, Maximum Close Duration, and others. These measurements act as markers of various degrees of tiredness. By combining face localization, statistical modeling, and eye movement analysis, the research proposes a complete and advanced approach to tiredness identification. This multi-layered technique contributes to developments in driver monitoring systems and overall road safety by providing a sophisticated knowledge of driver weariness [11].

The application of facial muscle activity as an indicator in facial feature fatigue detection. Sikander G uses a 3D Facial Feature Based Photometric Stereo Perspective delves into fatigue detection through a different lens, leveraging three-dimensional (3D) facial models and Photometric Stereo (PS). Unlike traditional 2D image analysis, this approach captures minute facial muscle changes represented by Action Units (AUs) in the Facial Action Coding System (FACS). The study incorporates a 3D model of facial muscles, emphasizing the intricate details provided by the face’s 3D shape. PS is employed for image capture, and deep networks process the bump map data derived from pixel-wise normal vectors. The research proposes innovative methods for accurate 3D reconstruction, including shadow detection and light source selection [12].

These case studies demonstrate the actual application of the methodologies described in the two relevant publications. The first research analyzed a comprehensive strategy that incorporates eye movement characteristics such as PERCLOS and Blink Frequency, as well as an AdaBoost-based face detector, Active Shape Model algorithm, and Mean-Shift algorithm. It performs multi-level driver tiredness monitoring, giving a comprehensive solution for improving driving safety. The second research, on the other hand, delves into the fine intricacies of facial muscle movements, using PS and deep learning to precisely recreate and evaluate 3D face expressions for tiredness identification.

3.4. Research Results

Zhang W article describes a nonintrusive sleepiness detection system that makes use of eye-tracking and picture processing. The introduction of a self-quotient picture for ASM statistical texture modeling and mean-shift eye-tracking addressed challenges originating from variations in light and driver position effecting eye identification. Drowsiness was quantified using six measures, including PERCLOS, MCD, BF, AOL, OV, and CV of eyes. In high-fidelity driving simulations with six participants, Fisher’s linear discriminant functions were used to analyze the correlations, obtaining a recognition accuracy of more than 86%. Recognizing individual differences in blink frequency and integrating personal attributes improved tiredness detection. Individual models based on initial driving task data showed promise for individualized evaluations, but combining generic criteria from varied participants improved overall recognition accuracy [11].

The findings of the Sikander G underlined the efficacy of the suggested approach for detecting three-dimensional face muscle tiredness. The created intelligent light source arrangement and shadow removal approach increased the accuracy of Photometric Stereo-based 3D reconstruction greatly. The results showed a significant reduction in reconstruction errors, particularly in shadowy regions. A comparison with current shadow compensating approaches demonstrated the superiority of the developed strategy. The study found encouraging findings in the subtle identification of early indicators of weariness, with lower mistakes than standard Photometric Stereo [12].

4. Conclusion

While this work thoroughly investigates the advanced uses of eye movement and facial feature approaches in driver tiredness detection, it is important to exercise caution when making conclusions by accepting inherent limits and assessing potential future developments. The focus of the article is specifically limited to eye movement and facial feature approaches, perhaps disregarding contributions from other upcoming technologies. Furthermore, relying on small case studies may limit the generalizability of findings across a variety of driving circumstances and people, necessitating larger field research to assure the universality of conclusions. Furthermore, the mentioned technologies may face practical obstacles in real-world applications, such as the influence of ambient conditions and individual differences in reactions. Future studies can focus on resolving these constraints and embracing new trends to better promote research and technology improvements in driver tiredness identification. Multimodal integration, which includes physiological data and cognitive evaluations, appears as a critical path to improving system robustness and accuracy. Furthermore, large-scale field testing will thoroughly confirm the suggested approaches’ actual usefulness, assuring their dependability in a variety of scenarios. Given the fast evolution of technology, ongoing research into upcoming technologies is critical for continually refining tiredness detection systems. As a result, a thorough grasp of constraints as well as an awareness of future trends help to the complete and long-term development of driver fatigue management systems.


References

[1]. Ramzan M, Khan H U, Awan S M, et al. A survey on state-of-the-art drowsiness detection techniques. IEEE Access, 2019, 7: 61904-61919.

[2]. Zhuang Q, Kehua Z, Wang J, et al. Driver fatigue detection method based on eye states with pupil and iris segmentation. Ieee Access, 2020, 8: 173440-173449.

[3]. Wang Y, Zhai G, Chen S, et al. Assessment of eye fatigue caused by head-mounted displays using eye-tracking. Biomedical engineering online, 2019, 18: 1-19.

[4]. Li K, Wang S, Du C, et al. Accurate fatigue detection based on multiple facial morphological features. Journal of Sensors, 2019, 2019.

[5]. Feldhütter A, Gold C, Schneider S, et al. How the duration of automated driving influences take-over performance and gaze behavior. Advances in ergonomic design of systems, products and processes: Proceedings of the annual meeting of GfA 2016. Springer Berlin Heidelberg, 2017: 309-318.

[6]. Deng W, Wu R. Real-time driver-drowsiness detection system using facial features. Ieee Access, 2019, 7: 118727-118738.

[7]. Assari M A, Rahmati M. Driver drowsiness detection using face expression recognition. 2011 IEEE international conference on signal and image processing applications (ICSIPA). IEEE, 2011: 337-341.

[8]. Sikander G, Anwar S. Driver fatigue detection systems: A review. IEEE Transactions on Intelligent Transportation Systems, 2018, 20(6): 2339-2352.

[9]. Fatima B, Shahid A R, Ziauddin S, et al. Driver fatigue detection using viola jones and principal component analysis[J]. Applied Artificial Intelligence, 2020, 34(6): 456-483.

[10]. Fatima B, Shahid A R, Ziauddin S, et al. Driver fatigue detection using viola jones and principal component analysis[J]. Applied Artificial Intelligence, 2020, 34(6): 456-483.

[11]. Zhang W, Cheng B, Lin Y. Driver drowsiness recognition based on computer vision technology. Tsinghua Science and Technology, 2012, 17(3): 354-362.

[12]. Sikander G, Anwar S, Husnain G, et al. An Adaptive Snake Based Shadow Segmentation for Robust Driver Fatigue Detection: A 3D Facial Feature based Photometric Stereo Perspective. IEEE Access, 2023.


Cite this article

Li,Q. (2024). Advancements in driver fatigue detection: A comprehensive analysis of eye movement and facial feature approaches. Applied and Computational Engineering,65,75-80.

Data availability

The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.

Disclaimer/Publisher's Note

The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

About volume

Volume title: Proceedings of Urban Intelligence: Machine Learning in Smart City Solutions - CONFSEML 2024

ISBN:978-1-83558-427-9(Print) / 978-1-83558-428-6(Online)
Editor:Omar Marwan
Conference website: https://www.confmss.org/
Conference date: 2 February 2024
Series: Applied and Computational Engineering
Volume number: Vol.65
ISSN:2755-2721(Print) / 2755-273X(Online)

© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license. Authors who publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See Open access policy for details).

References

[1]. Ramzan M, Khan H U, Awan S M, et al. A survey on state-of-the-art drowsiness detection techniques. IEEE Access, 2019, 7: 61904-61919.

[2]. Zhuang Q, Kehua Z, Wang J, et al. Driver fatigue detection method based on eye states with pupil and iris segmentation. Ieee Access, 2020, 8: 173440-173449.

[3]. Wang Y, Zhai G, Chen S, et al. Assessment of eye fatigue caused by head-mounted displays using eye-tracking. Biomedical engineering online, 2019, 18: 1-19.

[4]. Li K, Wang S, Du C, et al. Accurate fatigue detection based on multiple facial morphological features. Journal of Sensors, 2019, 2019.

[5]. Feldhütter A, Gold C, Schneider S, et al. How the duration of automated driving influences take-over performance and gaze behavior. Advances in ergonomic design of systems, products and processes: Proceedings of the annual meeting of GfA 2016. Springer Berlin Heidelberg, 2017: 309-318.

[6]. Deng W, Wu R. Real-time driver-drowsiness detection system using facial features. Ieee Access, 2019, 7: 118727-118738.

[7]. Assari M A, Rahmati M. Driver drowsiness detection using face expression recognition. 2011 IEEE international conference on signal and image processing applications (ICSIPA). IEEE, 2011: 337-341.

[8]. Sikander G, Anwar S. Driver fatigue detection systems: A review. IEEE Transactions on Intelligent Transportation Systems, 2018, 20(6): 2339-2352.

[9]. Fatima B, Shahid A R, Ziauddin S, et al. Driver fatigue detection using viola jones and principal component analysis[J]. Applied Artificial Intelligence, 2020, 34(6): 456-483.

[10]. Fatima B, Shahid A R, Ziauddin S, et al. Driver fatigue detection using viola jones and principal component analysis[J]. Applied Artificial Intelligence, 2020, 34(6): 456-483.

[11]. Zhang W, Cheng B, Lin Y. Driver drowsiness recognition based on computer vision technology. Tsinghua Science and Technology, 2012, 17(3): 354-362.

[12]. Sikander G, Anwar S, Husnain G, et al. An Adaptive Snake Based Shadow Segmentation for Robust Driver Fatigue Detection: A 3D Facial Feature based Photometric Stereo Perspective. IEEE Access, 2023.