Drowsy Eyes and Face Mask Detection for Car Drivers using the Embedded System
DOI:
https://doi.org/10.26594/register.v9i1.2612Keywords:
Embedded System, Support Vector Machin, HOG, Face Mask, MobileNetV2Abstract
Efforts to prevent the spread of the COVID-19 virus have underscored the critical importance of mask-wearing as a preventive measure. Concurrently, road traffic accidents, often resulting from human error, have emerged as a significant contributor to global mortality rates. This study endeavors to address these pressing issues by employing advanced Deep Learning techniques to detect mask usage and identify drowsy eyes, thus contributing to the prevention of COVID-19 and accidents due to driver fatigue. To achieve this objective, an embedded system was developed, utilizing the integration of hardware and software components. The system effectively utilizes MobileNetV2 for face mask detection and employs HOG and SVM algorithms for drowsy eye detection. By seamlessly integrating these detection systems into a single embedded device, the simultaneous detection of both mask usage and drowsy eyes is made possible. The results demonstrates a commendable accuracy rate of 80% for face mask detection and 75% for drowsy eye detection. Furthermore, the mask detection component exhibits a remarkable training accuracy of 99%, while the drowsy eye detection component demonstrates an 80% training accuracy, affirming the system's efficacy in precisely identifying masks and drowsy eyes. The proposed embedded system offers potential applications in enhancing road safety. Its capability to effectively detect drowsy eyes and mask usage in car drivers contributes significantly to preventing accidents due to driver fatigue. Additionally, it plays a vital role in mitigating COVID-19 transmission by promoting widespread mask-wearing among individuals. This study exemplifies the potential of integrating Deep Learning methodologies with embedded systems, thus paving the way for future research and development in the realm of driver safety and virus prevention.
References
WHO, "Global Status Report on Road Safety," World Health Organization, Geneva, 2018. [Online]. Available: https://www.who.int/publications-detail/global-statusreport-on-road-safety-2018
Y.-Y. Lin and P.-A. Hsiung, “An early warning system for predicting driver fatigue,” in 2017 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW), 2017, pp. 283–284.
C. Huda, H. Tolle, and F. Utaminingrum, “Mobile-based driver sleepiness detection using facial landmarks and analysis of EAR values,” 2020.
S. D. Lin, J.-J. Lin, and C.-Y. Chung, “Sleepy eye’s recognition for drowsiness detection,” in 2013 International Symposium on Biometrics and Security Technologies, 2013, pp. 176–179.
R. Jabbar, M. Shinoy, M. Kharbeche, K. Al-Khalifa, M. Krichen, and K. Barkaoui, “Driver drowsiness detection model using convolutional neural networks techniques for android application,” in 2020 IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT), 2020, pp. 237–242.
I. Gupta, N. Garg, A. Aggarwal, N. Nepalia, and B. Verma, “Real-time driver’s drowsiness monitoring based on dynamically varying threshold,” in 2018 Eleventh International Conference on Contemporary Computing (IC3), 2018, pp. 1–6.
S. Lefkovits, L. Lefkovits, and S. Emerich, “Detecting the eye and its openness with Gabor filters,” in 2017 5th International Symposium on Digital Forensic and Security (ISDFS), 2017, pp. 1–5.
W. Rahmaniar and A. Hernawan, “Real-time human detection using deep learning on embedded platforms: A review,” J. Robot. Control, vol. 2, no. 6, pp. 462–468, 2021.
P. Liu, H. Chi, X. Li, and D. Li, “Development of a fatigue detection and early warning system for crane operators: A preliminary study,” in Construction Research Congress 2020, 2020, pp. 106–115.
M. F. Shakeel, N. A. Bajwa, A. M. Anwaar, A. Sohail, and A. Khan, “Detecting driver drowsiness in real time through deep learning based object detection,” in International work-conference on artificial neural networks, 2019, pp. 283–296.
J. Cao, R. Pang, R. Ma, and Y. Qi, “Face Mask Recognition Based on MTCNN and MobileNet,” in Advances in Simulation and Process Modelling: Proceedings of the Second International Symposium on Simulation and Process Modelling (ISSPM 2020) 2, 2021, pp. 433–442.
T. Hope, Y. S. Resheff, and I. Lieder, Learning tensorflow: A guide to building deep learning systems. “ O’Reilly Media, Inc.,” 2017.
Y. S. Taspinar and M. Selek, “Object recognition with hybrid deep learning methods and testing on embedded systems,” Int. J. Intell. Syst. Appl. Eng., vol. 8, no. 2, pp. 71–77, 2020.
S. U. Rehman, M. R. Razzaq, and M. H. Hussian, “Training of SSD (single shot detector) for facial detection using Nvidia jetson nano,” arXiv Prepr. arXiv2105.13906, 2021.
J. Tang, D. Sun, S. Liu, and J.-L. Gaudiot, “Enabling deep learning on IoT devices,” Computer (Long. Beach. Calif)., vol. 50, no. 10, pp. 92–96, 2017.
P. Nagrath, R. Jain, A. Madan, R. Arora, P. Kataria, and J. Hemanth, “SSDMNV2: A real time DNN-based face mask detection system using single shot multibox detector and MobileNetV2,” Sustain. cities Soc., vol. 66, p. 102692, 2021.
G. Jignesh Chowdary, N. S. Punn, S. K. Sonbhadra, and S. Agarwal, “Face mask detection using transfer learning of inceptionv3,” in Big Data Analytics: 8th International Conference, BDA 2020, Sonepat, India, December 15--18, 2020, Proceedings 8, 2020, pp. 81–90.
M. Loey, G. Manogaran, M. H. N. Taha, and N. E. M. Khalifa, “A hybrid deep transfer learning model with machine learning methods for face mask detection in the era of the COVID-19 pandemic,” Measurement, vol. 167, p. 108288, 2021.
M. Jiang and X. Fan, “Retinamask: A face mask detector,” 2020.
Q. Abbas, “HybridFatigue: A real-time driver drowsiness detection using hybrid features and transfer learning,” Int. J. Adv. Comput. Sci. Appl., vol. 11, no. 1, 2020.
M. Kahlon and S. Ganesan, “Driver drowsiness detection system based on binary eyes image data,” in 2018 IEEE International Conference on Electro/Information Technology (EIT), 2018, pp. 209–215.
V. Pavani, M. N. Swetha, Y. Prasanthi, K. Kavya, and M. Pavithra, “Drowsy Driver Monitoring Using Machine Learning and Visible Actions,” in 2022 International Conference on Electronics and Renewable Systems (ICEARS), 2022, pp. 1269–1279.
R. R. Varghese, P. M. Jacob, J. Jacob, M. N. Babu, R. Ravikanth, and S. M. George, “An Integrated Framework for Driver Drowsiness Detection and Alcohol Intoxication using Machine Learning,” in 2021 International Conference on Data Analytics for Business and Industry (ICDABI), 2021, pp. 531–536.
A. Al Redhaei, Y. Albadawi, S. Mohamed, and A. Alnoman, “Realtime Driver Drowsiness Detection Using Machine Learning,” in 2022 Advances in Science and Engineering Technology International Conferences (ASET), 2022, pp. 1–6.
A. Celecia, K. Figueiredo, M. Vellasco, and R. González, “A portable fuzzy driver drowsiness estimation system,” Sensors, vol. 20, no. 15, p. 4093, 2020.
S. Menon, J. Swathi, S. K. Anit, A. P. Nair, and S. Sarath, “Driver face recognition and sober drunk classification using thermal images,” in 2019 International Conference on Communication and Signal Processing (ICCSP), 2019, pp. 400–404.
H. Kaufman, J. Woods, S. Dravida, and A. Tekalp, “Estimation and identification of two-dimensional images,” IEEE Trans. Automat. Contr., vol. 28, no. 7, pp. 745–756, 1983.
S. Cass, “Nvidia makes it easy to embed AI: The Jetson nano packs a lot of machine-learning power into DIY projects-[Hands on],” IEEE Spectr., vol. 57, no. 7, pp. 14–16, 2020.
A. A. Süzen, B. Duman, and B. cSen, “Benchmark analysis of jetson tx2, jetson nano and raspberry pi using deep-cnn,” in 2020 International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA), 2020, pp. 1–5.
V. Sati, S. M. Sánchez, N. Shoeibi, A. Arora, and J. M. Corchado, “Face detection and recognition, face emotion recognition through NVIDIA Jetson Nano,” in Ambient Intelligence--Software and Applications: 11th International Symposium on Ambient Intelligence, 2021, pp. 177–185.
S. Sukaridhoto, D. K. Basuki, H. Yulianus, and R. P. N. Budiarti, “Performance Evaluation of Integrated Deep Learning Web Platform for Dataset Training,” Appl. Technol. Comput. Sci. J., vol. 2, no. 2, pp. 117–128, 2019.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Rizqi Putri Nourma Budiarti, Bagoes Wahyu Nugroho, Sritrusta Sukaridhoto, Nisa Ayunda
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Please find the rights and licenses in Register: Jurnal Ilmiah Teknologi Sistem Informasi. By submitting the article/manuscript of the article, the author(s) agree with this policy. No specific document sign-off is required.
1. License
The non-commercial use of the article will be governed by the Creative Commons Attribution license as currently displayed on Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
2. Author(s)' Warranties
The author warrants that the article is original, written by stated author(s), has not been published before, contains no unlawful statements, does not infringe the rights of others, is subject to copyright that is vested exclusively in the author and free of any third party rights, and that any necessary written permissions to quote from other sources have been obtained by the author(s).
3. User/Public Rights
Register's spirit is to disseminate articles published are as free as possible. Under the Creative Commons license, Register permits users to copy, distribute, display, and perform the work for non-commercial purposes only. Users will also need to attribute authors and Register on distributing works in the journal and other media of publications. Unless otherwise stated, the authors are public entities as soon as their articles got published.
4. Rights of Authors
Authors retain all their rights to the published works, such as (but not limited to) the following rights;
Copyright and other proprietary rights relating to the article, such as patent rights,
The right to use the substance of the article in own future works, including lectures and books,
The right to reproduce the article for own purposes,
The right to self-archive the article (please read out deposit policy),
The right to enter into separate, additional contractual arrangements for the non-exclusive distribution of the article's published version (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal (Register: Jurnal Ilmiah Teknologi Sistem Informasi).
5. Co-Authorship
If the article was jointly prepared by more than one author, any authors submitting the manuscript warrants that he/she has been authorized by all co-authors to be agreed on this copyright and license notice (agreement) on their behalf, and agrees to inform his/her co-authors of the terms of this policy. Register will not be held liable for anything that may arise due to the author(s) internal dispute. Register will only communicate with the corresponding author.
6. Royalties
Being an open accessed journal and disseminating articles for free under the Creative Commons license term mentioned, author(s) aware that Register entitles the author(s) to no royalties or other fees.
7. Miscellaneous
Register will publish the article (or have it published) in the journal if the article’s editorial process is successfully completed. Register's editors may modify the article to a style of punctuation, spelling, capitalization, referencing and usage that deems appropriate. The author acknowledges that the article may be published so that it will be publicly accessible and such access will be free of charge for the readers as mentioned in point 3.
Editorial Board
Author Guidelines
Focus and Scope
Online Submissions
Author Fees 
Journal History
