Utilising the YOLOv3 Algorithm for the Student Posture Recognition System in Classroom Settings

• Published in: 8th International Conference on Recent Advances and Innovations in Engineering: Empowering Computing, Analytics, and Engineering Through Digital Innovation, ICRAIE 2023
• Main Author: Nazaruddin M.N.Z.; Afirdaus Zainal Abidin N.; Aminuddin R.; Samah K.A.F.A.; Ibrahim A.Z.M.; Yusoh S.D.; Mangshor N.N.A.; Nasir S.D.N.M.
• Format: Conference paper
• Language: English
• Published: Institute of Electrical and Electronics Engineers Inc. 2023
• Online Access: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85189930039&doi=10.1109%2fICRAIE59459.2023.10468178&partnerID=40&md5=5d9dca6cac14782cd7e0b30a7a90950f

Effective student-teacher interaction helps transfer knowledge, clarify concepts, and create a conductive learning environment the effectiveness of the interaction can be seen through students' behaviour and various factors, such as pos- ture and gestures in the classroom. However, educators face significant difficulties in tracking each student's performance and behaviour during class therefore, this study focuses on student posture recognition in classroom settings, which is essential for monitoring student behaviour and engagement during lectures the proposed system utilises the YOLOv3 machine learning model for real-time detection. A dataset of student postures was collected from Google Images, and the data was used to train a deep neural network the model was then tested on classroom images and compared to manual annotations the results showed that the model can accurately recognise student postures with high precision, recall, F1-score, and mean average precision (mAP), achieving an average precision of 88%, recall of 89%, F1-score of 88%, and mAP of 95.20% the real-time processing capability of YOLOv3 allows for immediate posture detection during lectures in a classroom; this may help educators monitor student behaviour and engagement. © 2023 IEEE.