Fatigue detection, Multimodal physiological signals, Deep transfer learning, Uncertainty-aware learning, Driver monitoring
," /> Fatigue detection, Multimodal physiological signals, Deep transfer learning, Uncertainty-aware learning, Driver monitoring
,"/> Fatigue detection, Multimodal physiological signals, Deep transfer learning, Uncertainty-aware learning, Driver monitoring,"/> Fatigue Detection with Multimodal Physiological Signals via Uncertainty-Aware Deep Transfer Learning

Quick Search Adv. Search

Journal of Bionic Engineering ›› 2026, Vol. 23 ›› Issue (1): 472-487.doi: 10.1007/s42235-025-00827-0

Previous Articles     Next Articles

Fatigue Detection with Multimodal Physiological Signals via Uncertainty-Aware Deep Transfer Learning

Kourosh Kakhi1, Hamzeh Asgharnezhad1, Abbas Khosravi1, Roohallah Alizadehsani1, U. Rajendra Acharya2   

  1. 1 Institute for Intelligent Systems Research and Innovation,Deakin University, Geelong, Victoria, Australia 2 School of Mathematics, Physics and Computing, Universityof Southern Queensland, Toowoomba, Queensland, Australia
  • Online:2026-02-15 Published:2026-03-17
  • Contact: Kourosh Kakhi1,Roohallah Alizadehsani1 E-mail:kkakhi@deakin.edu.au, r.alizadehsani@deakin.edu.au
  • About author:Kourosh Kakhi1, Hamzeh Asgharnezhad1, Abbas Khosravi1, Roohallah Alizadehsani1, U. Rajendra Acharya2

Abstract: Accurate detection of driver fatigue is essential for improving road safety. This study investigates the effectiveness ofusing multimodal physiological signals for fatigue detection while incorporating uncertainty quantification to enhancethe reliability of predictions. Physiological signals, including Electrocardiogram (ECG), Galvanic Skin Response (GSR),and Electroencephalogram (EEG), were transformed into image representations and analyzed using pretrained deep neural networks. The extracted features were classified through a feedforward neural network, and prediction reliabilitywas assessed using uncertainty quantification techniques such as Monte Carlo Dropout (MCD), model ensembles, andcombined approaches. Evaluation metrics included standard measures (sensitivity, specificity, precision, and accuracy)along with uncertainty-aware metrics such as uncertainty sensitivity and uncertainty precision. Across all evaluations,ECG-based models consistently demonstrated strong performance. The findings indicate that combining multimodal physiological signals, Transfer Learning (TL), and uncertainty quantification can significantly improve both the accuracy andtrustworthiness of fatigue detection systems. This approach supports the development of more reliable driver assistancetechnologies aimed at preventing fatigue-related accidents.

Key words: Fatigue detection, Multimodal physiological signals, Deep transfer learning, Uncertainty-aware learning, Driver monitoring')">Fatigue detection, Multimodal physiological signals, Deep transfer learning, Uncertainty-aware learning, Driver monitoring