Fusing Multiple Sensor Modalities for Complex Physiological State Monitoring

Report No. ARL-TR-6283
Authors: Daniel Silversmith, Nicholas Perkons, Kesshi Jordan, Justin Brooks, William Hairston, Scott Kerick, Brent Lance, Kaleb McDowell, and William Nothwang
Date/Pages: December 2012; 38 pages
Abstract: Both the public sector and the military are working on developing drowsiness detection systems, as driver fatigue is a significant contributor to motor vehicle accidents. Individually, electroencephalography (EEG) and eye-tracking measures are tenuous indicators of driver fatigue and impairment. This project proposes to integrate multiple sensor modalities in order to improve drowsiness level assessment and driver performance prediction. There is substantial evidence supporting the correlation of alpha bursts in EEG (narrowband alpha power density increases lasting 500 ms to several seconds) and eye-tracking measures, such as pupil diameter and gaze distribution, with drowsiness. As a step towards multi-sensory data fusion, we aim to implement in real time an optimized version of an existing algorithm for the automatic detection of alpha bursts using a single EEG channel and ascertain correlations between alpha bursts, eye-tracking measures, and behavioral indicators of fatigue that include standard deviation of both lane position and acceleration. The ability to reliably detect alpha bursts in real-time combined with established correlations will allow an algorithm to accurately predict driver performance in a simulation environment.
Distribution: Approved for public release
  Download Report ( 0.895 MBytes )
If you are visually impaired or need a physical copy of this report, please visit and contact DTIC.

Last Update / Reviewed: December 1, 2012