TY - JOUR
T1 - An orientation sensor-based head tracking system for driver behaviour monitoring
AU - Zhao, Yifan
AU - Görne, Lorenz
AU - Yuen, Iek Man
AU - Cao, Dongpu
AU - Sullman, Mark
AU - Auger, Daniel
AU - Lv, Chen
AU - Wang, Huaji
AU - Matthias, Rebecca
AU - Skrypchuk, Lee
AU - Mouzakitis, Alexandros
PY - 2017/11/22
Y1 - 2017/11/22
N2 - Although at present legislation does not allow drivers in a Level 3 autonomous vehicle to engage in a secondary task, there may become a time when it does. Monitoring the behaviour of drivers engaging in various non-driving activities (NDAs) is crucial to decide how well the driver will be able to take over control of the vehicle. One limitation of the commonly used face-based head tracking system, using cameras, is that sufficient features of the face must be visible, which limits the detectable angle of head movement and thereby measurable NDAs, unless multiple cameras are used. This paper proposes a novel orientation sensor based head tracking system that includes twin devices, one of which measures the movement of the vehicle while the other measures the absolute movement of the head. Measurement error in the shaking and nodding axes were less than 0.4°, while error in the rolling axis was less than 2°. Comparison with a camera-based system, through in-house tests and on-road tests, showed that the main advantage of the proposed system is the ability to detect angles larger than 20° in the shaking and nodding axes. Finally, a case study demonstrated that the measurement of the shaking and nodding angles, produced from the proposed system, can effectively characterise the drivers’ behaviour while engaged in the NDAs of chatting to a passenger and playing on a smartphone.
AB - Although at present legislation does not allow drivers in a Level 3 autonomous vehicle to engage in a secondary task, there may become a time when it does. Monitoring the behaviour of drivers engaging in various non-driving activities (NDAs) is crucial to decide how well the driver will be able to take over control of the vehicle. One limitation of the commonly used face-based head tracking system, using cameras, is that sufficient features of the face must be visible, which limits the detectable angle of head movement and thereby measurable NDAs, unless multiple cameras are used. This paper proposes a novel orientation sensor based head tracking system that includes twin devices, one of which measures the movement of the vehicle while the other measures the absolute movement of the head. Measurement error in the shaking and nodding axes were less than 0.4°, while error in the rolling axis was less than 2°. Comparison with a camera-based system, through in-house tests and on-road tests, showed that the main advantage of the proposed system is the ability to detect angles larger than 20° in the shaking and nodding axes. Finally, a case study demonstrated that the measurement of the shaking and nodding angles, produced from the proposed system, can effectively characterise the drivers’ behaviour while engaged in the NDAs of chatting to a passenger and playing on a smartphone.
KW - Attention level
KW - Autonomous driving
KW - Computer vision
KW - Non-driving activities
UR - http://www.scopus.com/inward/record.url?scp=85035139984&partnerID=8YFLogxK
U2 - 10.3390/s17112692
DO - 10.3390/s17112692
M3 - Article
C2 - 29165331
AN - SCOPUS:85035139984
SN - 1424-8220
VL - 17
JO - Sensors (Switzerland)
JF - Sensors (Switzerland)
IS - 11
M1 - 2692
ER -