Unimore logo AImageLab

Mercury: a vision-based framework for Driver Monitoring

Abstract: In this paper, we propose a complete framework, namely Mercury, that combines Computer Vision and Deep Learning algorithms to continuously monitor the driver during the driving activity. The proposed solution complies to the require-ments imposed by the challenging automotive context: the light invariance, in or-der to have a system able to work regardless of the time of day and the weather conditions. Therefore, infrared-based images, i.e. depth maps (in which each pixel corresponds to the distance between the sensor and that point in the scene), have been exploited in conjunction with traditional intensity images. Second, the non-invasivity of the system is required, since driver’s movements must not be impeded during the driving activity: in this context, the use of camer-as and vision-based algorithms is one of the best solutions. Finally, real-time per-formance is needed since a monitoring system must immediately react as soon as a situation of potential danger is detected.


Borghi, Guido; Pini, Stefano; Vezzani, Roberto; Cucchiara, Rita "Mercury: a vision-based framework for Driver Monitoring" Proceedings of the 3rd International Conference on Intelligent Human Systems Integration: Integrating People and Intelligent Systems (IHSI 2020), Modena, Italy, 19-21 February 2020, 2020 DOI: 10.1007/978-3-030-39512-4_17

 not available

Paper download:

Related projects: