Eyeware and Melexis collaborate on driver monitoring systems

The 3D time-of-flight cameras are claimed to overcome the limitations of infrared-based tracking technology.

The company has developed algorithms using proprietary machine learning approaches, designed for systems using low power, cost-effective and compact sensors.

The range data provided by the 3D time-of-flight sensor is used to increase the reliability of the head and gaze tracking capabilities of the system, enabling it to monitor a very wide range of head movement.

These sensors feature a VGA 640x480px array based on Sony’s Depthsense technology. It reaches a maximum full resolution framerate of 135FPS, with up to 4 raw phases per frame.

The VGA 3D ToF sensor measures 14x14x2.2mm, allowing it to be integrated into the rear-view mirror assembly. It operates at a temperature range of -40°C to 105°C and is AECQ100-certified.

Gualtiero Bagnuoli, product marketing manager, Melexis, says “[The] MLX75027 3D time-of-flight sensor with VGA resolution, used in the demonstrator, employs a high modulation frequency (20-100MHz) to drive the IR illumination. Along with the patented pixel design, this means the sensor is almost completely unaffected by light, resulting in robust and reliable operation under changing conditions, such as sunset.”

“Although the resolution of the 3D time-of-flight sensor is lower than current driver monitoring system cameras, the DMS needs just one MLX75027 VGA 3D ToF sensor to track both driver and passenger,” Bagnuoli says.

Kenneth Funes, CEO and co-founder, Eyeware, added: “We can localize eyes well, even under low resolution settings or under large head movements. Our technology also operates in a multiuser environment, to monitor car interiors with multiple passengers.”