Melexis ＆ Emotion3D Combine DMS and HUD Dynamic Object Alignment in A Single Camera
Tessenderlo, Belgium, 20 September 2021 - Melexis, a global leader in automotive semiconductors, and emotion3D, a leading provider of camera-based automotive in-cabin analysis software, have joined forces to offer a unique 3D Time-of-Flight (ToF) demonstrator. The solution combines the driver monitoring system (DMS) with high-precision 3D driver localization, to dynamically align augmented reality head-up displays (AR HUD) objects.
Melexis and emotion3D’s novel DMS covers all basic functions such as driver drowsiness and attention warning to conform to the EU’s General Safety Regulation and Euro NCAP’s testing protocols. In addition, the demonstrator provides 3D locations of the driver’s facial landmarks. These are relevant for an optimal augmented reality head-up display (AR HUD) user experience. The objects projected by the HUD require precise alignment with real-world objects, following the dynamic position changes of the driver.
The demonstrator consists of a camera built around Melexis’ MLX75027 3D ToF sensor and emotion3D’s advanced in-cabin analysis software (E3D ICMS). The software can be flexibly integrated in any automotive SoC of choice.
“Regulatory requirements make it necessary to integrate DMS into new vehicles and augmented reality head-up displays become more and more popular. Our combined system offers a highly precise and cost-efficient solution for automotive manufacturers”, notes Florian Seitner, CEO of emotion3D.
Gualtiero Bagnuoli, Product Marketing Manager at Melexis, comments on the benefits of ToF technology: “We combine accurate and robust 3D eye position detection for HUD with sunlight invariant eye gaze and eye openness detection for leaner DMS algorithm implementations. Use of ToF technology is key. It is very easy to get accurate depth data from the 3D ToF sensor with low processing effort. The result is that the DMS and HUD algorithms work impressively well with wide-field of view lenses and VGA resolution ToF sensors.”
- +1 Like
- Add to Favorites
Recommend
- Melexis VGA ToF Sensor IC MLX75027 the Full Potential of Automotive 3D ToF Imaging
- Melexis Pushes Back the Boundaries of ToF Technology for Automotive Applications by MLX75027
- Melexis ToF sensor MLX75027RTI/STI Supports Automotive and Industrial Functional Safety Applications
- Li Auto Inc. Selected Melexis MLX75027 3D Depth Sensor for In-car Gesture Control
- MulticoreWare Partners with Melexis to Develop Face Anti-spoofing AI Using ToF
- Melexis Announces an Exclusive License Agreement with Chronoptics to Further Enhance Its Time-of-flight Offering
- Melexis Announces World-first Combined Sensor MLX91805 for Smart Tires
- Melexis Reveals High-accuracy Current Sensors Optimized for Affordable E-mobility
This document is provided by Sekorm Platform for VIP exclusive service. The copyright is owned by Sekorm. Without authorization, any medias, websites or individual are not allowed to reprint. When authorizing the reprint, the link of www.sekorm.com must be indicated.
Integrated Circuits
Discrete Components
Connectors & Structural Components
Assembly UnitModules & Accessories
Power Supplies & Power Modules
Electronic Materials
Instrumentation & Test Kit
Electrical Tools & Materials
Mechatronics
Processing & Customization
