Fraunhofer Institute of Optronics, System Technologies and Image Exploitation IOSB
Fraunhofer Institute of Optronics, System Technologies and Image Exploitation IOSB

White Paper »Pioneering In-Cabin Monitoring«

Unmasking the Power of 2D and 3D Cameras through Sensor Fusion

Our latest white paper with a focus on sensor fusion!

Advanced In-Cabin Monitoring Systems will significantly change the user experience of passenger cars and promise to become the next fundamental milestone for vehicle safety.

In this white paper "Pioneering In-Cabin Monitoring — Unmasking the Power of 2D and 3D Cameras", Fraunhofer IOSB experts on computer vision and automotive in-cabin sensing provide helpful insights to

  • Current and future legislation on driver monitoring systems
  • Current and future applications and functions of occupant monitoring
  • Roadmap towards the future of in-cabin monitoring
  • Sensor comparisons, especially benefits of 2D vs 3D sensing
  • Outlook to the impact of generative AI, LLM and multi modal vision models.

Contact us for more information, research collaboration and contracted research. 

AI architectures for novel computer vision applications

Privacy warning

With the click on the play button an external video from www.youtube.com is loaded and started. Your data is possible transferred and stored to third party. Do not start the video if you disagree. Find more about the youtube privacy statement under the following link: https://policies.google.com/privacy

Human-AI Interaction at Fraunhofer IOSB – Research at the interface of humans, AI, and technology

We offer and develop intelligent AI assistance systems for vehicles. Thanks to our solutions, the interior becomes smart, intuitive and proactive.

From expert advice and the joint development of solutions to the evaluation of your systems: As an experienced partner, we are happy to assist you with your project!

Our projects on this topic

 

© Fraunhofer IOSB

Motion sickness prevention

An AI-based system was developed as part of the KARLI project to prevent motion sickness in automated vehicles.

More info
 

© Fraunhofer IOSB

AktiMeter

The AktiMeter uses 3D activity detection to record body poses while riding and can distinguish between different gestures in real time.

To AktiMeter
 

© Fraunhofer IOSB

KALLE - Karlsruhe road lab for level 3 evaluation

Mobile laboratory for automated driving. Observe drivers, understand users.

To KALLE
 

© Fraunhofer IOSB

SALSA

We develop smart, adaptive, and learnable systems for everyone (SALSA) for automated driving. Our focus is on the willingness to take over driving tasks in the vehicle interior.

To SALSA
 

AI in the vehicle of the future

An AI system for detecting passenger conditions and driver-vehicle interactions in the vehicle interior was developed in KARLI.

To KARLI
 

INITIATIVE

INITIATIVE integrates AI-supported adaptive human-machine communication into automated vehicles to increase road safety.

To INITIATIVE
 

PAKoS

Camera-based driver monitoring with PAKoS ensures safe transfer of vehicle control between the driver and the autonomous driving assistant.

To PAKOS
 

InCarIn: Intelligent Car Interieur

Just momentarily distracted? InCarIn records the individual needs of all passengers so that the system can respond and react accordingly.

To InCarIn
 

ED/OM

In ED/OM (European Data for Occupant Monitoring Systems), Fraunhofer IOSB worked together with industry partners to address issues relating to future driver monitoring systems.

To ED/OM

Weitere Infos

 

Department HAI of Fraunhofer IOSB

Would you like to learn more about our competence and service spectrum in the field of Human-AI Interaction? Then visit the HAI department page.

 

To the HAI department
 

© KARLI / TMD

We're blogging

In the Fraunhofer IOSB blog, we share our expert knowledge on current automotive topics in the field of human-machine interaction. With lots of insights from studies and the current status of Research!

Our Blog