AktiMeter – in-cabin monitoring for intelligent, real-time behavior analysis

What is the Fraunhofer IOSB AktiMeter?

The Fraunhofer IOSB AktiMeter is a modular research and proof-of-concept system for AI-based in-cabin monitoring. It has been developed to automatically detect human movements, body postures, gestures, activities, object interactions and relevant events in vehicle interiors.

The system is designed for research, development and evaluation tasks in real vehicles, driving simulators and laboratory environments. It supports the development of adaptive safety, comfort and assistance functions by translating complex in-cabin video streams into structured, searchable and usable information.

The new AktiMeter combines two complementary operating modes. In real-time mode, it analyzes the in-cabin situation locally in the vehicle and can run on compact edge hardware powered via a 65-watt USB-C connection. In offline mode, it enables the retrospective exploration of long-duration in-cabin videos from driving studies, own datasets or externally collected data.

Across both modes, AktiMeter supports prompt-based search, keyword-based search, body-pose-based search, object search, activity search and event-based search. This allows users to identify relevant situations quickly, inspect long video recordings efficiently and evaluate in-cabin behavior in a structured way.

By processing anonymous skeletal data and configurable semantic event information, the AktiMeter supports privacy-aware analysis workflows and GDPR-compliant research settings. With live visualization, real-time data output, extensive data logging, export functions and a programming interface for system integration, it provides a flexible tool for scientific studies, industrial prototyping and applied automotive research.

What is the Aktimeter used for?

Fraunhofer IOSB’s AktiMeter records and analyzes the natural behavior of occupants in vehicle interiors. It is used in research vehicles, driving simulators and experimental test setups to investigate how occupants sit, move, interact with objects and respond to automated or assisted driving functions.

Customers and research partners use the AktiMeter to develop and evaluate adaptive in-cabin systems, driver and occupant monitoring functions, human-machine interaction concepts, assistance systems and prototype demonstrations. The real-time capability is particularly valuable for live demonstrators, in-vehicle proof-of-concept functions and experimental studies in moving vehicles.

The offline analysis mode enables the automated evaluation and semantic search of long video recordings, for example from naturalistic driving studies, Car Clinics, benchmark studies or user-centered product evaluations. Instead of manually inspecting hours of video material, users can search for specific postures, objects, activities, events or situations of interest.

AktiMeter therefore supports both immediate in-vehicle analysis and systematic retrospective data exploration. It helps researchers and developers to understand real occupant behavior, derive design requirements and validate new concepts for safer, more adaptive and more context-aware vehicle interiors.

Who benefits from AktiMeter?

  • Automotive R&D and AI teams: Develop and test adaptive in-cabin functions based on real occupant behavior, semantic events and structured video analysis.
  • Driver and occupant monitoring developers: Evaluate body poses, activities, object interactions and relevant in-cabin events in real vehicles or simulators.
  • Passive safety and smart restraint developers: Investigate occupant posture, seating position, activities and context information as a basis for future adaptive safety concepts.
  • UX, HMI and market research teams: Analyze how users behave in the vehicle interior and how they interact with assistance, comfort and automation functions.
  • Ergonomics and human factors researchers: Capture posture, movement and activity data for human-centered design decisions and scientific studies.
  • Demonstrator and product teams: Present live AI-based in-cabin functions and support claims with measurable behavioral data.

 

 

Your added value with the AktiMeter

AktiMeter by Fraunhofer IOSB is an AI-powered behavior analysis system that automatically detects human activities, gestures, postures, and object interactions in real time. By transforming video data into anonymized behavioral insights, AktiMeter enables faster research, smarter product development, and more effective user-centered design - all while maintaining GDPR compliance. Whether in vehicles, simulators, ergonomic studies, or market research, AktiMeter delivers objective, scalable, and actionable data to help organizations better understand how people really behave

Discover Your Benefit!

Real-time in-cabin analysis

The AktiMeter is used in contracted research projects by Fraunhofer to quickly deliver high quality results and will also be available for licensing on request.  

The AktiMeter analyzes the in-cabin situation in real time. It detects occupants, estimates body postures, recognizes gestures and activities, identifies interactions with objects and outputs relevant information while the vehicle is operating. This makes the system suitable for live demonstrators, research vehicles and prototype functions.

Research platform for next-generation in-cabin AI

AktiMeter serves as a proof-of-concept platform for context-aware and adaptive in-cabin functions. It combines real-time occupant understanding with scalable video analysis and can be used to explore future applications in driver monitoring, occupant monitoring, human-AI interaction, comfort functions, adaptive assistance systems and smart safety concepts.

 

 

Prompt-, keyword- and event-based exploration

AktiMeter supports several complementary search approaches: prompt-based search, keyword-based search, body-pose-based search, object search, activity search and event-based search. This enables flexible data exploration for different research questions and development tasks.

 

 

 

Gesture, object, activity and posture recognition

The system uses AI-supported methods to detect body postures, movements, gestures, activities and interactions with objects. It distinguishes typical in-cabin activities such as eating, drinking, talking on the phone, sleeping or reading and can be adapted to specific research questions.

Offline search in long in-cabin videos

The new AktiMeter enables retrospective search in long-duration in-cabin video recordings. Users can search datasets from driving studies, experimental campaigns or externally collected data and quickly identify relevant situations without manually reviewing entire videos.

 

API and system integration

The AktiMeter provides a programming interface for integration into existing research, simulation and demonstrator environments. Various export formats support further analysis, benchmarking and documentation.

 

 

Live visualization, data logging and export

A specially developed application visualizes detected body poses, activities and events in real time. The system can continuously log movement sequences and semantic events for subsequent evaluation, reporting or further processing.

 

Our latest white paper with a focus on sensor fusion!

Advanced In-Cabin Monitoring Systems will significantly change the user experience of passenger cars and promise to become the next fundamental milestone for vehicle safety.

In this white paper "Pioneering In-Cabin Monitoring — Unmasking the Power of 2D and 3D Cameras", Fraunhofer IOSB experts on computer vision and automotive in-cabin sensing provide helpful insights to

  • Current and future legislation on driver monitoring systems
  • Current and future applications and functions of occupant monitoring
  • Roadmap towards the future of in-cabin monitoring
  • Sensor comparisons, especially benefits of 2D vs 3D sensing
  • Outlook to the impact of generative AI, LLM and multi modal vision models.

Contact us for more information, research collaboration and contracted research. 

 

AI and the vehicle interior

 

HAI Department

Would you like to find out more about our range of expertise and services in the field of Human-AI Interaction? Then visit the HAI department page.

 

Interested?

Are you interested in one of our products or a cooperation? Or would you simply like to find out more? Get in touch with us!