Projects and products

We designed and executed a systematic, multi-modal benchmark of four ADAS-relevant sensing technologies – RGB camera, long-wave infrared (LWIR/thermal) camera, LiDAR, and imaging radar – for pedestrian detection in rain, fog, and night conditions.

Easily utilize industrial data spaces: The Data Space Consumer from Fraunhofer IOSB automates secure, sovereign data exchange—covering everything from searching for data sources, identity verification, and contract negotiation to the actual transfer. This modular, open-source solution lowers technical barriers to entry and integrates flexibly into existing system landscapes.

LLM4OPC enables interaction with industrial systems via a secure, natural language interface. Through OPC UA and Asset Administration Shells (AAS), connected via the Model Context Protocol (MCP), Large Language Models (LLMs) can read live machine data, explain machine statuses in an understandable way, and - upon approval - execute actions.

Novel applications of quantum technology for imaging - this is what the lead project QUILT is all about. At Fraunhofer IOSB, a technology for remote sensing using entangled photons is being developed.

Significant costs in the operation of wind turbines (WTG) are incurred through maintenance and repair. Downtimes caused by such work must be minimized, but failures due to damage not recognized in time must also be avoided.

Military reconnaissance in adverse atmospheric conditions requires imaging techniques capable of providing high-resolution images through scattering and turbulent media. Active imaging is the method of choice for critical applications where high precision and reliability are required.

Our solutions make it possible to operate equipment and systems using natural language while they are running and to interact with them in a targeted manner.

"Several Fraunhofer Institutes are collaboratively developing a data space solution for the independent and interoperable exchange of PCF data across borders."

Making aircraft more fuel-efficient is one of the aviation industry's most important goals. To this end, Lufthansa Technik uses AeroSHARK, a technology inspired by shark skin, which significantly reduces frictional drag and thus emissions. To attach the coating optimally, however, it is necessary to conduct flow simulations, which take the actual wing shape during flight into account. Measuring this is a challenge - and a specialty of the Fraunhofer Institute of Optronics, System Technologies and Image Exploitation IOSB. This was demonstrated during successful measurement flights by Lufthansa Technik.

In the Fraunhofer SWAP lighthouse project, ten Fraunhofer institutes are developing technological concepts for the modular and self-organised production of the future, which will no longer be controlled centrally but decentrally - all the way to hierarchical swarms whose participants work together collaboratively and (partially) autonomously.

In the lighthouse project Factory-X, an open and collaborative data ecosystem for factory outfitters and operators is being developed on the basis of Catena-X and concepts of the Industry 4.0 platform. Fraunhofer IOSB is involved in or leading a number of use cases.

Faster set-up and changeover: In the project, consistent plug-and-work capability was achieved in production-related software components - using the AutomationML and OPC UA standards. In the process, non-I4.0-communication-capable components are also retrofitted with I4.0 features.

"TRM4" (originally from: Thermal Range Model) is a software package developed over decades for the development and performance evaluation of optronic camera systems.

The TRM4 Batch Module is a customized solution that we offer our customers for performing TRM4 calculations in batch. Here, customers define which set of TRM4 input parameters they want to change and which output parameters they want to access. In return, we provide a C programming interface for TRM4 that can be integrated into third-party software with a compatible C interface (e.g. Python, Matlab) to perform TRM4 calculations in batch for the defined input and output parameters.

For performance evaluation of electro-optical systems, image simulations have advantages and disadvantages over analytical models such as TRM4 . Here, the greatest advantages arise from the use of image data, which allows realistic simulation of anisoplanatic and statistical effects such as turbulence, as well as simulation of advanced digital signal processing techniques.

The AktiMeter is an innovative product developed for the automatic recording of human movements, gestures, postures, activities, and interactions with objects in the vehicle interior.

The production of high-performance carding assemblies for the textile industry is extremely complex and requires a high degree of precision. The “Machine Learning for Textile Industry” (ML4Tex) project optimizes this process by predicting the quality of the final product during production.

The XAI toolbox developed by Fraunhofer IOSB is designed with AI explainability at its core. It enables the swift evaluation of various XAI methods for AI procedures.

With the CoBot - Collaborative Robot - Fraunhofer IOSB in cooperation with PWC strategy& demonstrates an innovative AI-based assembly assistance system in which robots and humans work together collaboratively in manual assembly.

Whether you’re a pioneer from industry, an SME, a skilled-trades business, the municipal or government sector, or an emergency services organization: As the Fraunhofer IOSB’s Humanoid Robots Experience Lab (HREL), we offer you low-threshold, hands-on access to humanoid robotics.

Das Fraunhofer IOSB hat eine KI entwickelt, die auf Basis aktueller Messwerte den Alterungszustand eines Katalysators zur Methanoxidation (Reinigung der Abgase von Schiffsmotoren) bestimmt.

"Pat-Re" (Pattern-Retrieval) is a software tool for searching similar images.

The "STANAG 4609 Validator" was developed for the analysis and simulation of compatible image material.

The "Network Enabled Surveillance and Tracking (NEST)" project aims to create an autonomous surveillance system.

The aim of the "ivisX project" is to develop a software tool for the professional preparation and forensic analysis of video mass data, in particular for efficient navigation and search in large databases.

The aim of "Towards Ubiquitous Low-power Image Processing Platforms (TULIPP)" is to create a reference platform for high-performance and energy-efficient image processing embedded systems. The TULIPP project is funded by the European Mission.

The "m3motion system" offers an improvement in terms of security and surveillance by enabling the detection and tracking of moving objects.

The software tool "DevEnviro" serves the efficient and prototypical platform-independent development and implementation of image evaluation procedures under C/C++.

"PERFORMANCE" is a project of the Federal Ministry of Education and Research (BMBF). It is a cooperative system platform for video upload, evaluation, partially automated analysis and archiving.

"ABUL" is an interoperable video evaluation system with integrated real-time and offline procedures and various visualisation components to support the evaluator.