CoBot – the smart AI assembly workstation
With the CoBot - Collaborative Robot - Fraunhofer IOSB in cooperation with PWC strategy& demonstrates an innovative AI-based assembly assistance system in which robots and humans work together collaboratively in manual assembly.
The assistance system combines state-of-the-art AI machine learning methods to demonstrate the possibilities of an intuitive, worker-centric and efficient assembly assistance system that can intelligently respond and adapt to the workers and their activities. By recording the activities of the worker, the assistance system can understand in which step which actions are being followed. It can also intervene to ensure quality and use the robotic arms to proactively and efficiently assist in the various phases of assembly.
AI-based people and work environment detection for intelligent assembly assistance
Cameras installed on the table can be used to identify people in front of the table and continuously detect and analyze their posture and movements. The position and orientation of arms and hands can be used to readily infer grips and manual work. In addition, the camera detects the position and orientation of all tools used, so that not only movements but also interactions and the handling of screwdrivers, for example, can be traced.
The work steps to be performed are modeled and stored as instructions in the assistance system, allowing the actual activity to be compared with the target activity and deviations to be detected. At the same time, completed work steps are tracked, documented as completed and the display is switched to the next work step.