Vital signs: Improving the safety and comfort of vehicles using AI algorithms

Find the Latest SoC Solutions
for... Automotive... IoT... Security... Audio... Video

The transport of tomorrow will not only be autonomous – it will also be comfortable and safe. At IAA MOBILITY 2023 in Munich, the Fraunhofer Institute for Microelectronic Circuits and Systems IMS will present AI algorithms that massively improve transportation safety and comfort. To achieve this, optical sensors record vital signs, such as heart and respiratory rates. This data is processed by specially developed AI algorithms. The algorithms are modular and easy to integrate into cars and existing systems. They offer entirely new measurement options for car manufacturers. This development is supported by the European New Car Assessment Programme (Euro NCAP), which requires the installation of internal cameras in vehicles. The Fraunhofer-Gesellschaft will present this innovation and many more at the joint Fraunhofer booth in Hall B1, Booth D11.

www.fraunhofer.de/en.html, Sept. 01, 2023 – 

The vehicles of the future will not only monitor other road users. Sensors in the car interior will work with AI algorithms to make travel significantly safer and more comfortable for the driver and passengers: "Intelligent image and signal processing, paired with AI-based algorithms, can extract minute changes in intensity or micromovements on the skin and in the entire human body. The signals recorded can be used to determine vital signs such as heart and respiratory rate," explains Dr. Christian Wiede, head of Embedded AI at Fraunhofer IMS. A person's respiratory rate is visible, for example, through slight chest movements and can thus be measured, whereas the little-known optical technique of photoplethysmography allows heart rate to be monitored. This technique relies on the heart's contractions, recording subtle changes to the intensity of light on the skin. These changes, invisible to the eye, can be detected by standard cameras.

Benefits for the transport of tomorrow

In terms of comfort and safety, this development offers many advantages to the transport of tomorrow: By monitoring the vital signs of car, industrial vehicle and train drivers, emergencies can be anticipated and, in best-case scenarios, avoided. Comfort functionalities such as temperature, sound and light controls can also be better tailored to the driver, improving the driving experience.

This kind of camera-based monitoring is contact-free and does not require any active input from the driver. This not only increases comfort, but also acceptance of this type of system. Fraunhofer IMS has developed a modular software library, which facilitates integration into existing vehicle applications and assistance systems. This ensures that integration is possible without relying on car manufacturers or suppliers.

In the future, it will be possible to add further parameters, such as blood pressure, stress symptoms, alcohol intoxication and more to the system.

click here to read more...

 Back