Edge AI: Energy-saving "building blocks" for smart end devices

Find the Latest SoC Solutions
for... Automotive... IoT... Security... Audio... Video

The purpose of Edge AI is to relocate artificial intelligence to where it is needed: end devices. For this to work, however, processing operations cannot be too energy-intensive. In the ECSEL projects ANDANTE and TEMPO, researchers at Fraunhofer IIS are paving the way for this emerging technology with the development of suitable chips, algorithms, and tools.

www.iis.fraunhofer.de, Jan. 04, 2021 – 

Thinking is hard work. Computers are no exception: In fact, they consume significantly more power when making decisions by recourse to artificial intelligence than people or animals. A dedicated AI processor uses 7000 times more energy than the brain of a bee to recognize a flower in an image, for example. This massive energy consumption is particularly problematic when it comes to transferring artificial intelligence to end devices – such as the sensors built into a bridge to detect changes in the structure's tension, or in wearable devices that can be switched on and off using voice controls. Applications like these are sometimes referred to as Edge AI. That said, this kind of artificial intelligence promises numerous benefits: It is able to function in the absence of an internet connection. It is substantially faster than conventional AI, which involves sending data to a cloud, and analyzing it there. And it safeguards privacy, data sovereignty, security, and safety, as data is only relinquished to the extent absolutely necessary, if at all. The main obstacle so far, however, is the vast energy consumption of the components involved.

The challenge of reducing energy consumption

But how can the energy needs of artificial intelligence be brought down to a level compatible with Edge AI applications? This is the question being investigated by research teams at Fraunhofer IIS led by Dr. Marco Breiling and Dr. Loreto Mateu, in two projects: TEMPO and ANDANTE, the latter also involving the Fraunhofer institutes EMFT and IPMS, alongside numerous other partners. "We are developing the energy-saving chips, hardware-aware algorithms, and corresponding tools needed for Edge AI. In this process, we already have the hardware's limitations in mind when developing the algorithms, besides taking them into account during optimization," says Dr. Marco Breiling, chief scientist at the Communication Systems division. In the project TEMPO, the research team is laying the foundations for the technology in the context of radar and LiDAR applications, while ANDANTE builds on this with a focus on voice activity detection.

click here to read more...

 Back