Esperanto Technologies Announces RISC-V Industry Milestone of Generative AI Models Running on ET-SoC-1; Access to be Made Available to the RISC-V Research Community

Find the Latest SoC Solutions
for... Automotive... IoT... Security... Audio... Video

Initial Work Includes Running a Range of Large Language Models,

www.esperanto.ai/, Apr. 19, 2023 – 

MOUNTAIN VIEW, Calif., April 19, 2023 – Esperanto Technologies™, the leading developer of high performance, energy-efficient artificial intelligence solutions based on the RISC-V instruction set, today announced that it has ported and is running a range of Generative AI models on its low power RISC-V hardware. Esperanto plans to provide access to researchers in the RISC-V community as part of the company's mission to help "democratize AI" for the broader industry and help accelerate development of Generative AI technology on RISC-V.

Researchers interested in obtaining more information can contact Esperanto at www.esperanto.ai/contact.

This development is part of Esperanto's strategy to extend the benefits of RISC-V technology in AI and general-purpose applications from cloud to edge. Areas of focus for Esperanto's Generative AI efforts include use cases for large language models (LLMs) where using low power hardware with improved total cost of ownership (TCO) compared to existing offerings are key.

In particular, several versions of Meta's Open Pre-Trained Transformer (OPT) model are now running on Esperanto's hardware at multiple precision levels and context sizes with power levels as low as 25W per chip for inferencing. The rapid porting and bring-up of the OPT models onto ET-SoC-1 silicon were enabled by Esperanto's machine learning software development kit, which is currently in use by the company's commercial customers. Researchers who are granted access to Esperanto's solutions for R&D purposes will be required to comply with Meta's open-source license as well as other program terms.

"Generative AI is one of the latest advancements in machine learning, and we are pleased to contribute elements of our efforts in the area of large language models to the RISC-V research community," said Art Swift, president and CEO at Esperanto Technologies.

"Penguin Computing is proud to be a strategic partner of Esperanto, helping to accelerate the deployment of high performance, low power Generative AI solutions," said Thierry Pellegrino, president of Penguin Solutions and senior vice president of Intelligent Platform Solutions at Smart Global Holdings. "We are excited to be working with Esperanto to extend the deployment of its RISC-V solutions to a broader set of customers that are searching for low power AI inference solutions and reduced total cost of ownership."

"The growing interest in RISC-V signals an important inflection point for the semiconductor industry. This development in the area of Generative AI will further accelerate the evaluation of RISC-V by researchers looking for breakthroughs in this exciting field, and by developers seeking to increase their competitive differentiation beyond what existing platforms can provide," said Ben Bajarin, CEO and principal analyst at Creative Strategies.

click here to read more...

 Back