Nvidia, Cadence, and Ceva Keep Up With AI Processing Demands

Find the Latest SoC Solutions
for... Automotive... IoT... Security... Audio... Video

Each of these companies has introduced new hardware in the hopes of supporting modern AI workloads.

www.allaboutcircuits.com/, Aug. 16, 2023 – 

A recent Grand View Research report provides the vague but powerful prediction that AI will grow by 37% between now and 2030.

With these significant advances in software, the hardware industry is feeling the pressure to keep up its own pace of advancement to match. Recent weeks have seen a number of new releases in the AI hardware realm, with notable launches coming from Nvidia, Cadence, and Ceva.

Nvidia Upgrades Grace Hopper AI Superchip

At Nvidia's SIGGRAPH 2023 event, the company unveiled a new Grace Hopper AI Superchip integrated with "the world's first HBM3e processor".

The new chip, the GH200 Grace Hopper, is said to be built explicitly for generative AI workloads, including large language models (LLMs), recommender systems, and vector databases. To this end, the platform introduces a new dual-configuration architecture that unlocks up to 3.5x more memory capacity and 3x more bandwidth than the current generation. Part of this increased memory bandwidth comes from Nvidia's NVLink interconnect technology, resulting in a combined 1.2 TB of fast memory when in dual configuration.

The super chip is based on Nvidia's Grace Hopper architecture and is made up of a single server with 144 Arm Neoverse cores supported by 282 GB of the latest HBM3e memory technology. The HBM3e memory, which is said to be 50% faster than the current HBM3, enables the chip to run models that are 3.5x larger while still achieving up to eight petaflops of AI performance.

click here to read more...

 Back