An enormous, 144-core CPU from Nvidia is coming to a system near you

New servers coming out in the first half of 2023 will have Nvidia’s much-anticipated Grace CPU Superchip.

In addition to the new systems from the likes of Asus, Gigabyte, Supermicro, and others, Nvidia hinted at Computex 2022 for four further 2U reference designs.

Nvidia seems to anticipate that the new Grace-powered Arm-based servers will be a useful addition to the market rather than a replacement for x86-based systems.

CPU Superchip from Nvidia Grace

In a similar vein to Apple’s M1 Ultra, the Grace CPU Superchip was unveiled at GTC 2022 earlier this year. It consists of two Grace CPUs coupled together through high-speed NVLink interface.

With 1TB/s of bandwidth and 396MB of on-chip cache, Nvidia says its 144-core monster will be the fastest processor for AI, HPC, and other high-performance computing applications.

In announcing the new chip, Nvidia CEO Jensen Huang described it as a “new form of data center—AI factories that filter and refine mountains of data to generate insight.”

One chip with the fastest speed, memory bandwidth, and Nvidia software platforms available, the Grace CPU superchip is set to shine as the CPU for the world’s artificial intelligence infrastructure.

The enthusiasm around the new Nvidia processors will grow as definite dates for the introduction of the first Grace CPU Superchip-powered servers have been announced.

Specific use cases, such as cloud gaming, digital twins, high-performance computing (HPC), and artificial intelligence (AI), are addressed by each of the four reference designs. For example, Nvidia claims that partners may “immediately spin up motherboards utilising their current system architectures” using the designs.

While a number of major server manufacturers have already stated their intention to produce systems based on the Grace architecture, Nvidia will be hoping for more in the months to come.