Connect with us

Innovation and Technology

NVIDIA Storage and Memory Requirements

Published

on

NVIDIA Storage and Memory Requirements

NVIDIA’s Project DIGITS Announcement at the 2025 CES

Keynote Talk by Jensen Huang

NVIDIA CEO Jensen Huang gave an hour and 45-minute keynote talk just before the start of the 2025 CES. He gave many announcements, including announcing a desktop AI machine called Project DIGITS, shown above, that should be available in May, in partnership with MediaTek.

Storage and Memory in NVIDIA Products

In this article, we will talk about storage and memory and their use in some of the products discussed in Jensen’s keynote talk.

RTX Blackwell Device

The RTX Blackwell device that powers the Blackwell GeForce RTX 50 desktop and laptop GPUs is shown below, with Jensen holding the desktop version. It has 1.8TB/s memory bandwidth with up to 32GB of VRAM (video random access memory for storing graphics data). Jensen pointed out that G7 (GDDR7) memory was sourced from Micron, one of two call-outs to Micron memory products in his presentation (the other was to HBM memory used in the Grace Blackwell NVLink72 shown below).

GeForce RTX 50 Series GPUs

The GeForce RTX 50 Series GPUs run creative generative AI models up to 2X faster in a smaller memory footprint compared to the previous generation product. The GPUs support FP4, a quantization method to decrease image model sizes, somewhat similar to file compression. As a result, FP4 uses less than half of the memory and twice the performance and this is done with virtually no loss in the quality of the images.

Grace Blackwell NVLink72

Jensen showed an image of the Grace Blackwell NVLink72. This was introduced by NVIDIA in March of 2024. As shown below, this large chiplet includes 72 Blackwell GPUs and 36 Grace CPUs. It supports 1.4 exaflops per second, EFLOPS of Tensorflow 4-bit Floating Point processing.

NVIDIA Project DIGITS

At the very end of his talk Jensen introduced NVIDIA Project DIGITS with a new Grace Blackwell Superchip in a package that provides a desktop AI engine as shown below and at the beginning of this article. The GB10 Grace Blackwell Superchip is a system-on-a-chip (SoC) and provides a petaflop of FP4 AI computing performance that can be used for creating and running large AI models.

Conclusion

Jensen Huang from NVIDIA gave the first CES 2025 keynote talk and announced a slew of enterprise as well as consumer GPU products. Memory and storage play an important role in AI training and inference and his presentation showed how they enable modern AI solutions.

FAQs

* What is NVIDIA’s Project DIGITS?
NVIDIA’s Project DIGITS is a desktop AI machine that should be available in May, in partnership with MediaTek.
* What is the RTX Blackwell device?
The RTX Blackwell device is a device that powers the Blackwell GeForce RTX 50 desktop and laptop GPUs, providing 1.8TB/s memory bandwidth with up to 32GB of VRAM.
* What is the GeForce RTX 50 Series GPUs?
The GeForce RTX 50 Series GPUs run creative generative AI models up to 2X faster in a smaller memory footprint compared to the previous generation product.

Advertisement

Our Newsletter

Subscribe Us To Receive Our Latest News Directly In Your Inbox!

We don’t spam! Read our privacy policy for more info.

Trending