$NVIDIA (NVDA.US)$The launched GB200 NLV4 fills a key market demand. Additionally, NVIDIA plans to release its next-generation GB300 AI Server platform during the GTC conference from March 17 to 20, 2025, featuring the new B300 AI GPU with a power of up to 1400W, and FP4 performance that is 1.5 times that of the B200.

Recently, NVIDIA launched the mid-range platform GB200 NLV4, equipped with Grace CPU and Blackwell GPU, achieving a balance between performance and Energy efficiency, specifically designed for modern Datacenters.

Analysts believe that the launch of GB200 NLV4 coincides with NVIDIA's restructuring of its product portfolio—gradually phasing out the old NVL platform in favor of more advanced options like NVL4.

For medium-sized organizations, or those focusing on Energy efficiency, GB200 NLV4 is a highly suitable choice. Compared to the NVL72, which is designed for large-scale deployment and features edge connectors to support backbone configurations, NVL4 offers a more compact and Energy-efficient alternative.

Balancing performance with Energy efficiency.

At the core of GB200 NLV4 are two Grace CPUs based on Arm architecture, each equipped with 72 Arm Neoverse V2 cores, totaling 144 cores to provide the computational power necessary for executing high-performance tasks. Additionally, GB200 NLV4 is paired with four Blackwell GPUs.

Analysts indicate that this configuration is particularly suited for AI, high-performance computing (HPC), and other data-intensive applications.

Additionally, the GB200 NVL4 is equipped with six MCIO connectors under each CPU, ensuring fast PCIe connections to support seamless data transmission. These connectors support the integration of Network Interface Cards (NICs), Solid State Drives (SSDs), and other key components, providing the system with flexibility and scalability.

In terms of memory, the GB200 NVL4 offers up to 1.3 TB of unified memory, designed for organizations with memory-intensive workloads, ensuring efficient data processing.

In addition to its powerful performance, another highlight of the GB200 NVL4 is its energy efficiency.

NVIDIA estimates that a fully configured Server will consume approximately 6kW of Electrical Utilities. While this power consumption is not to be underestimated, it is only about half of earlier NVIDIA systems, such as the DGX-1 or HGX-1, which consumed about 3.5kW.

Will the GB300 be launched next year?

According to reports, NVIDIA plans to unveil its next-generation GB300 AI Server platform featuring the new B300 AI GPU, with a power consumption of up to 1400W, at the GTC conference on March 17-20, 2025. The FP4 performance is 1.5 times that of the B200.

Currently, NVIDIA's GB200 AI uses 192GB HBM3E memory in an 8-layer stacked configuration. According to UDN, the GB300 will utilize 288GB HBM3E memory in a 12-layer stack, a technology developed by SK hynix.

The rapid connection components and network cards of the GB300 AI Server platform have also been upgraded, with the speed of the optical modules increasing from 800G to an ultra-fast 1.6T. UDN reports that the performance and equipment have "improved in every aspect," making it NVIDIA's "market-winning Weapon."

In addition, there are some upgrades, such as adopting a slot design, the computing board will use LPCAMM, and the capacitor tray may become a standard configuration for the next generation GB300 NVL72 AI Server cabinet. UDN also mentioned that the BBU (Backup Battery Unit) "may be optional."

Undoubtedly, with such a luxurious configuration, the anticipated cost of components will be quite considerable.

Analysts expect the mass production price of the BBU module to be around 300 dollars, while the total price of the BBU for the GB300 AI Server may reach 1500 dollars. The expected production cost of supercapacitors is between 20 and 25 dollars, and the GB300 NVL72 AI Server cabinet will require over 300 supercapacitors.

Editor/Rocky