NVIDIAThe official new generation GH200 Grace Hopper super chip platform is the world's first to use HBM3e high-bandwidth memory, and for the first time integrates the CPU and GPU on a single motherboard, which can meet the world's most complex generative AI workload requirements.
Now, the first GH200 Grace HopperPC, appeared in a German store, and its dimensions are around 19 inches.
In terms of positioning, it is obviously not suitable for games and traditional workstations. A more accurate positioning should be to focus on running large language models locally.AI Workstation.
This console is equipped with 480GB of LPDDR5X memory, plus the 96GB of HBM3 memory in the GH200 (or even 144GB of HBMe), for a total of 576GB-624GB.
In terms of price, the 96GB HBM3 memory version is priced at 47,500 euros (about 370,000 yuan) and is now available for purchase. The 144GB HBMe version is expected to be launched in the second quarter of 2024 and will be priced at 59,500 euros (about 460,000 yuan).
The specific configuration of this AI workstation is that it is equipped with an NVIDIA GH200 Grace Hopper processor with 72 ARM cores (there is also a 144-core version) and a dedicated NVIDIA H100 accelerator. It is therefore equipped with dual 2000W power supplies and ultra-large-capacity storage, and supports a variety of connection expansion options (including NVIDIA Bluefield/Connect-X).
This PC has a cooling system that uses Noctua fans, add-ons, optional Nvidia Bluefield-3 and ConnectX-7 network cards, an 8TB SSD, a 30TB HDD, a mouse and keyboard, and even an RTX 4060.
In terms of performance, the German company claims that this AI workstation can provide 67 teraFLOPS FP64, 989 teraFLOPS TF32, 1979 teraFLOPS FP16, 3958 teraFLOPS FP8, and 3958 TOPS INT8 computing performance.
In 23 tests of software such as Emerald Rapids and Bergamo, the conclusion is that the performance of the GH200 Grace CPU is comparable to that of the Intel Xeon Platinum 8592 Emerald Rapids processor.