NVIDIA AI GPUs are undoubtedly the hard currency of the moment, with everyone from tech giants to small businesses grabbing them.
Meta(Facebook) CEO Zuckerberg just recently revealed that Meta is building a massive computing platform in order to train Llama 3, the next generation of big language models, including up to 350,000 NVIDIA H100 GPUs that will be purchased by the end of this year.
At that point, with the addition of other GPUs, Meta will have a total computing power equivalent to almost 600,000 H100s!
According to market researcher Omdia, Meta 2023 bought as many as 150,000 NVIDIA GPUs, rivaled only by Microsoft, while Amazon, Oracle, Google, Tencent, and others all got only about 50,000 units.
Dylan Patel, principal analyst at SemiAccurate, noted that shipments of GPUs based on the latest Hopper architecture, such as H100, H200, GH100, GH200, and H20, are expected to reach 773,000 in the first quarter of 2024, increasing to 811,000 in the second quarter.
And in the second quarter of 2023, only about 300,000 Hopper family GPUs were shipped.
It's also worth noting that Meta is also buying AMD's latest Instinct MI300 series GPUs in unknown quantities.
Microsoft is also a big AMD Instinct customer.