supercomputing

Elon Musk's Memphis Supercluster has been launched. According to Musk, the cluster uses 100,000 liquid-cooled H100s on a single RDMA fabric and is "the most powerful AI training cluster in the world." Such a huge computing power naturally requires an amazing power supply. Each H100 GPU consumes at least 700 watts of electricity, which means that the entire data center needs more than 70 megawatts of electricity to run at the same time, not including the power consumption of other servers, networks and cooling equipment...