NVIDIA GH100 Hopper: the biggest GPU ever made?

0

Currently, the largest GPU in production is the NVIDIA Ampere GA100 which measures 826 mm2. But the latest rumors about Hopper suggest that NVIDIA’s future H100 gas pedal should break this ‘record’.

Nvidia Hopper GH100 A priori, the next Hopper GPUs should benefit from the 5nm manufacturing process of TSMC. This GPU, which is obviously not intended for the general public, should compete with the Ponte Vecchio of Intel. Even if many uncertainties remain on the design of Hopper, Nvidia could however give birth to a huge GPU measuring about 1000 mm2. This new GPU intended for intensive calculations could be presented at the GTC 2022 next March. Nvidia has communicated very little about Hopper’s future architecture, but the company has talked about a next-generation GPU design using a “Composable On-Package Architecture(COPA)” as the optimal solution for maximizing the throughput of low-precision matrix mathematics to increase Deep Learning performance.

Nvidia Hopper GH100 A significant increase in performance is therefore to be expected, which is justified by the increasing demand for computing power for AI in particular. Increasing the size means increasing the number of transistors. For the record, the current NVIDIA A100 has 54.2 billion transistors while it is engraved in 7 nm by TSMC. On the other hand, don’t get carried away, Hopper won’t have much to do with the next generation of GPUs that will power the RTX 4000.