The H100 boards are far from being gamers’ boards. They are designed for use in servers and other environments requiring high computing power, and are available in several formats, including PCIe and SXM5 versions.
What’s more, there’s even an NVL version for LLM (Large Language Model) applications, in the form of two boards operating as a duo.
Towards 64GB and 94GB H100s?
Now, via the PCI ID repository, we learn that NVIDIA is working on new versions of the H100… In fact, we’re talking about versions with varying amounts of memory. The site’s entries mention memory configurations in 64 GB and 94 GB!
As ever, the 94 GB configuration always raises a few eyebrows, since 94 GB of memory (HBM) implies the use of six 16 GB stacks. However, this means that 2 GB of capacity is deactivated. Once again, the question is why? Obviously, performance is still the reason given. As for the 64 GB configuration, this is easy to achieve, since NVIDIA simply needs to exploit four stacks of 16 RAM.
Furthermore, there were rumours of an H100 equipped with 120 GB VRAM. However, this was based on a photo of the card taken from a device manager. However, no serious evidence was found to support this..
