Chinese modifying RTX 4090D and 4080 Super for AI

0

It has been reported that some Chinese companies running servers dedicated to intensive computing and AI are modifying RTX 4090D and 4080 Super graphics cards to boost their performance. These “tinkerings” to RTX 4090D and RTX 4080 SUPER graphics cards enable memory to be doubled, increasing these versions to 48 GB and 32 GB GDDR6X memory respectively. The high-end RTXs can run elaborate AI models, but memory quickly becomes their bottleneck. These “boosted” cards are intended for training large linguistic models and other generative AI models requiring considerable computing power and memory capacity.

Modifications to the RTX 4090D and 4080 Super: no longer really DIY.

One question is becoming important, however: given the upsurge in such “modding”, we’re beginning to wonder about the way these cards come out of the workshops. After all, it’s nothing new to see amateurs modifying boards. But to equip data centers “en masse”, these modifications need to be carried out at a quasi-industrial stage. The RTX 4090D normally supports just 12 memory modules. Under these conditions, it is difficult to extend its capacity. But it is possible to use the PCB of an RTX 3090 Ti, which supports 24 modules, combined with the AD102 GPU of the RTX 4090D. This doubles memory capacity. In other words, having access to GPUs and using a custom RTX 3090 Ti PCB with an AD102 GPU to achieve this enhancement is not for the faint-hearted. Surprisingly, there are no photos or leaks to identify the origin of the PCBs…

It is with these modifications that China can bypass barriers and expand its AI computing capabilities in the country. Under these conditions, Nvidia’s sanctions-bypassing RTX 4090D graphics card becomes even more attractive in China. Indeed, in order to have access to 48 GB of memory, you logically have to equip yourself with expensive professional cards, which are above all subject to the embargo. Modifications therefore become relevant on condition that you have access to PCBs and technical capabilities… and just as well, China is home to the majority of graphics card manufacturers’ factories.