Nvidia is building Nemotron 4, a new family of open-weight AI models meant to challenge the strongest freely available models, according to reporting by The Information cited by The Decoder. The largest model in the family is planned to reach at least one trillion parameters, twice the size of Nvidia's current Nemotron 3 Ultra.
To train it, Nvidia has tripled its cloud spending on in-house model development to 28 billion dollars through 2031. The earliest the models could ship is this fall.
China is already there
A trillion parameters would be a milestone for a US open model, but not for the field. China's labs already operate at that scale and beyond. Moonshot AI's Kimi K3 uses 2.8 trillion parameters, and DeepSeek V4 Pro uses 1.6 trillion. On the Artificial Analysis Intelligence Index, Nvidia's Nemotron 3 Ultra scores 38 points and trails Moonshot's Kimi K3 at roughly 60.
A tension with its own customers
The move also puts Nvidia in tension with its own customers. The chipmaker recently announced a 10 gigawatt infrastructure partnership with OpenAI, yet Nemotron 4 would compete directly with OpenAI's own models in the open-weight arena. Nvidia is also among the signatories of a petition opposing new regulation of open models, a position that aligns with selling more GPUs as companies choose to self-host.
Sources
The Decoder: https://the-decoder.com/nvidias-nemotron-4-aims-for-one-trillion-parameters-a-scale-chinese-labs-already-surpassed/
The Information (via The Decoder): https://www.theinformation.com/articles/nvidia-open-source-ai
