π
November 20, 2026 β’ Hugging Face
NVIDIA has released Nemotron-Labs-Sigma , an open-weight family of continuous diffusion language models. The release ships 14 checkpoints in two sizes, 3B and 8B: base, instruct and few-step distilled variants (NFE 2, 4, 8 and 16), plus a self-speculative variant per size. All weights are published on Hugging Face under the NVIDIA Nemotron Open Model License, which permits commercial use, so teams can download, fine-tune and serve the models in their own environments.
Continuous diffusion differs from both familiar approaches. An autoregressive model writes text token by token, always moving from left to right. Discrete diffusion models such as LLaDA or Dream diffuse over discrete token IDs. Sigma instead denoises token representations in a learned 16-dimensional embedding space and generates text blockwise, 64 tokens per block: each block passes through several denoising steps before it is emitted, and the model then moves on to the next block.β¦