#InterMediaTeTechNical

DeepSeek just launched its fourth generation of flagship models with DeepSeek-V4-Pro and DeepSeek-V4-Flash, both targeted at enabling highly efficient million…

AI tools are significantly accelerating software development and changing how developers work with code. These tools serve as real-time copilots…

The development of socially acceptable nuclear reactors requires that they are safe, clean, efficient, economical, and sustainable.

AI is evolving, and reasoning models are increasing token demand, placing new requirements on every layer of AI infrastructure. More than ever…

In the rapidly evolving landscape of large language model (LLM) development, NVIDIA Megatron Core has emerged as the foundational framework for training massive…

NVIDIA ACE is a suite of technologies for building AI agents for gaming. ACE provides ready-to-integrate cloud and on-device AI models for every part of in-game…

Sparse tensors are vectors, matrices, and higher-dimensional generalizations with many zeros. They are crucial in various fields such as scientific computing…

AI coding agents enable developers to work faster by streamlining tasks and driving automated, test-driven development. However, they also introduce a…

This post introduces Dynamic Context Parallelism (Dynamic-CP), a scheduling approach in NVIDIA Megatron Core used for LLM post-training or DiT pre-training.

Advances in AI architectures have unlocked multimodal functionality, enabling transformer models to process multiple forms of data in the same context.