When a speech model runs slower than real time, the reflex is to rent a bigger GPU. With Ming-3.0-tts-0.5B that buys very little. An RTX 2000 Ada sat idle more than two thirds of the time. An RTX 4090 worked at most one moment in five, and the speedup was about 17%.
The model comes from the inclusionAI team at Ant Group. They released weights and code under MIT, with their own benchmarks and a frank list of limitations. It copies a voice from a few seconds of sample audio, builds one from a text prompt describing it, and turns inline tags like [Laughter] or [Sigh] into sounds. Their model page only mentions H800-80GB and H20-96G cards, with no memory figure. We ran their unmodified code on a small card to get one. Every number is in our Ming-3.0-tts memory and speed test on an RTX 2000 Ada .
Low GPU utilisation is the first thing to check
"Real time" is a ratio: seconds of audio produced per second of compute. A 20.7-second English paragraph cost 31 to 32 seconds on the RTX 2000 Ada.…