Generating embeddings for millions of documents is a batch job: split the corpus into fixed shards, run GPU workers in parallel, and write each shard's vectors to its own file so a restarted worker skips finished work. Nodus runs that pattern as one Indexed Job, restores each worker's saved shards when a machine is reclaimed, and lists the NVIDIA L40S at $0.793/hr on its pricing page. At that rate and NVIDIA's published throughput for a 300M-parameter open model, 10 million 512-token documents take about $6 of GPU time, against $102.40 through OpenAI's standard embeddings API.
This post gives you the script, what happened when we killed it halfway, the launch command and the cost math with every assumption shown. If you have not picked a model yet, start with how to evaluate an embedding model for search .…