Two choices you already make as a developer, the region and the model size, move the estimate more than anything else.
I am CTO of SOMA AI, which publishes the dataset used here.
When we built our emission factors for AI inference, I expected the model to be the whole story. It is not. The place where the model runs matters almost as much, and it is a setting most teams pick once, by latency or habit, and never revisit.
Here is what the numbers say. All of them are estimates from the SOMA AI Emission Factors (CC BY 4.0, DOI 10.5281/zenodo.20443585), for one mid-size AI exchange of 1,210 tokens. They are location-based grid averages, not renewable contracts.
One exchange, 12 times apart
Across the 143 AWS, Azure and Google Cloud regions in the dataset, the lowest estimate is on the Quebec grid, where the dataset maps AWS ca-central-1. It comes to 0.008 g CO₂e. The highest is Bahrain, at 0.095 g. That is about 12 times more for identical work.
Closer to home, the spread inside the EU is about 7.4 times.…