AI Gateway now supports service tiering. Service tiers let you optimize for latency, throughput, and cost per request to match your use case. Pick a faster tier for interactive workloads (less queueing, higher token throughput), or a lower cost tier for background jobs that can tolerate more latency.

At launch, service tiering is available for OpenAI and Gemini models.

Service tiers work across every AI Gateway API format: AI SDK , Chat Completions API , Anthropic Messages API , OpenAI Responses API , and OpenResponses API . AI Gateway adjusts billing based on the tier each request used.

Copy link to heading Tiers

default : Standard processing

priority : Faster processing at increased cost

flex : Lower cost with potentially higher latency

If a service tier is not specified, requests run on the default tier.

Copy link to heading Basic usage

Set serviceTier under providerOptions.gateway .…