Menu

1 / 13

AI Gateway now supports Private Inference - Vercel

Vercel News·Sam Chitgopekar·about 18 hours ago
#a4oCaQJ6
#vercel#model#models#inference#gateway
Reading 0:00
15s threshold

Private Inference connects your own model endpoints to AI Gateway .

Enterprises running fine-tuned, self-hosted, or prerelease models used to need separate keys, client code, and logs for them. Those models can now run through the same authentication, SDKs and APIs , and observability as catalog models , so every model your team uses is managed in one place.

Use Private Inference to:

Switch between private and catalog models: Call private models through Chat Completions, Responses, or Messages. AI Gateway translates each request to your endpoint's format, so switching only changes the model ID.

Keep models scoped to your team: Only your Vercel team can view or call private models, and they aren't listed in the public catalog.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.