Introduction
Look at how your app calls a model today. There is an SDK, an API key and a model name, all in the code. That works until one of three things happens:
The provider has a bad hour, and your feature is down with it.
A cheaper or better model ships, and moving to it is a code change in every service.
You pay for the strongest model on every request, including "say hi".
An LLM gateway fixes this. It is one endpoint that sits between your apps and the model providers. The apps call the gateway. The gateway picks the model, retries, and fails over to another provider.
hikyaku (ι£θ) is an open-source message relay written in Go. Its launch article builds a webhook relay with AI routing. This article uses the same binary for a different job. A chat request is a message. A model is a destination.β¦