If you've built anything on more than one LLM provider, you know the drill. OpenAI's SDK here, Anthropic's there, a wrapper to make them look alike, and retry logic you wrote at 2am and don't fully trust. An LLM gateway is supposed to take that away: one endpoint, any model, and the plumbing handled for you.
Respan Gateway is a new open-source one, written in Rust and public since October. I installed it on my Windows PC, pointed it at Gemini, broke a provider on purpose, and checked whether it does what it says. Everything below is from that run: real commands, real timings, real screenshots.
What Respan Gateway is
Respan Gateway is a single binary that sits between your code and AI APIs. You point the SDK you already use (OpenAI, Anthropic or Gemini) at it, ask for any model, and it translates the request into whatever format that model's provider speaks.
What stood out before I ran it:
Everything is a plugin.…