Community Article
Community articles are authored by SitePoint Premium contributors. Content is screened before publication, and SitePoint reserves the right to moderate or remove articles that violate our guidelines. Views expressed are those of the authors and do not necessarily reflect those of SitePoint.
TA
Talha Anwar
Published in
November 13, 2026
· Updated: November 15, 2026
The AI briefing for Developers
Stay up to date with AI tools, model releases, and developer workflows that matter.
Weekly. Free. One click to leave.
A self-hosted LLM gateway sits between your app and the model provider, so every call pays for one extra hop. We measured that cost for three open-source gateways: the Langfuse AI Gateway, the LiteLLM proxy and AcruxCore. Each one ran on the same machine, in front of the same OpenAI model. LiteLLM added 61 to 67 ms to every non-streaming call. AcruxCore added 15 to 24 ms.…