LiteLLM Rust’s 7x overhead and 9x memory claims, checked against its public benchmark files: what holds up, where Bifrost leads, and what’s unproven.

LiteLLM's Rust gateway has been promoted with headline claims of roughly 7× lower overhead , 9× less memory , and about 4.5× more requests per dollar than Bifrost. Those numbers sound decisive, but benchmark headlines are only as useful as the setup, measurements, and comparisons behind them.

The response to the benchmark checks the claims against LiteLLM's post and the CSV/JSON files in its public benchmark repository .…