LLM Foundry finally stops being a toy and starts acting like a system

I wanted to see whether a weak local model could be made genuinely more useful without pretending the base model was magic.

So I wrapped a small Hugging Face model in LLM Foundry, gave it memory, semantic retrieval, a reflection loop, and a benchmark harness — then made it explain why semantic retrieval matters, while the terminal printed the receipts.

That is the point of LLM Foundry : the workshop around an LLM, not the model itself. It is the layer that makes a model useful for actual work instead of just looking smart in a demo.

What changed

The current version now has a few things worth showing instead of just claiming:

semantic retrieval backed by embeddings, so memory search is not just keyword matching

multi-provider support for OpenAI-compatible endpoints, Anthropic, Hugging Face, and failover bundles

compression + memory so long tasks can be shrunk into a compact working context

agent traces that can be exported into…