My CI Bot Remembers Every Failure, Thanks to Hindsight
The third time a build failed on the same flaky integration test, I realized the one component in my pipeline that hadn't learned anything was the tool I built to analyze failures.
That tool, PipelineDoctor, would read a failed log, call an LLM, and return a confident summary. Every time. From scratch. It had no idea it had explained this exact timeout twice before, or that the fix last time was pinning a dependency. So I gave it memory using Hindsight, an open-source agent memory system , and the way it behaves changed more than I expected.
What the system does
PipelineDoctor is a Python service built on FastAPI. When a CI run fails, a webhook sends the run to the service. The service pulls the logs through the GitHub API, extracts the failing step and error output, and produces a diagnosis with a suggested fix. Results land in a small dashboard and in SQLite for the run history.…