Prompt injection defence in BleedStop is a stack of checks in front of the model, not one classifier score. The default check is a phrase list. A DeBERTa classifier is a second stage I turn on, and on my held out set it caught 77.5% of injections at a 5% false positive rate.
Everything in this post is from the BleedStop case study or from the public repo, usmamalik345/bleedstop , especially the README and classifier/server.py . The spend guard around these checks is in the BleedStop deep dive .
What runs if I change nothing
The phrase list is the default detector. The README says the ONNX sidecar runs only when BLEEDSTOP_DETECTOR is classifier or both . Until that flag is set, the live demo's server check is the phrase list. The model that runs in the browser on the demo page is a demo only. It does not protect the API.
On the phrase list, the honest held out number is weak. The README's agent guard row calls the held out set 22.5%, with 0% false positives, and calls that the honest number.…