Menu

My bot detector was blocking most real users, and my tests never noticed
📰

My bot detector was blocking most real users, and my tests never noticed

DEV Community: rust·Mustafa Güngör·6 days ago
#JpsXnjNR
#devtorust#devto#dev#real#false
Reading 0:00
15s threshold

I maintain Synapse Shield , an open-source bot detection engine (Python with a native Rust core and JS client SDKs) that evaluates mouse and keyboard dynamics: jerk variance, Fitts' law terminal deceleration, path curvature, and keystroke flight times.

On paper, my test suite looked bulletproof: over 500 unit tests, mutation testing, and adversarial red-team suites. Every test case representing a "human" was passing cleanly.

Then I finally did what I should have done from day one: I ran actual recorded mouse movements from real people through the engine.

The experiment

Getting labeled interaction data is tedious, so I used recorded desktop sessions from a public academic dataset (120 participants).…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.