✓ Human-authored analysis; AI used for formatting and proofreading.
Grant Oviatt spent 15 years running security operations at Mandiant and Red Canary before building AI SOC agents at Prophet Security. He describes himself as a former AI skeptic: "anything AI detection in it scared me to death". He changed his mind when he saw what happened when you break security investigations into composable pieces that agents can tackle individually.
His team ran a bake-off: 12,000 alerts over two weeks, same alerts sent to both a human SOC team and the AI system, decisions compared blind at the end. The result was 99.3% agreement between the human team and the AI, with the AI completing investigations 11x faster. Four minutes average versus the human team not even starting to look at an alert in four minutes.
99.3% agreement across 12,000 investigations is a remarkable result. For runtime security investigation, is this login suspicious? Is this lateral movement malicious? Should this alert be escalated?…