Menu

1 / 5

I scanned 35 real SKILL.md files — 16 tripped a rule, 10 of them Anthropic's official skills

DEV Community: infosec·Ulk0r0·9 days ago
#domZFFxI
#devtoinfosec#devto#dev#skill#skills
Reading 0:00
15s threshold

Your AI agent reads files written by strangers, and then does what they say. Every SKILL.md it loads is a set of natural-language instructions your agent will follow — and almost nobody runs them past a checker first.

So we did. Here's the whole methodology, reproducible in under a minute.

The experiment

We took 35 real, public SKILL.md files :

the 20 skills in Anthropic's official skills repository

15 from superpowers , one of the most popular community skill collections on GitHub

Then we ran them through SkillSentry's static rule layer only:

npm install -g @ulkoro/skillsentry skillsentry . --json --no-ai

Enter fullscreen mode

Exit fullscreen mode

No model review, no judgement calls — just the fourteen pattern checks documented in the Rulebook . Total scan time for all 35 files: 161 milliseconds .

One disclaimer: we build SkillSentry, so treat this as a chef tasting their own soup in public.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.