Agent skill scanners compared
Updated 2026-10-21
This page lists the scanners we know of, what each does, and what we have observed. We run Cisco's scanner for this site. We are not affiliated with any vendor. For measured detection rates, use the independent benchmark at skillscan.sh; this page is about scope and behaviour, not scores.
| Scanner | Type | Open source | Runs locally | LLM layer | Notes |
|---|---|---|---|---|---|
| Cisco AI Defense skill-scanner | Static + behavioral + bytecode + trigger + LLM + meta | Yes | Yes | Optional | What this site runs. Full pipeline, high signature false-positive rate, meta layer helps. |
| Snyk Agent Scan (formerly Invariant mcp-scan) | Environment inventory + LLM | Partly | CLI | Yes, cloud | Scans installed skills and MCP servers together. Highest recall on skillscan.sh's benchmark among tools tested. |
| SkillSpector (NVIDIA) | Static + optional LLM | Yes | Yes | Optional | Documents its own scope limits: non-English, images, runtime. |
| Gen Agent Trust Hub | Cloud | No | No | Yes | One of three auditors on skills.sh. |
| Socket | Supply chain | No | No | Partial | One of three auditors on skills.sh. Flags unpinned remote installs aggressively. |
| VirusTotal Code Insight | Cloud | No | No | Yes | Used by ClawHub for new publications after ClawHavoc. |
| Enkrypt Skill Scanner, JFrog, Superagent | Commercial | No | Varies | Yes | API or platform products; no public corpus. |
skillscan (PyPI) |
Static CLI | Yes | Yes | No | Unrelated to this site. |
What we have observed running Cisco's scanner on 618 skills
- Signature rules produce most CRITICAL findings and most false positives. The worst cases are security tools and test corpora that contain attack strings as data.
- The LLM layer produces fewer, better findings, with readable remediation text. Its meta-validation confirmed about 60 percent at high confidence and downgraded most of the rest for context.
- Running without the LLM layer, as community scans do, roughly halves the useful findings and leaves only signature hits.
- Scanner version matters. We pin it and record it per run, because rule updates change results on unchanged skills.
Known bypasses
Trail of Bits (June 2026) bypassed every scanner on this list that they tested, including the one we run, using whitespace padding, bytecode, archive indirection, and persuasive framing. The Cloud Security Alliance's follow-up notes document further evasions of ClawHub's VirusTotal integration between February and May 2026. No scanner here should be treated as a gate. See what scanners catch and miss.
Adding scanners to this corpus
Running a second scanner over the same 618 skills, with results side by side on each skill page, is on the roadmap. It would be the first public cross-scanner dataset on real registry content. If you maintain a scanner and want it included, open an issue.
Vendor comparisons we reviewed while preparing this page were mostly written by competing vendors. We have tried to limit this page to scope and observed behaviour and to leave scoring to the benchmark.