Garak alternatives

OSS (Apache 2.0) LLM vulnerability scanner — 'nmap for LLMs.' Originally Leon Derczynski (Univ Sheffield / ITU Copenhagen); NVIDIA now stewards the project. Tests for jailbreaks, prompt injection, hallucination, data leakage. Apache-2.0. Full Garak record →

  1. 1 Sakana AI Scientist Use-case-specific agent harnesses

    also in Use-case-specific agent harnesses · same memory unit (turn) · also self-hostable · also offered managed

    OSS — Self-host ✓ Managed ✓ MCP ? ★ 15k The AI Scientist Source Code License v1.0… Compare with Garak →

  2. 2 Specter Ops BloodHound Enterprise Use-case-specific agent harnesses

    also in Use-case-specific agent harnesses · same memory unit (turn) · also open source · also self-hostable

    OSS ✓ Self-host ✓ Managed ? MCP ? ★ 3.5k released 2026-10-26 BloodHound OSS Apache-2.0 (Enterprise is… Compare with Garak →

  3. 3 Promptfoo Use-case-specific agent harnesses ⚠ acquired — acquired by OpenAI

    also in Use-case-specific agent harnesses · same memory unit (turn) · also open source · also self-hostable · also offered managed

    OSS ✓ Self-host ✓ Managed ✓ MCP ✓ ★ 27k released 2026-10-25 MIT Compare with Garak →

  4. 4 RunWhen Use-case-specific agent harnesses

    also in Use-case-specific agent harnesses · same memory unit (turn) · also open source · also self-hostable

    OSS ✓ Self-host ✓ Managed ? MCP ✓ ★ 26 Apache-2.0 Compare with Garak →

  5. 5 Lasso Security Use-case-specific agent harnesses

    also in Use-case-specific agent harnesses · same memory unit (turn) · also self-hostable · also offered managed

    OSS ? Self-host ✓ Managed ✓ MCP ? Compare with Garak →

  6. 6 Pillar Security Use-case-specific agent harnesses

    also in Use-case-specific agent harnesses · same memory unit (turn) · also self-hostable · also offered managed

    OSS ? Self-host ✓ Managed ✓ MCP ? Compare with Garak →

  7. 7 Stanford STORM Use-case-specific agent harnesses ⚠ stale — no commits since 2025-09

    also in Use-case-specific agent harnesses · same memory unit (turn) · also open source · also self-hostable

    OSS ✓ Self-host ✓ Managed ? MCP ? ★ 32k released 2025-09-29 MIT Compare with Garak →

  8. 8 11x.ai Use-case-specific agent harnesses

    also in Use-case-specific agent harnesses · same memory unit (turn) · also offered managed

    OSS ? Self-host — Managed ✓ MCP ? Compare with Garak →

Ranked by shared memory design (storage, retrieval, conflict handling, memory unit), same section and shared must-haves (open source, self-hosting, MCP), with adoption as a tie-breaker. ✓ confirmed · — no · ? not in the catalog yet. Want picks for your own requirements? Use the chooser. Checking a whole project? Check your stack.