Promptfoo alternatives

OSS (MIT) prompt-engineering eval and red-team CLI; supports OWASP LLM Top-10 vulnerability tests, jailbreak generation, and CI/CD pipeline integration. $5M seed Mar-2024 (Andreessen Horowitz). Founders ex-Discord + ex-Smile Identity. Full Promptfoo record →

  1. 1 Garak Use-case-specific agent harnesses

    also in Use-case-specific agent harnesses · same memory unit (turn) · also open source · also self-hostable · also offered managed

    OSS ✓ Self-host ✓ Managed ✓ MCP ? ★ 9.7k released 2026-10-16 Apache-2.0 Compare with Promptfoo →

  2. 2 RunWhen Use-case-specific agent harnesses

    also in Use-case-specific agent harnesses · same memory unit (turn) · also open source · also self-hostable · also has MCP

    OSS ✓ Self-host ✓ Managed ? MCP ✓ ★ 26 Apache-2.0 Compare with Promptfoo →

  3. 3 Sakana AI Scientist Use-case-specific agent harnesses

    also in Use-case-specific agent harnesses · same memory unit (turn) · also self-hostable · also offered managed

    OSS — Self-host ✓ Managed ✓ MCP ? ★ 15k The AI Scientist Source Code License v1.0… Compare with Promptfoo →

  4. 4 Specter Ops BloodHound Enterprise Use-case-specific agent harnesses

    also in Use-case-specific agent harnesses · same memory unit (turn) · also open source · also self-hostable

    OSS ✓ Self-host ✓ Managed ? MCP ? ★ 3.5k released 2026-10-26 BloodHound OSS Apache-2.0 (Enterprise is… Compare with Promptfoo →

  5. 5 Datadog Bits AI Use-case-specific agent harnesses

    also in Use-case-specific agent harnesses · same memory unit (turn) · also offered managed · also has MCP

    OSS ? Self-host — Managed ✓ MCP ✓ Compare with Promptfoo →

  6. 6 Vanta Use-case-specific agent harnesses

    also in Use-case-specific agent harnesses · same memory unit (turn) · also offered managed · also has MCP

    OSS ? Self-host — Managed ✓ MCP ✓ Compare with Promptfoo →

  7. 7 OpenBB Use-case-specific agent harnesses ⚠ acquired — acquired by OpenBQ

    also in Use-case-specific agent harnesses · same memory unit (turn) · also open source · also self-hostable · also has MCP

    OSS ✓ Self-host ✓ Managed ? MCP ✓ ★ 75k released 2026-09-29 Apache-2.0 Compare with Promptfoo →

  8. 8 Browser Use Computer-use & desktop agents

    same memory unit (turn) · also open source · also self-hostable · also offered managed · also has MCP

    OSS ✓ Self-host ✓ Managed ✓ MCP ✓ ★ 119k MIT Compare with Promptfoo →

Ranked by shared memory design (storage, retrieval, conflict handling, memory unit), same section and shared must-haves (open source, self-hosting, MCP), with adoption as a tie-breaker. ✓ confirmed · — no · ? not in the catalog yet. Want picks for your own requirements? Use the chooser. Checking a whole project? Check your stack.