Garak
https://github.com/NVIDIA/garak
OSS (Apache 2.0) LLM vulnerability scanner — 'nmap for LLMs.' Originally Leon Derczynski (Univ Sheffield / ITU Copenhagen); NVIDIA now stewards the project. Tests for jailbreaks, prompt injection, hallucination, data leakage. Apache-2.0.
Active · Verified 2026-10-28 · fresh as of 2026-10-28 · 25 cited facts, 1 with a third-party source · 1 recorded change · Suggest a correction
At a glance
- Tier
- T3
- Created
- 2023 (initial public release) repo fix
- Latest release
- v0.17.1 (2026-10-16) registry fix
- License
- Apache-2.0 repo fix
- GitHub
- NVIDIA/garak — ~9.7k stars, last commit 2026-10 repo fix
- Pricing
- not applicable — wrong section fix
- Funding
- not applicable — wrong section fix
- Freshness
- 2026-10-28 fix
- Layer
- agent-infra repo fix
- Licensing
- open-source repo fix
- Developer activity
- OpenRank 14.43 (12-mo avg 13.12) · 92 participants — 2026-09 third-party fix
When to use
Optimised for: researcher / advanced practitioner LLM vuln scanning
Anti-fit: not applicable — wrong section
Pros & cons
Pros
NVIDIA-backed; nmap-like CLI ergonomics; broad probe library; research-quality scoring.
Cons
CLI-first (no SaaS dashboard); requires manual scoring/triage; not a commercial product per se.
Claims & capabilities
Apache-2.0; ~80 attack probes shipped; NVIDIA-stewarded
Technical surface
- API surface
- Python CLI
- Backend storage
- not applicable — wrong section
- Deployment
- Self-hosted only — pip-installed Python CLI
- Embedding model
- not applicable — not a memory product
- Multi-tenancy
- not applicable — wrong section
- MCP
- not applicable — wrong section
- A2A
- not applicable — wrong section
- OpenTelemetry
- not applicable — wrong section
Alternatives to Garak → live options ranked by shared design, licence, hosting and MCP support
Similar systems
Other use-case-specific agent harnesses in the catalog, ranked by inbound references.
- Calypso AI (now F5 AI Guardrails) T2
Dublin / NYC founded 2018; GenAI security and content scanning. $23M Series A-1 Aug-2024 (Paladin Capital + Lockheed Martin Ventures). Pivoted from defence ML to enterprise GenAI guardrails 2023-24.
- Salesforce Agentforce T1
Cross-listing: Salesforce Agentforce already exists under Vertical / Customer-support / voice memory; this row is the Agent-harness framing — Agentforce as the consumer-facing agent IDE / builder on Data Cloud. Agentforce launched Sep-2024; Agentforce 2.0 announced Dec-2024.
- Lasso Security T2
Tel-Aviv-founded LLM security platform — adversarial testing, prompt-injection defence, data-leakage prevention. $6M seed Nov-2023 (Entrée Capital + Samsung Next).
- Pillar Security T2
Tel-Aviv-founded (Dor Sarig + Ziv Karliner, both ex-IDF cyber); end-to-end LLM security platform — discovery, red-teaming, runtime guardrails. $9M seed Apr-2024 (Shield Capital + Greenfield).
- Promptfoo T2
OSS (MIT) prompt-engineering eval and red-team CLI; supports OWASP LLM Top-10 vulnerability tests, jailbreak generation, and CI/CD pipeline integration. $5M seed Mar-2024 (Andreessen Horowitz). Founders ex-Discord + ex-Smile Identity.
- Protect AI T2
Founded 2022 by Ian Swanson + Daryan Dehghanpisheh (ex-AWS); AI/ML supply-chain + GenAI security. Acquired by Palo Alto Networks (2025-07-22; announced Apr-2025, reported $700M); its capabilities now ship in Prisma AIRS. Products: Recon (red-team), ModelScan (model artifact scanner), Sightline (vulnerability DB).
Sources (24 cited facts, 1 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is OSS LLM vulnerability scanner (NVIDIA-stewarded) repo
- What it does & what's distinct OSS (Apache 2.0) LLM vulnerability scanner — 'nmap for LLMs.' Originally Leon Derczynski… repo
- Claims / benefits Apache-2.0; ~80 attack probes shipped; NVIDIA-stewarded repo
- Created 2023 (initial public release) repo
- Latest release v0.17.1 (2026-10-16) registry
- License Apache-2.0 repo
- GitHub NVIDIA/garak — ~9.7k stars, last commit 2026-10 repo
- Deployment Self-hosted only — pip-installed Python CLI registry
- HQ London / NVIDIA repo
- Founders / pedigree Leon Derczynski (Univ Sheffield; now NVIDIA) repo
- Code/weights release Apache-2.0 — OSS repo
- API surface Python CLI repo
- Optimised for researcher / advanced practitioner LLM vuln scanning repo
- Pros NVIDIA-backed; nmap-like CLI ergonomics; broad probe library; research-quality scoring. repo
- Cons CLI-first (no SaaS dashboard); requires manual scoring/triage; not a commercial product … repo
- Project & sources github.com/NVIDIA/garak repo
- commit-trajectory [{"ym":"2025-10","cum":3117},{"ym":"2025-11","cum":3278},{"ym":"2025-12","cum":3358},{"y… repo
- architecture-deployment-locus local repo
- licensing-bucket open-source repo
- positioning-platform-vs-product platform repo
- taxonomy-three-layer-rollup agent-infra repo
- developer-activity-opendigger {"activity":187.58,"as_of":"2026-09","openrank_12mo":13.12,"openrank_current":14.43,"par… third-party
- sdk-languages python repo
- maturity alpha registry
What changed
Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)
Related systems
Referenced by (1)
- PyRIT integrates with — PyRIT Scanner docs have a Garak Scenarios page. (verified 2026-10-29)