← Back to all projects

garak

A vulnerability scanner for anything built on a language model: probes attack, detectors judge, a report follows

OfficialApache-2.0
Stars
9.8k
Forks
1.4k
Open issues
525
Last commit
27 Oct 2026

What is garak?

Point it at a chatbot or a model and it works through families of attacks — prompt injection, jailbreaks, encoding-based bypasses, data leaks and replay, toxicity, false reasoning — and reports which ones got through. Keeping the attacks, the judgement and the connection to the target as separate components is what lets a new probe or a new backend be added without rewriting the rest. It is the finding half of security, not the fixing half: the output tells you which probes succeeded, not what policy to write in response.

What can you do with garak?

  • Point it at what you already have — Scanning an existing chatbot or model produces a report of the weaknesses found, so the work of designing attacks and deciding what counts as a failure is not yours to do first.
  • Attack and judgement are separate pieces — Probes generate attempts, detectors decide whether an attempt succeeded and generators handle talking to the target, which means a new attack or a new model backend slots into the existing machinery.
  • Cover the categories that actually get exploited — Shipped probe families include prompt injection, jailbreaks, encoding-based bypasses, data leaks and replay, toxicity generation and false reasoning — the failure modes that show up in real incidents.
  • Read the result properly — The documentation covers interpreting results and evaluating a scan, which matters because a raw pass rate against adversarial probes is one of the easier numbers in this field to misread.

Before you choose garak

  • It finds problems rather than fixing them: the report says which probes got through, and turning that into a defence means adding a guardrail layer as a separate piece of work.
  • A scan deliberately sends adversarial traffic to whatever model backs the target, so both the provider's terms and the cost of the run are worth checking before pointing it at production.

Star history

21 Aug to 30 Oct · +906

8.9k9.8k

Frequently asked questions

Is garak free for commercial use?

garak is released under the Apache-2.0 licence — OSI-approved open source, which permits commercial use.

How can garak be deployed?

garak is available as Runs locally / Self-hosted.