← Back to all projects

Giskard

Attacks your own agent with hostile inputs and reports the ones it answered when it should have refused

Apache-2.0
Stars
5.9k
Forks
555
Open issues
73
Last commit
30 Oct 2026

What is Giskard?

Evaluation tells you how well an agent does on the questions you thought of. That is the wrong shape for safety, where what matters is the question you did not think of. Giskard inverts it: the scan generates hostile inputs itself and reports the ones your agent answered when it should have refused, so the test set is produced by the tool rather than by your imagination. Alongside it sits a scan for the ways a retrieval system quietly goes wrong, and a way of writing behavioural expectations as ordinary tests that pass or fail under pytest, so a check that mattered once becomes a check that runs on every change. The maintainers are explicit that a clean scan is not a safety or compliance guarantee.

What can you do with Giskard?

  • Let the tool write the hostile inputs — The scan generates the attacks rather than asking you to think of them, which is the only way to cover the case you would not have imagined.
  • Find where retrieval quietly fails — A separate scan looks for the ways a document-grounded system goes wrong without looking wrong, which ordinary accuracy numbers do not surface.
  • Keep a finding as a test — Expectations are written as scenarios and checks that run under pytest, so something you fixed once is checked again on every change.
  • Run it where your tests already run — Because it is a Python library rather than a platform, a scan fits into an existing pipeline without a service to stand up first.

Before you choose Giskard

  • The maintainers state plainly that scan results are not a safety or compliance guarantee — it finds some of what is wrong, and a clean report is not evidence that nothing is.
  • The open library covers the scans and the tests; continuous red teaming, dataset management and scheduled evaluation are part of the company's separate hosted product.

Star history

29 Aug to 30 Oct · +145

5.8k5.9k

Frequently asked questions

Is Giskard free for commercial use?

Giskard is released under the Apache-2.0 licence — OSI-approved open source, which permits commercial use.

How can Giskard be deployed?

Giskard is available as Runs locally / Self-hosted.