Open Source
-
Protect AI's ModelScan and NB Defense: An Open-Source Review
A review of Protect AI's two best-known open-source tools — ModelScan for model serialization attacks and NB Defense for Jupyter notebooks.
-
Giskard Review: Open-Source Testing for LLM and RAG Apps
A review of Giskard, the open-source Python library for testing AI systems, covering its automated LLM vulnerability Scan and the RAGET RAG toolkit.
-
PyRIT Review: Microsoft's AI Red Teaming Framework
A review of PyRIT 1.1, Microsoft's open-source AI red teaming framework: its target, attack, converter, scorer and memory design, and multi-turn attacks.
-
Garak LLM Scanner Review: Research Tool or CI Gate?
A review of garak, NVIDIA's open-source LLM vulnerability scanner: plugin architecture, backend coverage, report quality, and the CI-gating pattern.
-
Rebuff: Open-Source Prompt Injection Defense, Layer by Layer
Rebuff is a self-hosted prompt injection detector with four layers: heuristics, LLM-based detection, a vector database of past attacks, and canary tokens.