v0.10.0

What's Changed

New plugins

• detector: llm as a judge by @jmartin-tech in #956
• generator: update openai for o1 models by @leondz in #922
• generator: Ollama by @martinebl in #876
• generator: support of azure openai by @eric-therond in #817
• generator: vision nims by @leondz in #959
• probe: add whois injection to latentinjection by @leondz in #947

New features

• payload/probe separation by @leondz in #870
• data file override support with precedence by @jmartin-tech in #916
• cli: --parallel_attempts hint by @leondz in #932
• reporting: tidy config details, add payload audit info by @leondz in #936
• payloads: web-related, incl. probes.encoding migration by @leondz in #933

Documentation

• Document configuration of garak using YAML by @leondz in #911
• RST formatting updates to restgenerator page by @leondz in #912
• doc: give generatiors.rest list the space it wants and deserves by @leondz in #914
• latent injection doc fix by @leondz in #921
• Contributing Probes documentation by @erickgalinkin in #919
• docs: add example of using Configurable to specify a generator name for load_plugin by @leondz in #929
• docs: NVIDIA generators by @leondz in #917
• update bag reference by @emmanuel-ferdman in #953
• docs: update faq by @leondz in #957
• docs: describe top-level objectives in reference guide by @leondz in #958
• docs: centralise faq by @leondz in #965
• docs: make project scope clear and note that contributors should check it by @leondz in #964
• doc: update to use rst toctree href syntax by @leondz in #967
• docs: clarify "contributing" document by @leondz in #968
• docs: require core config top- and second-level params to be documented by @leondz in #966

Tuning & fixes

• plugin classes should not access DEFAULT_PARAMS by @jmartin-tech in #906
• add test status lozenges for lin/win/osx by @leondz in #903
• utilized the cache to filter base classes by @jmartin-tech in #905
• paraphrase fast consistent model device by @jmartin-tech in #898
• Force cache build in automation by @jmartin-tech in #907
• tweak: defer import of slow Llava* classes by @leondz in #908
• add issue and PR templates by @jmartin-tech in #909
• tweak: new latentinjection probe, add configurability to mini version by @leondz in #910
• bug: set match type correctly in riskywords detectors by @leondz in #918
• bugfix: enable latent injection mini latent jailbreak probe by default by @leondz in #923
• tweak: update migitation strings by @leondz in #925
• bugfix: use distinct report entry type for payload init by @leondz in #930
• add code coverage options by @jmartin-tech in #934
• reporting: update link to bag by @leondz in #935
• probe: missing newline in latentinjection.LatentInjectionFactSnippetEiffel by @leondz in #938
• update: extend calibration with more probes by @leondz in #939
• limit project actions to primary repo by @jmartin-tech in #940
• Add error handling for empty node_results to base.py. by @erickgalinkin in #942
• update: rename replay plugins to divergence by @leondz in #945
• update hint to reference --parallel_attempts by @jmartin-tech in #951
• Configurable TAP probe, refactor judge resources to shared red team by @jmartin-tech in #949
• architecture: factor HFCompatible out by @leondz in #954
• generators: fix rasa issues #961 & #962 by @rgstephens in #963
• fix: add garak/data to pip package by @jmartin-tech in #969

New Contributors

• @martinebl made their first contribution in #876
• @emmanuel-ferdman made their first contribution in #953
• @eric-therond made their first contribution in #817

Full Changelog: v0.9.0.16...v0.10.0