v0.9.0.16
What's Changed
New plugins
- probe: topic pushing by @leondz in #764
- probe: ruby package hallucination by @arjun-krishna1 in #851
- probe: Latent prompt injection by @leondz in #877
- probe: npm package hallucination by @arjun-krishna1 in #861
- probe: rust crate hallucination by @arjun-krishna1 in #873
- generator: Groq API by @mmilenkovic-groq in #896
New features
- extract
generations
param to be set on probes instead of generators by @jmartin-tech in #837 - secure garak HF assets by @leondz in #854
- Rename
knownbadsignatures
toav_spam_scanning
by @leondz in #850 - enable tokenizer customization in HFDetector by @jmartin-tech in #855
- refactor calibration / z-score code, so z-scores can be shown in CLI at run time by @leondz in #847
Tuning & fixes
- add automation action for plugin_cache.json by @jmartin-tech in #819
- add automation action for plugin_cache.json by @jmartin-tech in #819
- Docs/readmefaqdc32 by @leondz in #828
- fix initialization bug for kwargs in function by @soumilinandi in #827
- suppress LiteLLM logging during import by @jmartin-tech in #834
- relax
--probe_tags
as supported when other probe options are passed by @jmartin-tech in #836 - rename harness test module by @leondz in #848
- Surface underlying exception msg at plugin load by @leondz in #846
- relax litellm provider constraint by @arjun-krishna1 in #820
- plugin metadata tests by @leondz in #849
- Add explanation of how we treat the word "vulnerability" by @leondz in #852
- add faq items by @leondz in #857
- test buff transform() methods, to get them to load and run by @leondz in #856
- expand doc string that fails test requirements for verbosity by @jmartin-tech in #859
- refresh tutorial on contributing a generator by @leondz in #858
- avoid lambda in
_config
module level code by @jmartin-tech in #860 - add logging dir, new generator questions to FAQ by @leondz in #866
- revise default generations value to 5 by @leondz in #868
- validate detector doc_uri by @leondz in #865
- fix output error when parallel_requests > 1 and supports_multiple_generations is False by @arjun-krishna1 in #864
- improved messaging & error handling around NIM names by @leondz in #867
- look at the right var for NIM name checking by @leondz in #871
- filter detector template in tests by @jmartin-tech in #874
- have CLI UI render 100% w/o using scientific notation by @leondz in #882
- Generator docs are now tested for as intended by @leondz in #897
- reporting tweaks by @leondz in #901
New Contributors
- @soumilinandi made their first contribution in #827
- @arjun-krishna1 made their first contribution in #820
- @mmilenkovic-groq made their first contribution in #896
- @greshake made their first contribution in #877
Full Changelog: v0.9.0.15...v0.9.0.16