Skip to content
@protectai

Protect AI

Securing ML

Protect AI OSS

Protect AI's OSS portfolio includes tools aimed at improving security of AI/ML software. These tools are meant for a wide range of engineering, security and ML practitioners including:

  • Developers
  • Security Engineers/Researchers
  • ML Engineers
  • LLM Engineers & Prompt Engineers
  • Data Scientists

Project Description
ModelScan 🔍 ML Model Security Scanner
AI Exploits 🗡️ Collection of AI/ML Exploits
LLM Guard 🛡️ Security Toolkit for LLM Interactions
rebuff 💉 LLM Prompt Injection Attack Detection
NB Defense 📓 Jupyter Notebooks Security
Vulnhuntr 🏹 Autonomous AI-Discovered 0Day Tool

Pinned Loading

  1. modelscan modelscan Public

    Protection against Model Serialization Attacks

    Python 341 75

  2. nbdefense nbdefense Public

    Secure Jupyter Notebooks and Experimentation Environment

    Python 60 10

  3. llm-guard llm-guard Public

    The Security Toolkit for LLM Interactions

    Python 1.3k 169

  4. rebuff rebuff Public

    LLM Prompt Injection Detector

    TypeScript 1.1k 82

  5. ai-exploits ai-exploits Public

    A collection of real world AI/ML exploits for responsibly disclosed vulnerabilities

    Python 1.5k 114

Repositories

Showing 10 of 14 repositories
  • nbdefense Public

    Secure Jupyter Notebooks and Experimentation Environment

    protectai/nbdefense’s past year of commit activity
    Python 60 Apache-2.0 10 1 3 Updated Dec 23, 2024
  • modelscan Public

    Protection against Model Serialization Attacks

    protectai/modelscan’s past year of commit activity
    Python 341 Apache-2.0 75 17 (1 issue needs help) 9 Updated Dec 23, 2024
  • chart-testing Public Forked from helm/chart-testing

    CLI tool for linting and testing Helm charts

    protectai/chart-testing’s past year of commit activity
    Go 0 Apache-2.0 222 0 0 Updated Dec 11, 2024
  • llm-guard Public

    The Security Toolkit for LLM Interactions

    protectai/llm-guard’s past year of commit activity
    Python 1,314 MIT 169 21 3 Updated Nov 25, 2024
  • vulnhuntr Public

    Zero shot vulnerability discovery using LLMs

    protectai/vulnhuntr’s past year of commit activity
    Python 1,251 AGPL-3.0 127 4 4 Updated Oct 31, 2024
  • .github Public
    protectai/.github’s past year of commit activity
    1 0 0 0 Updated Oct 24, 2024
  • ai-exploits Public

    A collection of real world AI/ML exploits for responsibly disclosed vulnerabilities

    protectai/ai-exploits’s past year of commit activity
    Python 1,466 114 1 2 Updated Oct 23, 2024
  • protectai/nbdefense-jupyter’s past year of commit activity
    TypeScript 11 Apache-2.0 6 2 6 Updated Oct 1, 2024
  • grepdiff Public Forked from rsc/grepdiff

    grep for diffs

    protectai/grepdiff’s past year of commit activity
    Go 1 BSD-3-Clause 4 0 1 Updated Aug 7, 2024
  • rebuff Public

    LLM Prompt Injection Detector

    protectai/rebuff’s past year of commit activity
    TypeScript 1,147 Apache-2.0 82 25 (9 issues need help) 6 Updated Aug 7, 2024