the LLM vulnerability scanner
-
Updated
Sep 3, 2025 - Python
#
llm-security
Here are 72 public repositories matching this topic...
🐢 Open-Source Evaluation & Testing library for LLM Agents
ai-security mlops fairness-ai responsible-ai ml-validation red-team-tools trustworthy-ai ml-testing llm ai-red-team ai-testing llmops llm-security llm-eval llm-evaluation rag-evaluation agent-evaluation
-
Updated
Sep 2, 2025 - Python
The Security Toolkit for LLM Interactions
transformers security-tools adversarial-machine-learning large-language-models llm prompt-engineering chatgpt llmops prompt-injection llm-security
-
Updated
Sep 3, 2025 - Python
A.I.G (AI-Infra-Guard) is a comprehensive, intelligent, and easy-to-use AI Red Teaming platform developed by Tencent Zhuque Lab.
-
Updated
Sep 4, 2025 - Python
Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪
agent-framework ai-red-team prompt-testing llm-security llm-vulnerabilities llm-evaluation llm-fuzzing llm-evaluation-framework llm-guardrails llm-scanner llm-jailbreaks llm-fuzzer llm-fuzzer-aggregator agent-security
-
Updated
Aug 26, 2025 - Python
An easy-to-use Python framework to generate adversarial jailbreak prompts.
jailbreak discrete-optimization large-language-model llm-security llm-safety-benchmark jailbreak-framework
-
Updated
Mar 27, 2025 - Python
A security scanner for your LLM agentic workflows
cli security ai mcp security-tools devsecops red-teaming ai-security llm generative-ai llm-security agentic-framework agentic-workflow agentic-ai mcp-server ai-red-teaming
-
Updated
Aug 4, 2025 - Python
Papers and resources related to the security and privacy of LLMs 🤖
-
Updated
Jun 8, 2025 - Python
⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
security-tools adversarial-machine-learning adversarial-attacks yara-scanner large-language-models llmops prompt-injection llm-security
-
Updated
Jan 31, 2024 - Python
This repository provides a benchmark for prompt Injection attacks and defenses
-
Updated
Jul 16, 2025 - Python
Experimental tools to backdoor large language models by re-writing their system prompts at a raw parameter level. This allows you to potentially execute offline remote code execution without running any actual code on the victim's machine or thwart LLM-based fraud/moderation systems.
-
Updated
Apr 5, 2025 - Python
The fastest Trust Layer for AI Agents
security ai-agents ai-agent llm-security ai-runtime llm-privacy prompt-security llm-guard llm-guardrails agentic-ai cx-agent
-
Updated
May 28, 2025 - Python
Framework for testing vulnerabilities of large language models (LLM).
python nlp agent ai attack jailbreak owasp vulnerability red-team security-tools misinformation ai-security rag red-team-tools hallucinations llm llm-security rag-evaluation llm-testing llm-read-team
-
Updated
Aug 20, 2025 - Python
Whistleblower is a offensive security tool for testing against system prompt leakage and capability discovery of an AI application exposed through API. Built for AI engineers, security researchers and folks who want to know what's going on inside the LLM-based app they use daily
-
Updated
Jul 28, 2024 - Python
Ultra-fast, low latency LLM prompt injection/jailbreak detection ⛓️
jailbreak security-tools large-language-models prompt-engineering chatgpt-prompts llm-security llm-local llm-guard llm-guardrails
-
Updated
Jul 26, 2024 - Python
Framework for LLM evaluation, guardrails and security
-
Updated
Sep 9, 2024 - Python
An Execution Isolation Architecture for LLM-Based Agentic Systems
ai sandbox gpt isolation multi-agent-systems ai-agents openai-api llm chatgpt langchain genai llm-agent llm-security llm-framework llm-privacy llm-platform llm-based-systems genai-security
-
Updated
Jan 31, 2025 - Python
A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
-
Updated
Apr 15, 2024 - Python
The Open Source Firewall for LLMs. A self-hosted gateway to secure and control AI applications with powerful guardrails.
self-hosted ai-safety content-moderation pii-redaction prompt-injection llm-security ai-gateway llm-firewall llm-guardrails
-
Updated
Jun 25, 2025 - Python
Code scanner to check for issues in prompts and LLM calls
cli security ai linter evaluation code-scanning red-teaming ai-security hallucination ai-evaluation llm prompt-injection llm-security ai-code-review llm-evaluation owasp-llm-top-10 ai-performance ai-red-teaming llm-performance
-
Updated
Apr 6, 2025 - Python
Improve this page
Add a description, image, and links to the llm-security topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the llm-security topic, visit your repo's landing page and select "manage topics."