NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
-
Updated
Apr 7, 2026 - Python
#
llm-safety
Here are 140 public repositories matching this topic...
DeepTeam is a framework to red team LLMs and LLM systems.
-
Updated
Apr 6, 2026 - Python
UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection
uncertainty-quantification uncertainty-estimation ai-safety confidence-score hallucination confidence-estimation ai-evaluation llm llm-evaluation llm-safety hallucination-evaluation hallucination-detection hallucination-mitigation llm-hallucination
-
Updated
Apr 3, 2026 - Python
Internal Safety Collapse: Turning the LLM or an AI Agent into a sensitive data generator.
benchmark jailbreak ai-safety adversarial-attacks red-teaming large-language-models llm-safety safety-evaluation agent-safety frontier-models
-
Updated
Apr 6, 2026 - Python
Protect every action your agent takes.
guardrails prompt-injection data-leakage-prevention llm-safety ai-gateway content-safety ai-agent-security ai-security-gateway enterprise-ai-guardrails openclaw openclaw-security
-
Updated
Mar 27, 2026 - TypeScript
Decrypted Generative Model safety files for Apple Intelligence containing filters
-
Updated
Jan 26, 2026 - Python
[NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.
-
Updated
Apr 1, 2025 - Python
Attack to induce LLMs within hallucinations
-
Updated
May 17, 2024 - Python
Papers about red teaming LLMs and Multimodal models.
-
Updated
May 28, 2025
Static security scanner for LLM agents — prompt injection, MCP config auditing, taint analysis. 49 rules mapped to OWASP Agentic Top 10 (2026). Works with LangChain, CrewAI, AutoGen.
python cli security mcp static-analysis owasp taint-analysis vulnerability-detection vulnerability-scanner ai-security ai-agent langchain prompt-injection llm-security llm-safety crewai ai-security-tool langchain-security-
-
Updated
Apr 2, 2026 - Python
Reading list for adversarial perspective and robustness in deep reinforcement learning.
deep-reinforcement-learning ai-safety machine-learning-security ai-security robust-machine-learning ai-alignment safe-reinforcement-learning robust-reinforcement-learning responsible-ai adversarial-reinforcement-learning secure-ai ml-security llm-security reinforcement-learning-safety llm-safety artificial-intelligence-security artificial-intelligence-alignment robust-deep-reinforcement-learning reinforcement-learning-security large-language-model-safety
-
Updated
Mar 2, 2026
[NeurIPS 2025] SECA: Semantically Equivalent and Coherent Attacks for Eliciting LLM Hallucinations
-
Updated
Dec 10, 2025 - Python
Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"
nlp benchmark ai artificial-intelligence nlp-machine-learning red-teaming bias-detection safety-monitoring transformers-models llm llm-evaluation llm-safety llm-safety-benchmark
-
Updated
Sep 20, 2024 - Python
AISecOps (AI Security Operations) framework for deterministic verification of AI systems. QWED verifies LLM outputs using math, logic, and symbolic execution — creating an auditable trust boundary for agentic AI systems. Not generation. Verification.
python nlp machine-learning sympy smt-solver formal-verification ai-safety ai-security hallucination code-security ai-accuracy generative-ai enterprise-ai neurosymbolic-ai llm-safety hallucination-detection z3-prover deterministic-ai aisecops llm-verification
-
Updated
Apr 7, 2026 - Python
Papers from our SoK on Red-Teaming (Accepted at TMLR)
-
Updated
Mar 24, 2026
NeurIPS'24 - LLM Safety Landscape
-
Updated
Oct 21, 2025 - Python
Restore safety in fine-tuned language models through task arithmetic
-
Updated
Mar 28, 2024 - Python
DuoGuard: A Two-Player RL-Driven Framework for Multilingual LLM Guardrails
-
Updated
Feb 26, 2025 - Python
Comprehensive LLM testing suite for safety, performance, bias, and compliance, equipped with methodologies and tools to enhance the reliability and ethical integrity of models like OpenAI's GPT series for real-world applications.
ai-explainability llm-safety large-language-models-testing ai-testing-best-practices gpt-model-reliability ai-bias-testing ai-security-testing model-compliance ai-performance-optimization machine-learning-testing-frameworks
-
Updated
Apr 15, 2024
Code and dataset for the paper: "Can Editing LLMs Inject Harm?"
-
Updated
Dec 26, 2025 - Python
Improve this page
Add a description, image, and links to the llm-safety topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the llm-safety topic, visit your repo's landing page and select "manage topics."