RAG Red-Teaming Pipeline

2025

Project Overview

Designed and built an attacker-to-evaluator pipeline comprising an attacker, executor, target RAG system, and evaluator. The framework probes an HR chatbot for prompt injection, roleplay jailbreaks, encoding obfuscation, RAG context poisoning, and other adversarial behaviors. A hybrid observability score combines an LLM semantic judge with heuristic signals and severity tiers, surfaced through a real-time SSE streaming dashboard in Next.js.

Technologies

PythonGeminiGroq/LLaMA-3.3-70BFastAPINext.js