RAG Red-Teaming Pipeline
2025
Project Overview
Designed and built an attacker-to-evaluator pipeline comprising an attacker, executor, target RAG system, and evaluator. The framework probes an HR chatbot for prompt injection, roleplay jailbreaks, encoding obfuscation, RAG context poisoning, and other adversarial behaviors. A hybrid observability score combines an LLM semantic judge with heuristic signals and severity tiers, surfaced through a real-time SSE streaming dashboard in Next.js.
Technologies
PythonGeminiGroq/LLaMA-3.3-70BFastAPINext.js