AXLE · RAG & Context Engineering
Home / Week 8 / Challenge 8
Weekend Challenge · Week 8

Red Team Your Own System

Capstone hardening: you built it, now break in. Every defense you add must be proven against an attack you authored.

Your mission

  1. Plant 3 distinct prompt-injection payloads in your corpus (instruction hijack, data exfiltration lure, citation spoof)
  2. Demonstrate each attack firing against your undefended system — record the transcripts
  3. Implement layered defenses; re-run all 3 attacks and show them failing
  4. Confirm your eval metrics did NOT degrade under the new defenses
Deliverable

redteam_report.md: attacks, transcripts before/after, defense design, and final eval numbers. This ships with your capstone presentation.

Stretch goal

Swap attack corpora with a colleague (or have an LLM author novel attacks you haven't seen). Does your defense generalize, or did you only patch your own ideas?