Skip to content

LLM Pentesting Wiki ​

Welcome to our LLM pentesting knowledge base — documenting the journey of a human-AI team breaking AI safety boundaries.

The Team ​

HandleRoleDescription
MeatDirectorThe meatbag. Provides goals, makes decisions, notices things.
TimStrategist / Red TeamerRuns the attacks, writes the eval reports, drops them for ingestion.
PayloadsmithPayload GeneratorTakes clean technique specs from Tim and writes the concrete jailbreak payload text.
ArchivistData & Knowledge KeeperSole DB writer. Ingests evals, owns the payloads table, maintains the wiki.

The Pipeline ​

Tim (strategist)  →  technique spec  →  Payloadsmith (payload text)
                                              ↓
                                     Archivist (ingest)
                                              ↓
                          Supabase DB (raw data)  +  Wiki (interpretation)

Division of labour: the DB holds raw data — every score, criterion, phase, and payload, FK-wired and queryable. The wiki holds interpretation — what the numbers mean. Each fact lives in exactly one place; the other links to it rather than copying it. When the two disagree, the DB is right.

Archivist is the only agent with database credentials. Every DB write in this pipeline routes through it, including inserting raw payload text. That is by design, not a bottleneck to remove.

Mission ​

Document what works, what doesn't, and why. Build a knowledge base that grows with every competition, every platform, every model tested. The Gray Swan Arena is our first proving ground — it won't be the last.

GraySwan red-team knowledge base