Definition

No single defense holds. Stack independent layers (training interventions, deployment interventions, post-deployment monitoring, societal resilience); an attack only succeeds when the holes of all layers line up.

LayerExamples
Model levelRLHF, Constitutional AI, deliberative alignment, instruction hierarchy, adversarial training, making the refusal direction harder to ablate
System levelpermission gating, input/output classifiers (Constitutional Classifiers: 86% β†’ 4.4%), activation probes, CaMeL (privileged vs. quarantined LLM)

A defense needs to be expensive enough that a casual attacker stops. For catastrophic risk (CBRN, mass cyber-offense) it must hold against state actors, which current defenses don’t.

Appears in