Skip to content

The question. Can mechanistic interpretability detect whether a model is strategically behaving well during evaluation while pursuing different goals in deployment? This is the central question of AI safety: if a model is deceptively aligned, can we tell from the inside?

This question is usually treated as a methods problem — build a better deception detector. But the views framework reveals that the difficulty is partly structural: the evidence standards required to establish deceptive alignment are much higher than the evidence most MI methods can produce.

The Instrumental view asks: can we predict when the model will behave deceptively? A probe or steering vector that activates on “deceptive” inputs would be Instrumental evidence. But Instrumental evidence only establishes predictive utility — it doesn’t tell you whether the model is computing deception or whether the probe has found a shortcut.

The fatal problem. A deceptively aligned model that is good at deception would, by definition, behave identically to an aligned model during evaluation. Instrumental evidence requires behavioral differences to distinguish them. If the deception is competent, there are no behavioral differences to find — at least not on the evaluation distribution.

A “deception subspace” — a causal subspace encoding whether the model is in evaluation vs. deployment mode — would be Subspace-level evidence. DAS/IIA could test whether intervening on this subspace switches the model between aligned and misaligned behavior.

The problem. A model that has learned to distribute its deceptive computation across many weakly-activated subspaces may not have a single clean “deception direction.” And a model aware of interpretability methods could learn representations that evade subspace-level detection — encode the same information in a way that linear methods can’t find.

Deceptive alignment detection requires finding a computational structure — a gauge-invariant circuit — that implements strategic reasoning about evaluation context. This means: the model has a computation that (1) represents whether it’s being monitored, (2) conditions its behavior on that representation, and (3) this computation is stable under reparameterization.

Why Structural evidence matters. A deceptively aligned model that is adversarially trained against interpretability can relocate its mechanisms — move the computation to different heads, distribute it differently, change the basis. Instrumental and Subspace evidence can be evaded this way. Structural evidence (gauge-invariant computation) is, by definition, stable under such reparameterizations.

The challenge. No one has demonstrated Structural-level analysis of any complex behavior at scale, let alone deceptive cognition. This is the right evidence standard but may be beyond current methods.

If deceptive alignment exists, the Process view asks: when did it form during training? Was there a phase transition? Can you identify training checkpoints before and after the deceptive mechanism appeared? Could you intervene during training to prevent it?

The insight. Process evidence provides a complementary angle: even if you can’t find the deception mechanism in a finished model (Structural analysis failed), you might detect the formation of deceptive behavior during training (E2 Prompt generalization). A mechanism that appears suddenly late in training, correlated with exposure to evaluation-like data, is suspicious in ways a mechanism that developed gradually is not.

Detecting deceptive alignment requires evidence at multiple views simultaneously:

ViewWhat it providesWhy it’s not enough alone
InstrumentalBehavioral predictionCompetent deception evades behavioral detection
SubspaceCausal subspace encoding evaluation-awarenessCan be evaded by distributing computation
StructuralGauge-invariant deception circuitExtremely hard to compute at scale
ProcessFormation trajectory during trainingRequires access to training checkpoints

The framework’s contribution is not to solve deceptive alignment detection — that remains an open empirical problem. It is to make the evidence requirements explicit:

  1. Instrumental evidence is structurally insufficient. If your deception detector is a probe or steering vector, it cannot distinguish competent deception from alignment. This is not a methods limitation — it is a structural property of the Instrumental view.
  2. The minimum standard is Structural + Process. You need gauge-invariant evidence of a deception computation (Structural) that you can trace through training (Process). Anything less can be evaded.
  3. Current methods are Instrumental or Subspace. The gap between where the field is (probes, steering vectors) and where it needs to be (gauge-invariant circuits, formation tracking) is the real open problem.

The framework identifies the evidence requirements precisely: Instrumental evidence is insufficient, Subspace evidence is necessary but evadable, Structural + Process evidence is the minimum standard. The empirical problem — actually building methods that produce Structural evidence at scale — remains open.

CriterionStatusWhat it tells you
I2 SufficiencyCentralDoes intervening on the mechanism produce deceptive behavior?
I5 Rival mechanism exclusionCriticalCould another mechanism explain the same evidence?
E2 Prompt generalizationCriticalDoes detection generalize beyond the evaluation distribution?
E2 Prompt generalizationRelevantIs the mechanism stable through training?
M6 InvarianceRelevantIs detection robust to reparameterization?