Researchers from Imperial College London and Fraunhofer HHI developed an architectural prompt injection defence that reduces black-box attack success from 97% to 10%, according to a study published on arXiv [1].
The method, named Heads of Security, learns per-head attention gates that redistribute attention weights between trusted system instructions and untrusted data tokens [1]. In evaluations on GPT-OSS-20B, the RL-Hammer attack achieved a 97% attack success rate against the baseline model and 85% against fine-tuned defence SecAlign, but dropped to 10% when protected by Heads of Security gates [1]. Adaptive white-box attack Claudini required 3 times more compute FLOPs to achieve the same breach rate against the gated architecture [1].
What it measures
The study measures empirical attack success rates and benign task utility across Llama-3.3-70B-Instruct and GPT-OSS-20B using standardized prompt injection benchmarks [1]. Utility retention was measured across multiple-choice reasoning, standard few-shot prompts, and agentic tool-use environments [1].
What it does not tell you
The evaluation does not measure defence performance against multimodal inputs containing visual steganography or adversarial audio payloads [1]. The paper does not report deployment latency overhead or memory footprint implications when serving gated attention layers on commercial inference engines [1].
Comments