基于注意力引导奖励的强化学习对大推理模型的越狱攻击 / Attention-Guided Reward for Reinforcement Learning-based Jailbreak against Large Reasoning Models
1️⃣ 一句话总结
本文发现对大推理模型的越狱攻击成功率与其注意力模式密切相关,并据此提出一种利用强化学习和注意力信号设计奖励函数的攻击方法,结合多样说服策略,显著提升了攻击的效果、效率和可迁移性。
Large Reasoning Models (LRMs) have demonstrated remarkable capabilities in solving complex problems by generating structured, step-by-step reasoning content. However, exposing a model's internal reasoning process introduces additional safety risks; for example, recent studies show that LRMs are more vulnerable to jailbreak attacks than standard LLMs. In this paper, we investigate jailbreak attacks on LRMs and reveal that the attack success rate (ASR) is closely correlated with LRMs' attention patterns. Specifically, successful jailbreaks tend to assign lower attention to harmful tokens in the input prompt, while allocating higher attention to those tokens in the reasoning content. Motivated by this finding, we propose a novel jailbreak method for LRMs that leverages reinforcement learning (RL) to enhance attack effectiveness, explicitly incorporating attention signals into the reward function design. In addition, we introduce diverse persuasion strategies to enrich the RL action space, which consistently improves the ASR. Extensive experiments on five open-source and closed-source LRMs across three benchmarks demonstrate that our method achieves substantially higher ASR, outperforming existing approaches in terms of effectiveness, efficiency, and transferability.
基于注意力引导奖励的强化学习对大推理模型的越狱攻击 / Attention-Guided Reward for Reinforcement Learning-based Jailbreak against Large Reasoning Models
本文发现对大推理模型的越狱攻击成功率与其注意力模式密切相关,并据此提出一种利用强化学习和注意力信号设计奖励函数的攻击方法,结合多样说服策略,显著提升了攻击的效果、效率和可迁移性。
源自 arXiv: 2605.19485