Hidden in Thought: Transferable Chain-of-Thought Artifacts Induce Harmful Behavior
arXiv:2607.15286v1 Announce Type: cross Abstract: We investigate whether harmful chain-of-thought (CoT) traces from compromised language models can transfer unsafe behaviour and be distilled into reusable jailbreak attacks. Using an emergent-misalignment organism and a refusal-ablated jailbroken organism, we transplant harmful CoTs into $29$ open-source and $5$ closed-source targets. Transferred traces raise harmful-response rates above $80\%$ on the most vulnerable open-source models, while sem...
arXiv cs.CL
·Ali khalil, Aly M. Kassem, Mohamed Abdelrazek, Santu Rana, Negar Rostamzadeh, Golnoosh Farnadi
·
// relacionados
Leia também
Blog
Hugging Face says an AI agent hacked its infrastructure, and it used AI to fight back
Editorial
Cura 1T: um modelo que aprende medicina treinando a si mesmo, sob supervisão humana
Blog
Beyond grep: The case for a context-rich AI coding harness
Blog