Michael Karasik

We introduce Doublespeak , a simple in-context representation hijacking attack against language models. The attack works by systematically replacing a harmful keyword (e.g., bomb ) with a benign token (e.g., carrot ) across multiple in-context examples, provided as a prefix to a harmful request....