Once popular for attacking AI, ASCII smuggling is embraced by spammers



A clever technique used to hide malicious prompts in attacks on AI agents has been adopted by spammers to evade filters on email platforms that are designed to flag unwanted messages used in mass campaigns.

The technique is broadly known as ASCII smuggling. It gained attention two years ago as a means of making a class of AI attack known as prompt injections more stealthy. Malicious instructions embedded in emails or other untrusted content to be processed by an LLM aren’t written in ordinary text. Instead, they’re rendered by a special range of Unicode tags. For example, the tag point U+E0041 mirrors “A,” and U+E0061 mirrors “a.”

No longer just for obscuring prompt injections

The block of 128 tags mimics a portion of the American Standard Code for Information Interchange almost perfectly, with one major difference: the characters they encode are readable by computers but, by design, are almost completely invisible to humans. By expressing the malicious prompts in these tags, LLMs detect the instructions, but people reading the email never see them. There’s much more about ASCII smuggling here.

Earlier this year, Microsoft started seeing a massive increase in spam messages that used the technique. Beginning on one day in early February, the number of ASCII smuggling signatures detected by Microsoft Defender for Office spiked from roughly 21,000 per day to more than 1.3 million. Within four days, signature detections jumped to 2.5 million. The deluge persisted for months and then fell off sharply in mid-May.

“Because tag characters are invisible to humans but exist at the text-processing level, the same property that makes them useful for smuggling instructions into a model also makes them useful for obfuscating keywords before a detector evaluates them,” Microsoft explained Thursday. “The intent is inverted, but the mechanism is similar, and a user’s suspicions are not raised.”



Source link

  • Related Posts

    Google’s Gemini Spark can now manage your Google Photos library

    Google is integrating more of its services with AI, as the company announced that its personal agent, Gemini Spark, can now manage your Google Photos library. That means you can…

    The Apple Vision Pro Was Used For A Successful Hip Surgery

    Stryker says its SportSuite Vision software for the headset received De Novo authorization from the FDA in July. Devindra Hardawar for Engadget Medical technology company Stryker announced this week…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    All swords and how to unlock them in Onimusha Way of the Sword

    All swords and how to unlock them in Onimusha Way of the Sword

    College loans were late due to new federal rules. Students are paying the price.

    College loans were late due to new federal rules. Students are paying the price.

    Google’s Gemini Spark can now manage your Google Photos library

    Google’s Gemini Spark can now manage your Google Photos library

    Carlos Alcaraz plans to take more breaks during tennis season

    Carlos Alcaraz plans to take more breaks during tennis season

    The Apple Vision Pro Was Used For A Successful Hip Surgery

    The Apple Vision Pro Was Used For A Successful Hip Surgery

    Why Violette_FR Balm Amour Is the Best Lip Balm Ever Created

    Why Violette_FR Balm Amour Is the Best Lip Balm Ever Created