Anthropic shares more details about how Claude’s new watermarks will work


Anthropic published a blog post Friday seeking to answer some basic questions about how it will watermark the text generated by its chatbot Claude. Such as: How will the watermarking actually work? Can it be hidden with editing? And how does this affect code?

Claude users have been debating the move since the company revealed earlier this week that it would be doing this watermarking to comply with the EU AI Act’s Transparency Code, which requires AI companies to use systems that make it possible to identify AI-generated content.

On Reddit, for example, one poster characterized this as a conspiracy against innocent Claude users, while another claimed, “The only reason you wouldn’t want this is to lie to people.” And Business Insider reports that “dozens” of users on X have claimed to cancel their Claude subscriptions as a result.

Anthropic’s new post starts with a general overview of the watermarking concept, explaining that when making “low-stakes choices” — like choosing between the words “overcast” and “grey” to describe the weather — Claude can create a pattern in its responses that is “undetectable to the reader, but is detectable to anyone who has a key that encodes it.”

“Watermarking does not impact the quality of Claude’s output,” the company said. “To a reader, a watermarked response is indistinguishable from an unwatermarked one.”

More specifically, Anthropic said it will be using the SynthID-Text approach that the Google DeepMind team outlined in 2024, and that it plans to release a watermark detection API. It also noted that watermarking is distinct from the AI detection approaches offered by companies like Pangram that look for “tells” in the writing (like the construction “his isn’t [X], it’s [Y]”) to reveal AI usage: “Picking up on these patterns is fundamentally different from checking for a watermark.”

Could someone just rewrite the text to hide the watermark? Anthropic said it’s possible, but “light editing probably won’t remove the watermark completely,” while “a complete rewrite where every word is replaced will.”

“In the latter case, of course, it’s arguable whether the text can any longer be described as AI-generated,” the company said.

As for whether the watermark will be detectable in text that was only proofread or edited by Claude, Anthropic said that will depend on “the length of the text and how heavily Claude has edited it.” If it’s only been lightly edited, “nearly all the words” will have been written by the human author and “there’s very little (if anything) for the watermark to attach to.”

Code, meanwhile, should have less of a watermark than other text, because the model will need to create working code and won’t have the freedom to choose between a variety of equally valid options. 

“Having said that, in areas where there is an arbitrary choice between particular words or terms within the code, the watermark can be used, such as comments within code,” Anthropic said. “But by definition, it will have a negligible effect on the actual code produced.”

Anthropic also said that Claude won’t be the only AI chatbot to generate watermarked text, as “other major model developers have signed the same Code of Practice and will be implementing their own watermarks.”

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.



Source link

  • Related Posts

    Today’s NYT Strands Hints, Answers and Help for Aug. 16, #896

    Today’s Strands puzzle is a fun one, but a few answers are tough to unscramble. If you need hints and answers, read on. Hint for today’s Strands puzzle Today’s Strands…

    Matt Groening lets slip that Simpsons: Hit & Run might be making a comeback

    At D23, when asked about the potential for a sequel to the cult classic The Simpsons: Hit & Run game, Matt Groening replied, “I think the original game is coming…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Deshaun Watson returns with ‘awesome’ first half for Browns

    Deshaun Watson returns with ‘awesome’ first half for Browns

    Today’s NYT Strands Hints, Answers and Help for Aug. 16, #896

    Today’s NYT Strands Hints, Answers and Help for Aug. 16, #896

    Afghan advocates urge action for women as Taliban marks five years since takeover

    Afghan advocates urge action for women as Taliban marks five years since takeover

    This Is Every Kate Moss Airport Look Since 1994

    This Is Every Kate Moss Airport Look Since 1994

    Bou Meng, Rare Survivor of Khmer Rouge Torture House, Dies at 85

    Bou Meng, Rare Survivor of Khmer Rouge Torture House, Dies at 85

    Backgrounder – Canada’s commitments at 2025 United Nations Peacekeeping Ministerial meeting