Google Earth risked ruin with retracted AI tool for making fake satellite pics



Previous Ars testing of Google’s SynthID system has shown that Google’s digital watermark can persist despite substantial image edits and data loss. However, Ars also encountered the issue of SynthID limiting image checks to about 10 per day.

When Ars prompted Google’s Gemini app to run a SynthID check on several AI-modified images generated within Google Earth—before Google removed the Google Earth feature—Gemini responded that it had “detected digital watermarking indicating that part or all of this image was generated or edited using Google AI tools.”

But Ess questioned why Google’s policy on preventing the creation of AI-generated images on harmful topics had not stopped him from depicting scenes such as a hospital with a bomb crater in Gaza. He also expressed skepticism about primarily relying on Google’s SynthID watermarking system and Google’s AI tools for verifying whether an image is AI-generated.

“Fakes do not travel as clean files with their credentials intact,” Ess wrote. “They travel as screen recordings, re-encodes, screenshots of screenshots, filmed off somebody’s phone in a hurry.”

Indeed, Google’s SynthID was unable to provide any image verification when Ars used a smartphone camera to take a photo of an AI-altered image made using the Google Earth feature.

Undermining trust

By introducing an AI image generator as a Google Earth feature, Google risked undermining public trust in Google Earth as a reliable reference for providing authentic imagery of the real world, Ess said. It could have also handed an additional excuse to government officials or anyone who wants to deny genuine satellite photos by claiming they were modified or generated entirely by AI tools.

Giving anyone access to an easy tool to create AI-modified satellite imagery could have also made it even harder for journalists and researchers checking misinformation and disinformation. Ess recommended using multiple sources to verify satellite imagery and relying on constantly updated satellite imagery sources such as Europe’s Copernicus Sentinel-2.

Google may have alleviated immediate concerns by deciding to quickly remove the AI tool within Google Earth—but its statement suggested that the company could eventually bring the feature back in the future.

“We’ve seen geospatial professionals using this feature for a range of useful purposes, however we’ve also seen people sharing screenshots of generated imagery that appear to violate our policies,” according to the Google statement. “So we’re rolling back this feature in Google Earth while we work on implementing stronger guardrails.”



Source link

  • Related Posts

    VC-backed startups commit more fraud, and researchers think they know why  

    A new report from the U.K.’s Imperial College and France’s Emlyon Business School has mapped out the ways Silicon Valley’s VC-backed founders commit fraud — and the role investors play.…

    This New Drone Spins So Fast The Human Eye Can Barely See It

    Researchers at Northwestern announced that they may have cracked the drone-invisibility-code. Dubbed the Phantom Twist by its creators, the drone exploits faults in human vision to become nearly invisible to the…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Cameron Norrie beaten by Denis Shapovalov in Los Cabos semi-final

    Cameron Norrie beaten by Denis Shapovalov in Los Cabos semi-final

    VC-backed startups commit more fraud, and researchers think they know why  

    VC-backed startups commit more fraud, and researchers think they know why  

    Nicole Kidman Styled Her Adidas Sambas in the Chicest Way

    Nicole Kidman Styled Her Adidas Sambas in the Chicest Way

    Knickers in a twist: why M&S selling crotchless panties isn’t as outrageous as it seems | Marks & Spencer

    Knickers in a twist: why M&S selling crotchless panties isn’t as outrageous as it seems | Marks & Spencer

    Biographical note

    WestJet cancels flights as Sunday strike deadline looms

    WestJet cancels flights as Sunday strike deadline looms