These days, rather than showing you the traditional list of links when you run a search query, Google is intent on throwing up AI Overviews instead: synthesized summaries of information scraped off the web, with some word-prediction magic added, and packaged together in a way to sound as accurate and reliable as possible.

We’ve written before about some of the problems with these AI Overviews, which regularly contain mistakes or nonsense, and of course rip off the work of the human writers who actually know the answers to the questions you’re putting into Google. There’s another problem though—these AI answers can actually be dangerous.

As with every other new technology through history, scams are now making their way into AI Overviews as well, apparently injecting Google’s AI answers with fraudulent phone numbers that you shouldn’t trust. Here’s what’s happening, and how you can make sure you stay safe.

How AI Overview Scams Work

It’s a good idea not to trust AI for contact details.David Nield

Both The Washington Post and Digital Trends have spotted instances of scam support numbers showing up in Google AI Overviews, reports of which appeared on Facebook and Reddit respectively. Credit unions and banks are also warning their customers about these scams.

It doesn’t seem to be a completely new problem, but the way Google Search works now, it’s been given a new twist.

Here’s what happens: The unfortunate victim Googles a company name looking for a contact number, then calls the number thrown up by AI. This doesn’t actually lead to the company in question, but rather to someone pretending to be that company, who then tries to take payment information or other sensitive details from the caller.

It’s not clear exactly how these fake numbers are being planted, but the best guess is that they’re being published in multiple low-profile places online, alongside the names of major companies. AI Overviews then comes along and scoops them up, without running the proper checks to verify the information.

The planting of misleading phone numbers by bad actors is not a completely new danger of course; misinformation has been a part of the web for a long, long time. But the design of AI Overviews, which picks out information from the web and presents it as fact rather than encouraging you to do the research yourself, is making people much more susceptible to this kind of con.