‘Legitimately Dangerous’: Google’s Inaccurate AI Overviews Ignite Mockery and Raise Concerns

Should You Add Glue to Your Pizza? Stare at the Sun for 30 Minutes? Eat Rocks? Treat Snake Bites with Ice?

According to Google's new "AI Overview" feature, these dangerous suggestions appear among the top results when users search for information.

What is Google AI Overview?

In May 2023, Google launched the “Search Generative Experience” to compete with OpenAI's ChatGPT. This AI-driven summary of key information is displayed prominently below the search bar, before the traditional list of blue links. Initially an opt-in feature, it became the default experience for all U.S. users after being rebranded as AI Overviews at the recent I/O conference. Users can still opt out by switching to the “Web” tab during searches.

Why is Google AI Overview Controversial?

Since its rollout, many have taken to X (formerly Twitter) to highlight the concerning, often inaccurate results generated by AI Overviews. Some misleading results can even be harmful or inflammatory, leading to criticism from celebrities and users alike. The poor quality of AI-generated responses has sparked memes and jokes, mocking Google's reliability.

To address these concerns, Google has labeled the AI Overview feature as “experimental,” indicating that results may vary in accuracy. The company asserts that user feedback and human reviews will guide improvements to the system.

Will Google Remove AI Overviews?

Calls for Google to reconsider the AI Overview feature have emerged, especially after past incidents where Google suspended AI tools for producing problematic results. A company spokesperson noted that the most troubling examples shared online involved “very uncommon queries” and have responded to isolated incidents by refining the feature. However, some users view this as an excuse, questioning the integrity of the system that relies on generating content from previously indexed sources, including misinformation and satire.

Conclusion

While it’s unclear how many searches yield inaccurate information, AI Overview seems more vulnerable to untrustworthy sources than traditional Google Search. Users must exercise caution and verify information from reliable sources before taking action based on these AI-generated results. Alternatives like Perplexity have shown greater accuracy in providing trustworthy information, highlighting an ironic twist for Google, which pioneered the technology behind modern generative AI.