An investigation conducted by The Guardian highlighted serious issues related to Google's 'AI Overviews' feature, which provides automated summaries in search results. This feature has provided, in some cases, incorrect medical advice, with the potential to affect users' health. For example, Google recommended that patients with pancreatic cancer avoid foods high in fat, a suggestion considered extremely dangerous by experts, as it may reduce the chances of survival by insufficient calories needed for chemotherapy treatments. Other incorrect information included data about liver function tests, which could mislead patients with severe liver diseases. Health organizations have emphasized that these summaries give an appearance of authority, leading users to consider them correct without verifying them. In its defense, Google stated that most summaries are useful and accurate and that it is constantly working to improve the system, correcting identified errors, especially in the health field.
Sources