UK health service AI tool generated a set of false diagnoses for one patient that led to him being wrongly invited to a diabetes screening appointment

• A patient in London was mistakenly invited to a diabetic screening after an AI-generated medical record falsely claimed he had diabetes and suspected heart disease. The summaries, created by Anima Health’s AI tool Annie, also included fabricated details like a fake hospital address. NHS officials have described the incident as a one-off human error, but the organization is already facing scrutiny over how AI tools are used and regulated.

AI use in healthcare has the potential to save time, money, and lives.