ONTARIO AUDITORS: AI DOCTOR NOTES FAIL ON BASICS

An audit by Ontario's Office of the Auditor General found that AI note-taking systems deployed in healthcare settings frequently misrecord basic facts from patient encounters, including names, dates, diagnoses, and treatment details. The investigation examined multiple AI transcription tools used across Ontario's healthcare system to automatically generate clinical documentation from doctor-patient interactions. Auditors discovered error rates that consistently exceeded acceptable thresholds for medical records, which must maintain high accuracy standards to support patient care and legal compliance. Common failures included the AI system conflating patient information, recording incorrect vital signs, misidentifying medications, and garbling clinical terminology. In some cases, the errors altered the clinical meaning of notes in ways that could potentially affect subsequent treatment decisions. The audit raises questions about implementation practices at healthcare facilities using these systems. While many institutions deploy AI transcription to reduce administrative burden on physicians, the Ontario findings suggest inadequate verification protocols may be in place. Doctors typically review and sign off on AI-generated notes, but the audit suggests this review process may not be catching systemic errors. Healthcare organizations using AI documentation tools now face pressure to establish stronger quality assurance measures. This could include enhanced human review processes, limiting AI use to certain note types, or more rigorous vendor testing before deployment. The findings align with broader concerns about AI reliability in high-stakes sectors. Unlike consumer applications where errors carry minimal consequences, medical documentation errors can have serious implications for patient safety and clinical outcomes. Ontario health officials have been contacted for comment on implementation of audit recommendations. The report does not name specific AI vendors or healthcare facilities involved in the audit, but its findings apply across multiple organizations currently using similar technology.