ObjectiveTo evaluate the accuracy of Google Translate (GT) in translating low-acuity paediatric emergency consultations involving respiratory symptoms and fever, and to examine legal and policy implications of using AI-based language interpretation in healthcare.MethodsBased on the methodology used for conducting language performance testing routinely at the Interpreter Services Department of the Hospital for Sick Children, clinical performance testing was completed using a paediatric emergency scenario (child with respiratory illness and fever) on five languages: Spanish, French, Urdu, Arabic, and Mandarin. The study focused on GT's translation accuracy and a legal and policy evaluation regarding AI-based interpretation in healthcare was conducted by legal scholars.ResultsGT demonstrated strong translation performance, with accuracy rates from 83.5% in Urdu to 95.4% in French. Challenges included dialect sensitivity and pronoun misinterpretations. Legal evaluation indicated inconsistent access to language interpretation services across healthcare jurisdictions and potential risks involving data privacy, consent, and malpractice when using AI-based translation tools.ConclusionsGoogle Translate can effectively support communication in specific non-critical paediatric emergency scenarios. However, its use necessitates careful monitoring, understanding of its limitations, and attention to dialect and literal translation risks along with equity considerations. Establishing legal and policy frameworks for language interpretation in healthcare is crucial, alongside addressing funding and data security concerns, to optimize the use of AI-based translation tools in healthcare contexts.
Read full abstract