ChatGPT May Improve Access to Language-Concordant Care for Patients With Non–English Language Preferences
2024

ChatGPT's Role in Translating Medical Education Materials

Sample size: 5 publication Evidence: moderate

Author Information

Author(s): Fiatsogbe Dzuali MD, Kira Seiger MD, MBA, Roberto Novoa MD, Maria Aleshin MD, Joyce Teng MD, PhD, Jenna Lester MD, Roxana Daneshjou MD, PhD

Primary Institution: University of California, San Francisco

Hypothesis

Can ChatGPT accurately translate patient education materials into Spanish, Mandarin, and Russian?

Conclusion

ChatGPT may effectively translate medical information into Spanish and Russian, but its Mandarin translations require further refinement.

Supporting Evidence

  • ChatGPT translations into Spanish and Russian were mostly deemed clinically usable.
  • 60% of Mandarin translations contained misinformation.
  • Grammatical and spelling errors were identified in all languages.
  • 80% of reviewers would provide Spanish and Russian translations to patients.

Takeaway

This study looked at how well ChatGPT can change English medical information into other languages. It did a good job with Spanish and Russian, but not so much with Mandarin.

Methodology

The study involved translating English patient education materials into Spanish, Mandarin, and Russian, followed by evaluations from board-certified dermatologists fluent in the target languages.

Potential Biases

The study may be biased due to reliance on a limited number of reviewers and existing materials.

Limitations

The study focused on dermatologists' expertise for evaluating translations and did not explore multiple prompts, potentially underestimating the effects of errors.

Participant Demographics

Participants included board-certified dermatologists fluent in Spanish, Mandarin, and Russian.

Digital Object Identifier (DOI)

10.2196/51435

Want to read the original?

Access the complete publication on the publisher's website

View Original Publication