ChatGPT's Role in Translating Medical Education Materials
Author Information
Author(s): Fiatsogbe Dzuali MD, Kira Seiger MD, MBA, Roberto Novoa MD, Maria Aleshin MD, Joyce Teng MD, PhD, Jenna Lester MD, Roxana Daneshjou MD, PhD
Primary Institution: University of California, San Francisco
Hypothesis
Can ChatGPT accurately translate patient education materials into Spanish, Mandarin, and Russian?
Conclusion
ChatGPT may effectively translate medical information into Spanish and Russian, but its Mandarin translations require further refinement.
Supporting Evidence
- ChatGPT translations into Spanish and Russian were mostly deemed clinically usable.
- 60% of Mandarin translations contained misinformation.
- Grammatical and spelling errors were identified in all languages.
- 80% of reviewers would provide Spanish and Russian translations to patients.
Takeaway
This study looked at how well ChatGPT can change English medical information into other languages. It did a good job with Spanish and Russian, but not so much with Mandarin.
Methodology
The study involved translating English patient education materials into Spanish, Mandarin, and Russian, followed by evaluations from board-certified dermatologists fluent in the target languages.
Potential Biases
The study may be biased due to reliance on a limited number of reviewers and existing materials.
Limitations
The study focused on dermatologists' expertise for evaluating translations and did not explore multiple prompts, potentially underestimating the effects of errors.
Participant Demographics
Participants included board-certified dermatologists fluent in Spanish, Mandarin, and Russian.
Digital Object Identifier (DOI)
Want to read the original?
Access the complete publication on the publisher's website