Evaluating ChatGPT Responses to Patient Questions About Total Ankle Arthroplasty
Author Information
Author(s): Artioli Elena, Veronesi Francesca, Mazzotti Antonio, Brogini Silvia, Zielli Simone Ottavio, Giavaresi Gianluca, Faldini Cesare
Primary Institution: IRCCS Istituto Ortopedico Rizzoli Bologna, Italy
Hypothesis
Can ChatGPT provide accurate and comprehensive answers to common patient questions regarding total ankle arthroplasty?
Conclusion
ChatGPT shows potential as a tool for answering common patient questions about total ankle arthroplasty, providing mostly clear and accurate information.
Supporting Evidence
- ChatGPT's responses were mostly satisfactory, requiring minimal clarification.
- The average accuracy score for ChatGPT's responses was 2, indicating good performance.
- Mean DISCERN score was 51, categorized as good-fair.
- Responses were evaluated by orthopedic surgeons for quality and clarity.
- ChatGPT's readability level was assessed to require approximately 13.3 years of education.
Takeaway
ChatGPT can help answer questions about ankle surgery, making it easier for patients to understand their options.
Methodology
Ten common questions were selected by two ankle surgeons, and ChatGPT was used to generate responses, which were then evaluated for accuracy and clarity.
Potential Biases
Potential for misinformation if patients rely solely on AI without consulting healthcare professionals.
Limitations
The study only assessed responses in English and did not explore variations in responses based on rephrasing or different user inputs.
Digital Object Identifier (DOI)
Want to read the original?
Access the complete publication on the publisher's website