Assessing ChatGPT responses to common patient questions regarding total ankle arthroplasty
2024

Assessing ChatGPT Responses to Patient Questions About Total Ankle Arthroplasty

Sample size: 10 publication Evidence: moderate

Author Information

Author(s): Artioli Elena, Veronesi Francesca, Mazzotti Antonio, Brogini Silvia, Zielli Simone Ottavio, Giavaresi Gianluca, Faldini Cesare

Primary Institution: IRCCS Istituto Ortopedico Rizzoli Bologna, Italy

Hypothesis

The study aims to evaluate the ability of ChatGPT to provide accurate and comprehensive responses to common patient questions regarding total ankle arthroplasty.

Conclusion

ChatGPT demonstrates potential as a tool for responding to common patient questions related to total ankle arthroplasty, offering clear and mostly accurate information.

Supporting Evidence

  • ChatGPT's responses were generally satisfactory, requiring minimal clarification.
  • The mean accuracy score was 2, indicating satisfactory responses.
  • The mean DISCERN score was 51, categorized as good-fair.
  • Responses were evaluated for clarity and accuracy by orthopedic surgeons.
  • ChatGPT's performance may improve with advancements in AI technology.

Takeaway

ChatGPT can help answer questions about ankle surgery, making it easier for patients to understand their options.

Methodology

Ten common questions were selected by two ankle surgeons, and ChatGPT was used to answer these questions, with responses analyzed for accuracy and clarity.

Potential Biases

The evaluation of responses was subjective, relying on two independent authors for scoring.

Limitations

The study only posed questions in English and did not assess the variability of responses based on rephrasing or different users.

Digital Object Identifier (DOI)

10.1002/jeo2.70138

Want to read the original?

Access the complete publication on the publisher's website

View Original Publication