CONTENT AND QUALITY OF CHATGPT AS A SOURCE OF DEMENTIA INFORMATION: COMPARATIVE ANALYSES
2024
Evaluating ChatGPT as a Source of Dementia Information
publication
Evidence: moderate
Author Information
Author(s): Dosso Jill, Kailley Jaya, Angus Payton, Robillard Julie
Primary Institution: University of British Columbia
Hypothesis
Can ChatGPT provide reliable and high-quality information about dementia?
Conclusion
ChatGPT, especially GPT-4, can be a relatively high-quality source of dementia information for non-expert users.
Supporting Evidence
- ChatGPT was released to the public in November 2022.
- GPT-4 links to specific, identifiable, dated sources for its claims.
- All forms of ChatGPT had a high Flesch-Kincaid Grade Level, indicating moderate readability.
Takeaway
ChatGPT can help people find information about dementia, but it might not always connect them to local resources.
Methodology
The study evaluated the quality and content of dementia information from ChatGPT-3.5 and GPT-4 using a validated evaluation tool.
Potential Biases
All versions of ChatGPT were found to be unbiased.
Limitations
ChatGPT is limited in its ability to link users to local resources.
Digital Object Identifier (DOI)
Want to read the original?
Access the complete publication on the publisher's website