Usefulness of Generative AI Tools in Pediatric Dentistry
Author Information
Author(s): Kusaka Satoru, Akitomo Tatsuya, Hamada Masakazu, Asao Yuria, Iwamoto Yuko, Tachikake Meiko, Mitsuhata Chieko, Nomura Ryota
Primary Institution: Hiroshima University Hospital
Hypothesis
Can generative AI tools provide reliable information for pediatric dentistry?
Conclusion
Generative AI tools can be useful assistants in clinical pediatric dentistry, although their accuracy varies by question type.
Supporting Evidence
- The average AI response score was 3.34, indicating moderate reliability.
- Responses related to consultations from guardians scored the highest average.
- AI struggled with questions about dental abnormalities, scoring below 3.
- Microsoft Copilot outperformed other AI tools in several categories.
- AI responses were evaluated using a 5-point Global Quality Scale.
- Statistical analysis showed significant differences in AI performance across question categories.
- Generative AI tools can assist in providing information but have limitations in accuracy.
- Further research is needed to improve AI's clinical application in dentistry.
Takeaway
This study looked at how well AI can answer questions about kids' dental care, and it found that AI can help but isn't perfect.
Methodology
The study evaluated responses from three generative AI tools to 20 pediatric dentistry questions, rated by six specialists.
Potential Biases
The AI responses may be influenced by the general medical knowledge it was trained on, which can lead to inaccuracies.
Limitations
The study used free versions of AI tools, which may yield different results than paid versions, and the questions were based on personal experience without standardization.
Participant Demographics
Six pediatric dental specialists with over 5 years of clinical experience evaluated the AI responses.
Statistical Information
P-Value
p<0.05
Statistical Significance
p<0.05
Digital Object Identifier (DOI)
Want to read the original?
Access the complete publication on the publisher's website