There is no “too small” for frequent workplace-based assessment: Differences between large and small residency programs in anesthesia when using a mobile application to assess EPAs
2024

Assessing Professional Activities in Anesthesia Residency Programs

Sample size: 3936 publication Evidence: moderate

Author Information

Author(s): Tobias Tessmann, Adrian P. Marty, Daniel Stricker, Sören Huwendiek, Jan Breckwoldt

Primary Institution: University Hospital Zurich

Hypothesis

How many assessments are required for reliable ratings in residency programs of different sizes?

Conclusion

Frequent workplace-based assessments of Entrustable Professional Activities were feasible in both large and small residency programs, with no significant differences in the number of assessments performed.

Supporting Evidence

  • 3936 assessments were recorded by 306 supervisors for 295 residents.
  • The median number of assessments per trainee was 8.
  • At least 12 assessments are needed for reliable ratings.
  • Frequent assessments were feasible in both large and small residency programs.
  • No significant differences were found in the number of assessments between program sizes.

Takeaway

Doctors in training can be assessed frequently using a mobile app, and it works well in both big and small hospitals.

Methodology

A mobile app was used to assess 10 different EPAs over 5 months in Swiss anesthesia departments, comparing data from large and small residency programs.

Potential Biases

The voluntary nature of participation could introduce selection bias.

Limitations

Voluntary participation may have led to a non-representative sample, and data on confounders like age and gender were not collected due to privacy policies.

Participant Demographics

Data on specific demographics like age and gender were not collected.

Statistical Information

P-Value

p<0.05

Statistical Significance

p<0.05

Digital Object Identifier (DOI)

10.3205/zma001709

Want to read the original?

Access the complete publication on the publisher's website

View Original Publication