A generalizability study of the medical judgment vignettes interview to assess students' noncognitive attributes for medical school
2008

Assessing Noncognitive Attributes in Medical School Admissions

Sample size: 29 publication Evidence: moderate

Author Information

Author(s): Donnon Tyrone, Paolucci Elizabeth Oddone

Primary Institution: University of Calgary

Hypothesis

The study aims to determine the reliability of the Medical Judgment Vignettes interview in assessing noncognitive attributes of medical school candidates.

Conclusion

The Medical Judgment Vignettes interview is a reliable method for assessing candidates' noncognitive attributes for medical school.

Supporting Evidence

  • The Medical Judgment Vignettes interview had a G coefficient of 0.70.
  • Increasing the number of stations to six with a single judge improved the G coefficient to 0.81.
  • The mean interrater reliability coefficient was Kappa = 0.95 across the three Medical Judgment Vignettes.
  • Participants' performance scores covered the full range of potential scores across the five stages.

Takeaway

This study shows that a special interview can help figure out if medical school applicants have important personal qualities, like being caring and ethical.

Methodology

A three station, Medical Judgment Vignettes interview was conducted with 29 participants, scored by two judges using a 5-point rubric.

Potential Biases

Potential biases may arise from the subjective nature of the interview process and the training of judges.

Limitations

The study's sample size was small and consisted of convenience sampling, which may not represent the broader population.

Participant Demographics

The sample consisted of 18 females (62%) and 11 males (38%) with a mean age of 26.7 years.

Statistical Information

P-Value

0.25

Statistical Significance

p<0.05

Digital Object Identifier (DOI)

10.1186/1472-6920-8-58

Want to read the original?

Access the complete publication on the publisher's website

View Original Publication