Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple choice questions?
2007

Assessing Higher Order Cognitive Skills in Education: MEQs vs MCQs

Sample size: 50 publication Evidence: moderate

Author Information

Author(s): Palmer Edward J, Devitt Peter G

Primary Institution: University of Adelaide

Hypothesis

How effectively do modified essay questions (MEQs) assess higher order cognitive skills compared to multiple-choice questions (MCQs)?

Conclusion

Well-constructed multiple-choice questions (MCQs) can effectively replace modified essay questions (MEQs) when MEQs fail to adequately assess higher order cognitive skills.

Supporting Evidence

  • Over 50% of MEQs tested factual recall, similar to MCQs.
  • MCQs frequently tested more than mere recall of knowledge.
  • MEQs failed to consistently assess higher cognitive skills.

Takeaway

This study looked at two types of test questions used in medical education and found that multiple-choice questions are often better at testing thinking skills than essay questions.

Methodology

The study analyzed 50 multiple-choice questions and 139 stages of modified essay questions from three exams over two years, assessing their effectiveness in measuring higher cognitive skills.

Potential Biases

Potential bias in question construction due to lack of formal instruction for authors on how to create effective MEQs.

Limitations

The study's findings may not be generalizable to other institutions due to the specific context of the University of Adelaide.

Participant Demographics

Fourth Year clinical students at the University of Adelaide.

Digital Object Identifier (DOI)

10.1186/1472-6920-7-49

Want to read the original?

Access the complete publication on the publisher's website

View Original Publication