An experimental study of simulated grant peer review: Gender differences and psychometric characteristics of proposal scores
2024

Gender Differences in Grant Peer Review

Sample size: 605 publication 10 minutes Evidence: moderate

Author Information

Author(s): Karen B. Schmaling, Stephen A. Gallo

Primary Institution: Washington State University

Hypothesis

Does the gender of the reviewer or investigator affect the evaluation scores in grant peer review?

Conclusion

Women reviewers tend to give more positive evaluations, and women investigators receive better overall evaluations in grant peer reviews.

Supporting Evidence

  • Women reviewers gave significantly better scores to all criteria except environment than men reviewers.
  • Women investigators received better overall impact scores than men investigators.
  • Peer reviewer reliability was moderate overall, but decreased when evaluating proposals with weaknesses.

Takeaway

This study looked at how men and women score grant proposals. It found that women reviewers often give better scores to women applicants.

Methodology

Participants evaluated NIH-style grant proposals and provided scores based on overall impact statements.

Potential Biases

Potential biases related to gender identity in scoring were noted.

Limitations

The sample may not fully represent current NIH reviewer demographics, and the study lacked actual panel discussions.

Participant Demographics

Participants were mostly White (74.7%) and male (63.8%), with a majority holding PhDs.

Statistical Information

P-Value

0.037

Confidence Interval

95% CI = 0.542, 0.675

Statistical Significance

p<0.05

Digital Object Identifier (DOI)

10.1371/journal.pone.0315567

Want to read the original?

Access the complete publication on the publisher's website

View Original Publication