Reliability of journal impact factor rankings
2007

Reliability of Journal Impact Factor Rankings

Sample size: 19393 publication Evidence: moderate

Author Information

Author(s): Darren C Greenwood

Primary Institution: University of Leeds

Hypothesis

There is uncertainty associated with journal rankings based on the journal impact factor.

Conclusion

Decisions based on journal impact factors are potentially misleading if the associated uncertainty is ignored.

Supporting Evidence

  • Most journals cannot be ranked with great precision.
  • Only the top and bottom few journals could place any confidence in their rank position.
  • Intervals were wider and overlapping for most journals.

Takeaway

This study shows that we can't always trust journal rankings because they can change a lot, and we should be careful when using them.

Methodology

Bayesian Markov chain Monte Carlo methods were used to estimate the uncertainty associated with journal performance indicators based on citations.

Limitations

The study did not extract information on individual articles, which could provide more detailed insights into citation variability.

Statistical Information

Confidence Interval

95% credible intervals

Digital Object Identifier (DOI)

10.1186/1471-2288-7-48

Want to read the original?

Access the complete publication on the publisher's website

View Original Publication