A Propaganda Index for Reviewing Research Reports
Author Information
Author(s): Eileen Gambrill, Amanda Reiman
Primary Institution: School of Social Welfare, University of California, Berkeley
Hypothesis
To determine the effectiveness of an index in increasing recognition of misleading problem framing in articles and manuscripts.
Conclusion
This propaganda index warrants further exploration as a complement to reporting guidelines such as CONSORT and PRISMA.
Supporting Evidence
- Participants detected propaganda at a higher rate after using the Propaganda Index.
- The mean percentage of indicators detected increased from 4.5% to 64.3% after using the index.
- Inter-rater reliability between reviewers was .88.
- Detection of under-treatment indicators improved by 67% after using the index.
Takeaway
The study created a tool to help people spot misleading information in research articles, and it showed that using this tool helped people notice more problems.
Methodology
A propaganda index consisting of 32 items was developed, and 17 subjects reviewed five articles using this index to identify propaganda indicators.
Potential Biases
The study relied on a convenience sample of reviewers who may not have specialized knowledge in social anxiety.
Limitations
Many instances of propaganda remained undetected even with the use of the index.
Participant Demographics
All participants had a doctoral degree but none specialized in social anxiety.
Digital Object Identifier (DOI)
Want to read the original?
Access the complete publication on the publisher's website