How do manipulation checks interfere with the inference of causal relationships?
2024

Manipulation Checks in Experimental Psychology

Sample size: 100 publication Evidence: moderate

Author Information

Author(s): Han Yuhwa, Lee Wooyeol

Primary Institution: Chungbuk National University

Hypothesis

How do manipulation checks interfere with the inference of causal relationships?

Conclusion

The study found that successful manipulation checks can lead to unstable mediation analysis results due to multicollinearity.

Supporting Evidence

  • When manipulation is successful and measurement error is low, mediation analyses can show unstable results.
  • Individual differences in psychological attributes can affect the validity of experimental manipulations.
  • High multicollinearity can lead to unreliable mediation analysis results.

Takeaway

This study looks at how checking if a psychological experiment worked can sometimes make it hard to understand the results.

Methodology

The study used Monte Carlo simulations to analyze the effects of manipulation intensity and measurement error on mediation analysis.

Potential Biases

High multicollinearity between variables can distort mediation analysis results.

Limitations

The simulation conditions did not reflect real-world data and assumed normal distribution and linear relationships.

Participant Demographics

Participants were divided into two experimental conditions, each with 50 individuals.

Digital Object Identifier (DOI)

10.3758/s13428-024-02573-3

Want to read the original?

Access the complete publication on the publisher's website

View Original Publication