Critique of Discriminative Instruments
Author Information
Author(s): Norman Geoffrey R
Primary Institution: McMaster University
Hypothesis
Reliability is not a good measure of discrimination in measurement instruments.
Conclusion
Reliability and discrimination are fundamentally linked, and one cannot assess discrimination without considering measurement error.
Supporting Evidence
- Reliability coefficients reflect the ability of an instrument to differentiate among individuals.
- Hankins' examples show that reliability and discrimination can diverge.
- True differences can only be separated from measurement error with multiple observations.
Takeaway
This study argues that just because a measurement tool is reliable doesn't mean it can tell the difference between people accurately.
Methodology
The author critiques the definitions and calculations of reliability and discrimination presented in Hankins' article.
Potential Biases
The author acknowledges a potential bias in assuming all differences in scales are real.
Limitations
The critique is based on theoretical arguments rather than empirical data.
Participant Demographics
Participants were 10 subjects used in examples.
Want to read the original?
Access the complete publication on the publisher's website