Indirect calibration between clinical observers - application to the New York Heart Association functional classification system
2010

Improving the Reliability of NYHA Classification

Sample size: 1136 publication Evidence: moderate

Author Information

Author(s): Severo Milton, Gaio Rita, Lourenço Patrícia, Alvelos Margarida, Bettencourt Paulo, Azevedo Ana

Primary Institution: University of Porto Medical School

Hypothesis

The study aims to calibrate the New York Heart Association (NYHA) classification system between observers to increase its reliability.

Conclusion

The study shows that discrepancies in thresholds between observers significantly affect the reliability of the NYHA classification, and calibration can improve this reliability.

Supporting Evidence

  • Previous studies showed an inter-observer agreement for the NYHA classification of approximately 55%.
  • The agreement between estimated ability and the observers' NYHA classification was 88%.
  • The calibration methodology can be useful to improve the reliability between observers in clinical practice and research settings.
  • The study identified discrepancies in thresholds between observers as a main reason for low inter-observer reliability.

Takeaway

Doctors sometimes disagree on how to classify heart failure patients, but this study found a way to make their classifications more consistent.

Methodology

The study used a 4-item questionnaire administered by 7 physicians to assess functional capacity and calibrated NYHA classifications using a 1-parameter logistic graded response model.

Potential Biases

The physicians were aware of patients' responses to the anchor items, which could influence their ratings.

Limitations

The study had a small sample size and each individual was assessed by only one observer, which may limit the generalizability of the findings.

Participant Demographics

Participants were community-dwellers in Porto, Portugal, aged 45 years and older, with 265 reporting breathlessness.

Statistical Information

Statistical Significance

p<0.05

Digital Object Identifier (DOI)

10.1186/1756-0500-4-276

Want to read the original?

Access the complete publication on the publisher's website

View Original Publication