Author Interviews, Outcomes & Safety / 11.10.2016
Hospital Ranking Systems Need Better Validation and Transparency
MedicalResearch.com Interview with:
Bala N. Hota, MD
Department of Internal Medicine
Rush Medical College
Chicago, IL
MedicalResearch.com: What is the background for this study?
Response: There has been a proliferation of online ranking systems that seek to rate the quality of health care systems. Rush University Medical Center (RUMC) has consistently scored highly on patient safety measurement systems. For example, RUMC has received nine consecutive “A” grades for safety from the Leapfrog Group, and was recently ranked “4 stars” in the CMS 2016 star ranking system.
In the 2015-2016 US News and World Report Ranking System, however, Rush received a low score for quality, a 1 out of 5 possible points, which was a surprise. To understand these results, the RUMC quality team began a process to validate the data and methods of the US News hospital ranking system.
What was found was a surprise – the data backing the ranking system produced by US News had flaws, leading to the low score. Specifically, data were missing from the data set used for the US News analysis, including whether a condition was present on admission in 10% of cases; dates of service were also missing from all cases. The quality team at RUMC then conducted an analysis using national data, and simulated the impact of these data flaws on national rankings.



















