Do performance indicators predict regulator ratings of healthcare providers? Cross-sectional study of acute hospitals in England.

T Allen, K Walshe, N Proudlove, M Sutton

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

Abstrakt

Objective: To determine whether a large set of care performance indicators ('Intelligent Monitoring (IM)') can be used to predict the Care Quality Commission's (CQC) acute hospital trust provider ratings. Design: The IM dataset and first-inspection ratings were used to build linear and ordered logistic regression models for the whole dataset (all trusts). This was repeated for subsets of the trusts, with these models then applied to predict the inspection ratings of the remaining trusts. Setting: The United Kingdom Department of Health and Social Care's Care Quality Commission is the regulator for all health and social care services in England. We consider their first-inspection cycle of acute hospital trusts (2013-2016). Participants: All 156 English NHS acute hospital trusts. Intervention(s): None. Main Outcome Measure(s): Percentage of correct predictions and weighted kappa. Results: Only 24% of the predicted overall ratings for the test sample were correct and the weighted kappa of 0.01 indicates very poor agreement between predicted and actual ratings. This lack of predictive power is also found for each of the rating domains. Conclusion: While hospital inspections draw on a much wider set of information, the poor power of performance indicators to predict subsequent inspection ratings may call into question the validity of indicators, ratings or both. We conclude that a number of changes to the way performance indicators are collected and used could improve their predictive value, and suggest that assessing predictive power should be undertaken prospectively when the sets of indicators are being designed and selected by regulators.

OriginalsprogEngelsk
TidsskriftInternational journal for quality in health care : journal of the International Society for Quality in Health Care
Vol/bind32
Udgave nummer2
Sider (fra-til)113-119
ISSN1353-4505
DOI
StatusUdgivet - apr. 2020
Udgivet eksterntJa

Fingeraftryk Dyk ned i forskningsemnerne om 'Do performance indicators predict regulator ratings of healthcare providers? Cross-sectional study of acute hospitals in England.'. Sammen danner de et unikt fingeraftryk.

Citationsformater