Using quality indicators to predict inspection ratings: cross-sectional study of general practices in England.

T Allen, K Walshe, N Proudlove, M Sutton

Research output: Contribution to journalJournal articleResearchpeer-review

Abstract

Background The Care Quality Commission regulates, inspects, and rates general practice providers in England. Inspections are costly and infrequent, and are supplemented by a system of routine quality indicators, measuring patient satisfaction and the management of chronic conditions. These indicators can be used to prioritise or target inspections. Aim To determine whether this set of indicators can be used to predict the ratings awarded in subsequent inspections. Design and setting This cross-sectional study was conducted using a dataset of 6860 general practice providers in England. Method The indicators and first-inspection ratings were used to build ordered logistic regression models to predict inspection outcomes on the four-level rating system (‘outstanding’, ‘good’, ‘requires improvement’, and ‘inadequate’) for domain ratings and the ‘overall’ rating. Predictive accuracy was assessed using the percentage of correct predictions and a measure of agreement (weighted κ). Results The model correctly predicted 79.7% of the ‘overall’ practice ratings. However, 78.8% of all practices were rated ‘good’ on ‘overall’, and the weighted κ measure of agreement was very low (0.097); as such, predictions were little more than chance. This lack of predictive power was also found for each of the individual domain ratings. Conclusion The poor power of performance of these indicators to predict subsequent inspection ratings may call into question the validity and reliability of the indicators, inspection ratings, or both. A number of changes to the way data relating to performance indicators are collected and used are suggested to improve the predictive value of indicators. It is also recommended that assessments of predictive power be undertaken prospectively when sets of indicators are being designed and selected by regulators.

Original languageEnglish
JournalBritish Journal of General Practice
Volume70
Issue number690
Pages (from-to)E55-E63
ISSN0960-1643
DOIs
Publication statusPublished - 2020
Externally publishedYes

Keywords

  • Data analysis
  • General practice administration and organisation
  • General practice standards
  • Government regulation
  • National Health Service
  • Patient safety
  • Cross-Sectional Studies
  • Humans
  • Quality of Health Care/organization & administration
  • England/epidemiology
  • Data Collection
  • Quality Assurance, Health Care
  • Quality Indicators, Health Care/statistics & numerical data
  • Public Health Practice
  • General Practice/organization & administration
  • Total Quality Management/standards

Fingerprint Dive into the research topics of 'Using quality indicators to predict inspection ratings: cross-sectional study of general practices in England.'. Together they form a unique fingerprint.

Cite this