Validity evidence of the 2022 ERS thoracic ultrasound Objective Structured Clinical Examination (OSCE)

Pia Iben Pietersen, Rahul Bhatnagar, Freja Andreasen, Lars Konge, Christian Laursen, Najib M. Rahman, Anders B. Nielsen

Publikation: Bidrag til tidsskriftKonferenceabstrakt i tidsskriftForskningpeer review

Abstract

Background: Clinicians increasingly use thoracic ultrasound in several settings due to its high diagnostic accuracy for many common causes of respiratory failure and dyspnoea. However, ultrasound examinations are operator-dependent, and sufficient competences are needed to obtain high diagnostic accuracy and to attain the ability to interpret the images and integrate them into the patient history and other examinations. This study aims to explore and gather validity evidence for the 2022 ERS thoracic ultrasound objective structured clinical examination (OSCE).Methods: An expert panel created the test, which included two theoretical and three practical stations comprising cases with diagnoses which can be established by point-of-care thoracic ultrasound. Twenty-five participants with different levels of experience thoracic ultrasound completed the test. Data from the test scores and questionnaires on participants’ experiences were used for item analysis. Validation was done according to Messick’s framework. The contrasting groups’ standard-setting method was used to establish a pass/fail score.Results: The summarised internal consistency reliability was high with a Cronbach’s alpha=0.83. The novice group (n=4) had a mean test score of 26.9textpm10.0 points, the intermediate group (n=8) scored 55.2textpm5.8 points, and the experienced group (n=13) 62.0textpm6.1 points (one-way ANOVA, plt;0.001). A pass/fail score of 48 points was thus derived (maximum score =75 points).Conslusion: We developed a test for the assessment thoracic ultrasound competences with solid validity evidence, and a pass/fail standard with no false positives or false negatives.FootnotesCite this article as: European Respiratory Journal 2023; 62: Suppl. 67, PA1814.This abstract was presented at the 2023 ERS International Congress, in session textquotedblleftInflammatory endotyping: the macrophage across disease areastextquotedblright.This is an ERS International Congress abstract. No full-text version is available. Further material to accompany this abstract may be available at www.ers-education.org (ERS member access only).
OriginalsprogEngelsk
ArtikelnummerPA1814
TidsskriftEuropean Respiratory Journal
Vol/bind62
Udgave nummersuppl. 67
ISSN0903-1936
DOI
StatusUdgivet - 2023
BegivenhedERS International Congress 2023 - Milan, Italien
Varighed: 9. sep. 202313. sep. 2023

Konference

KonferenceERS International Congress 2023
Land/OmrådeItalien
ByMilan
Periode09/09/202313/09/2023

Fingeraftryk

Dyk ned i forskningsemnerne om 'Validity evidence of the 2022 ERS thoracic ultrasound Objective Structured Clinical Examination (OSCE)'. Sammen danner de et unikt fingeraftryk.

Citationsformater