Validity evidence of the 2022 ERS thoracic ultrasound Objective Structured Clinical Examination (OSCE)

Pia Iben Pietersen, Rahul Bhatnagar, Freja Andreasen, Lars Konge, Christian Laursen, Najib M. Rahman, Anders B. Nielsen

Research output: Contribution to journalConference abstract in journalResearchpeer-review

Abstract

Background: Clinicians increasingly use thoracic ultrasound in several settings due to its high diagnostic accuracy for many common causes of respiratory failure and dyspnoea. However, ultrasound examinations are operator-dependent, and sufficient competences are needed to obtain high diagnostic accuracy and to attain the ability to interpret the images and integrate them into the patient history and other examinations. This study aims to explore and gather validity evidence for the 2022 ERS thoracic ultrasound objective structured clinical examination (OSCE).Methods: An expert panel created the test, which included two theoretical and three practical stations comprising cases with diagnoses which can be established by point-of-care thoracic ultrasound. Twenty-five participants with different levels of experience thoracic ultrasound completed the test. Data from the test scores and questionnaires on participants’ experiences were used for item analysis. Validation was done according to Messick’s framework. The contrasting groups’ standard-setting method was used to establish a pass/fail score.Results: The summarised internal consistency reliability was high with a Cronbach’s alpha=0.83. The novice group (n=4) had a mean test score of 26.9textpm10.0 points, the intermediate group (n=8) scored 55.2textpm5.8 points, and the experienced group (n=13) 62.0textpm6.1 points (one-way ANOVA, plt;0.001). A pass/fail score of 48 points was thus derived (maximum score =75 points).Conslusion: We developed a test for the assessment thoracic ultrasound competences with solid validity evidence, and a pass/fail standard with no false positives or false negatives.FootnotesCite this article as: European Respiratory Journal 2023; 62: Suppl. 67, PA1814.This abstract was presented at the 2023 ERS International Congress, in session textquotedblleftInflammatory endotyping: the macrophage across disease areastextquotedblright.This is an ERS International Congress abstract. No full-text version is available. Further material to accompany this abstract may be available at www.ers-education.org (ERS member access only).
Original languageEnglish
Article numberPA1814
JournalEuropean Respiratory Journal
Volume62
Issue numbersuppl. 67
ISSN0903-1936
DOIs
Publication statusPublished - 2023
EventERS International Congress 2023 - Milan, Italy
Duration: 9. Sept 202313. Sept 2023

Conference

ConferenceERS International Congress 2023
Country/TerritoryItaly
CityMilan
Period09/09/202313/09/2023

Fingerprint

Dive into the research topics of 'Validity evidence of the 2022 ERS thoracic ultrasound Objective Structured Clinical Examination (OSCE)'. Together they form a unique fingerprint.

Cite this