Inter-rater reliability of direct observations of the physical and psychosocial working conditions in eldercare

An evaluation in the DOSES project

Kristina Karstad, Reiner Rugulies, Jørgen Skotte, Pernille Kold Munch, Birgit A Greiner, Alex Burdorf, Karen Søgaard, Andreas Holtermann

Research output: Contribution to journalJournal articleResearchpeer-review

103 Downloads (Pure)

Abstract

The aim of the study was to develop and evaluate the reliability of the "Danish observational study of eldercare work and musculoskeletal disorders" (DOSES) observation instrument to assess physical and psychosocial risk factors for musculoskeletal disorders (MSD) in eldercare work. During 1.5 years, sixteen raters conducted 117 inter-rater observations from 11 nursing homes. Reliability was evaluated using percent agreement and Gwet's AC1 coefficient. Of the 18 examined items, inter-rater reliability was excellent for 7 items (AC1>0.75) fair to good for 7 items (AC1 0.40-0.75) and poor for 2 items (AC1 0-0.40). For 2 items there was no agreement between the raters (AC1 <0). The reliability did not differ between the first and second half of the data collection period and the inter-rater observations were representative regarding occurrence of events in eldercare work. The instrument is appropriate for assessing physical and psychosocial risk factors for MSD among eldercare workers.

Original languageEnglish
JournalApplied Ergonomics
Volume69
Pages (from-to)93-103
ISSN0003-6870
DOIs
Publication statusPublished - 1. May 2018

Fingerprint

working conditions
evaluation
Nursing Homes
Nursing
nursing home
Observation
worker
event

Keywords

  • Healthcare
  • Nursing home
  • Patient handling activities

Cite this

Karstad, Kristina ; Rugulies, Reiner ; Skotte, Jørgen ; Munch, Pernille Kold ; Greiner, Birgit A ; Burdorf, Alex ; Søgaard, Karen ; Holtermann, Andreas. / Inter-rater reliability of direct observations of the physical and psychosocial working conditions in eldercare : An evaluation in the DOSES project. In: Applied Ergonomics. 2018 ; Vol. 69. pp. 93-103.
@article{2bea6d744614469c8a3650ec4b2e1144,
title = "Inter-rater reliability of direct observations of the physical and psychosocial working conditions in eldercare: An evaluation in the DOSES project",
abstract = "The aim of the study was to develop and evaluate the reliability of the {"}Danish observational study of eldercare work and musculoskeletal disorders{"} (DOSES) observation instrument to assess physical and psychosocial risk factors for musculoskeletal disorders (MSD) in eldercare work. During 1.5 years, sixteen raters conducted 117 inter-rater observations from 11 nursing homes. Reliability was evaluated using percent agreement and Gwet's AC1 coefficient. Of the 18 examined items, inter-rater reliability was excellent for 7 items (AC1>0.75) fair to good for 7 items (AC1 0.40-0.75) and poor for 2 items (AC1 0-0.40). For 2 items there was no agreement between the raters (AC1 <0). The reliability did not differ between the first and second half of the data collection period and the inter-rater observations were representative regarding occurrence of events in eldercare work. The instrument is appropriate for assessing physical and psychosocial risk factors for MSD among eldercare workers.",
keywords = "Healthcare, Nursing home, Patient handling activities",
author = "Kristina Karstad and Reiner Rugulies and J{\o}rgen Skotte and Munch, {Pernille Kold} and Greiner, {Birgit A} and Alex Burdorf and Karen S{\o}gaard and Andreas Holtermann",
note = "Copyright {\circledC} 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.",
year = "2018",
month = "5",
day = "1",
doi = "10.1016/j.apergo.2018.01.004",
language = "English",
volume = "69",
pages = "93--103",
journal = "Applied Ergonomics",
issn = "0003-6870",
publisher = "Pergamon Press",

}

Inter-rater reliability of direct observations of the physical and psychosocial working conditions in eldercare : An evaluation in the DOSES project. / Karstad, Kristina; Rugulies, Reiner; Skotte, Jørgen; Munch, Pernille Kold; Greiner, Birgit A; Burdorf, Alex; Søgaard, Karen; Holtermann, Andreas.

In: Applied Ergonomics, Vol. 69, 01.05.2018, p. 93-103.

Research output: Contribution to journalJournal articleResearchpeer-review

TY - JOUR

T1 - Inter-rater reliability of direct observations of the physical and psychosocial working conditions in eldercare

T2 - An evaluation in the DOSES project

AU - Karstad, Kristina

AU - Rugulies, Reiner

AU - Skotte, Jørgen

AU - Munch, Pernille Kold

AU - Greiner, Birgit A

AU - Burdorf, Alex

AU - Søgaard, Karen

AU - Holtermann, Andreas

N1 - Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

PY - 2018/5/1

Y1 - 2018/5/1

N2 - The aim of the study was to develop and evaluate the reliability of the "Danish observational study of eldercare work and musculoskeletal disorders" (DOSES) observation instrument to assess physical and psychosocial risk factors for musculoskeletal disorders (MSD) in eldercare work. During 1.5 years, sixteen raters conducted 117 inter-rater observations from 11 nursing homes. Reliability was evaluated using percent agreement and Gwet's AC1 coefficient. Of the 18 examined items, inter-rater reliability was excellent for 7 items (AC1>0.75) fair to good for 7 items (AC1 0.40-0.75) and poor for 2 items (AC1 0-0.40). For 2 items there was no agreement between the raters (AC1 <0). The reliability did not differ between the first and second half of the data collection period and the inter-rater observations were representative regarding occurrence of events in eldercare work. The instrument is appropriate for assessing physical and psychosocial risk factors for MSD among eldercare workers.

AB - The aim of the study was to develop and evaluate the reliability of the "Danish observational study of eldercare work and musculoskeletal disorders" (DOSES) observation instrument to assess physical and psychosocial risk factors for musculoskeletal disorders (MSD) in eldercare work. During 1.5 years, sixteen raters conducted 117 inter-rater observations from 11 nursing homes. Reliability was evaluated using percent agreement and Gwet's AC1 coefficient. Of the 18 examined items, inter-rater reliability was excellent for 7 items (AC1>0.75) fair to good for 7 items (AC1 0.40-0.75) and poor for 2 items (AC1 0-0.40). For 2 items there was no agreement between the raters (AC1 <0). The reliability did not differ between the first and second half of the data collection period and the inter-rater observations were representative regarding occurrence of events in eldercare work. The instrument is appropriate for assessing physical and psychosocial risk factors for MSD among eldercare workers.

KW - Healthcare

KW - Nursing home

KW - Patient handling activities

U2 - 10.1016/j.apergo.2018.01.004

DO - 10.1016/j.apergo.2018.01.004

M3 - Journal article

VL - 69

SP - 93

EP - 103

JO - Applied Ergonomics

JF - Applied Ergonomics

SN - 0003-6870

ER -