Development of measurable indicators to enhance public health evidence-informed policy-making

Valentina Tudisca, Adriana Valente, Tommaso Castellani, Timo Ståhl, Petru Sandu, Diana Dulf, Hilde Spitters, Ien van de Goor, Christina Mathilde Radl-Karimi, Mohamed Ahmed Syed, Natasa Loncarevic, Cathrine Juel Lau, Susan Roelofs, Maja Bertram, Nancy Edwards, Arja R. Aro, REPOPA Consortium

Research output: Contribution to journalJournal articleResearchpeer-review

125 Downloads (Pure)

Abstract

Background
Ensuring health policies are informed by evidence still remains a challenge despite efforts devoted to this aim. Several tools and approaches aimed at fostering evidence-informed policy-making (EIPM) have been developed, yet there is a lack of availability of indicators specifically devoted to assess and support EIPM. The present study aims to overcome this by building a set of measurable indicators for EIPM intended to infer if and to what extent health-related policies are, or are expected to be, evidence-informed for the purposes of policy planning as well as formative and summative evaluations.
Methods
The indicators for EIPM were developed and validated at international level by means of a two-round internet-based Delphi study conducted within the European project ‘REsearch into POlicy to enhance Physical Activity’ (REPOPA). A total of 82 researchers and policy-makers from the six European countries (Denmark, Finland, Italy, the Netherlands, Romania, the United Kingdom) involved in the project and international organisations were asked to evaluate the relevance and feasibility of an initial set of 23 indicators developed by REPOPA researchers on the basis of literature and knowledge gathered from the previous phases of the project, and to propose new indicators.
Results
The first Delphi round led to the validation of 14 initial indicators and to the development of 8 additional indicators based on panellists’ suggestions; the second round led to the validation of a further 11 indicators, including 6 proposed by panellists, and to the rejection of 6 indicators. A total of 25 indicators were validated, covering EIPM issues related to human resources, documentation, participation and monitoring, and stressing different levels of knowledge exchange and involvement of researchers and other stakeholders in policy development and evaluation.
Conclusion
The study overcame the lack of availability of indicators to assess if and to what extent policies are realised in an evidence-informed manner thanks to the active contribution of researchers and policy-makers. These indicators are intended to become a shared resource usable by policy-makers, researchers and other stakeholders, with a crucial impact on fostering the development of policies informed by evidence.
Original languageEnglish
Article number47
JournalHealth Research Policy and Systems
Volume16
Number of pages13
ISSN1478-4505
DOIs
Publication statusPublished - 2018

Fingerprint

Policy Making
Public Health
Research Personnel
Administrative Personnel
Foster Home Care
Health Policy
Exercise
Delphi Technique
Romania
Denmark
Finland
Research
Documentation
Internet
Netherlands
Italy
Organizations

Keywords

  • Evidence-informed policy-makingindicatorsphysical activityDelphi methodologyco-production of knowledgepublic health
  • Evidence-informed policy-making
  • Physical activity
  • Co-production of knowledge
  • Indicators
  • Public health
  • Delphi methodology
  • Administrative Personnel
  • Public Health
  • Europe
  • Humans
  • Translational Medical Research
  • Evidence-Based Medicine
  • Delphi Technique
  • Exercise
  • Research Personnel
  • Policy Making
  • Health Policy

Cite this

Tudisca, V., Valente, A., Castellani, T., Ståhl, T., Sandu, P., Dulf, D., ... REPOPA Consortium (2018). Development of measurable indicators to enhance public health evidence-informed policy-making. Health Research Policy and Systems, 16, [47]. https://doi.org/10.1186/s12961-018-0323-z
Tudisca, Valentina ; Valente, Adriana ; Castellani, Tommaso ; Ståhl, Timo ; Sandu, Petru ; Dulf, Diana ; Spitters, Hilde ; van de Goor, Ien ; Radl-Karimi, Christina Mathilde ; Syed, Mohamed Ahmed ; Loncarevic, Natasa ; Juel Lau, Cathrine ; Roelofs, Susan ; Bertram, Maja ; Edwards, Nancy ; Aro, Arja R. ; REPOPA Consortium. / Development of measurable indicators to enhance public health evidence-informed policy-making. In: Health Research Policy and Systems. 2018 ; Vol. 16.
@article{0304d8b354cf415ba9a26f580eefd36b,
title = "Development of measurable indicators to enhance public health evidence-informed policy-making",
abstract = "BackgroundEnsuring health policies are informed by evidence still remains a challenge despite efforts devoted to this aim. Several tools and approaches aimed at fostering evidence-informed policy-making (EIPM) have been developed, yet there is a lack of availability of indicators specifically devoted to assess and support EIPM. The present study aims to overcome this by building a set of measurable indicators for EIPM intended to infer if and to what extent health-related policies are, or are expected to be, evidence-informed for the purposes of policy planning as well as formative and summative evaluations.MethodsThe indicators for EIPM were developed and validated at international level by means of a two-round internet-based Delphi study conducted within the European project ‘REsearch into POlicy to enhance Physical Activity’ (REPOPA). A total of 82 researchers and policy-makers from the six European countries (Denmark, Finland, Italy, the Netherlands, Romania, the United Kingdom) involved in the project and international organisations were asked to evaluate the relevance and feasibility of an initial set of 23 indicators developed by REPOPA researchers on the basis of literature and knowledge gathered from the previous phases of the project, and to propose new indicators.ResultsThe first Delphi round led to the validation of 14 initial indicators and to the development of 8 additional indicators based on panellists’ suggestions; the second round led to the validation of a further 11 indicators, including 6 proposed by panellists, and to the rejection of 6 indicators. A total of 25 indicators were validated, covering EIPM issues related to human resources, documentation, participation and monitoring, and stressing different levels of knowledge exchange and involvement of researchers and other stakeholders in policy development and evaluation.ConclusionThe study overcame the lack of availability of indicators to assess if and to what extent policies are realised in an evidence-informed manner thanks to the active contribution of researchers and policy-makers. These indicators are intended to become a shared resource usable by policy-makers, researchers and other stakeholders, with a crucial impact on fostering the development of policies informed by evidence.",
keywords = "Evidence-informed policy-makingindicatorsphysical activityDelphi methodologyco-production of knowledgepublic health, Evidence-informed policy-making, Physical activity, Co-production of knowledge, Indicators, Public health, Delphi methodology, Administrative Personnel, Public Health, Europe, Humans, Translational Medical Research, Evidence-Based Medicine, Delphi Technique, Exercise, Research Personnel, Policy Making, Health Policy",
author = "Valentina Tudisca and Adriana Valente and Tommaso Castellani and Timo St{\aa}hl and Petru Sandu and Diana Dulf and Hilde Spitters and {van de Goor}, Ien and Radl-Karimi, {Christina Mathilde} and Syed, {Mohamed Ahmed} and Natasa Loncarevic and {Juel Lau}, Cathrine and Susan Roelofs and Maja Bertram and Nancy Edwards and Aro, {Arja R.} and {REPOPA Consortium}",
year = "2018",
doi = "10.1186/s12961-018-0323-z",
language = "English",
volume = "16",
journal = "Health Research Policy and Systems",
issn = "1478-4505",
publisher = "BioMed Central",

}

Tudisca, V, Valente, A, Castellani, T, Ståhl, T, Sandu, P, Dulf, D, Spitters, H, van de Goor, I, Radl-Karimi, CM, Syed, MA, Loncarevic, N, Juel Lau, C, Roelofs, S, Bertram, M, Edwards, N, Aro, AR & REPOPA Consortium 2018, 'Development of measurable indicators to enhance public health evidence-informed policy-making', Health Research Policy and Systems, vol. 16, 47. https://doi.org/10.1186/s12961-018-0323-z

Development of measurable indicators to enhance public health evidence-informed policy-making. / Tudisca, Valentina ; Valente, Adriana; Castellani, Tommaso; Ståhl, Timo; Sandu, Petru; Dulf, Diana; Spitters, Hilde; van de Goor, Ien; Radl-Karimi, Christina Mathilde; Syed, Mohamed Ahmed; Loncarevic, Natasa; Juel Lau, Cathrine; Roelofs, Susan; Bertram, Maja ; Edwards, Nancy; Aro, Arja R.; REPOPA Consortium.

In: Health Research Policy and Systems, Vol. 16, 47, 2018.

Research output: Contribution to journalJournal articleResearchpeer-review

TY - JOUR

T1 - Development of measurable indicators to enhance public health evidence-informed policy-making

AU - Tudisca, Valentina

AU - Valente, Adriana

AU - Castellani, Tommaso

AU - Ståhl, Timo

AU - Sandu, Petru

AU - Dulf, Diana

AU - Spitters, Hilde

AU - van de Goor, Ien

AU - Radl-Karimi, Christina Mathilde

AU - Syed, Mohamed Ahmed

AU - Loncarevic, Natasa

AU - Juel Lau, Cathrine

AU - Roelofs, Susan

AU - Bertram, Maja

AU - Edwards, Nancy

AU - Aro, Arja R.

AU - REPOPA Consortium

PY - 2018

Y1 - 2018

N2 - BackgroundEnsuring health policies are informed by evidence still remains a challenge despite efforts devoted to this aim. Several tools and approaches aimed at fostering evidence-informed policy-making (EIPM) have been developed, yet there is a lack of availability of indicators specifically devoted to assess and support EIPM. The present study aims to overcome this by building a set of measurable indicators for EIPM intended to infer if and to what extent health-related policies are, or are expected to be, evidence-informed for the purposes of policy planning as well as formative and summative evaluations.MethodsThe indicators for EIPM were developed and validated at international level by means of a two-round internet-based Delphi study conducted within the European project ‘REsearch into POlicy to enhance Physical Activity’ (REPOPA). A total of 82 researchers and policy-makers from the six European countries (Denmark, Finland, Italy, the Netherlands, Romania, the United Kingdom) involved in the project and international organisations were asked to evaluate the relevance and feasibility of an initial set of 23 indicators developed by REPOPA researchers on the basis of literature and knowledge gathered from the previous phases of the project, and to propose new indicators.ResultsThe first Delphi round led to the validation of 14 initial indicators and to the development of 8 additional indicators based on panellists’ suggestions; the second round led to the validation of a further 11 indicators, including 6 proposed by panellists, and to the rejection of 6 indicators. A total of 25 indicators were validated, covering EIPM issues related to human resources, documentation, participation and monitoring, and stressing different levels of knowledge exchange and involvement of researchers and other stakeholders in policy development and evaluation.ConclusionThe study overcame the lack of availability of indicators to assess if and to what extent policies are realised in an evidence-informed manner thanks to the active contribution of researchers and policy-makers. These indicators are intended to become a shared resource usable by policy-makers, researchers and other stakeholders, with a crucial impact on fostering the development of policies informed by evidence.

AB - BackgroundEnsuring health policies are informed by evidence still remains a challenge despite efforts devoted to this aim. Several tools and approaches aimed at fostering evidence-informed policy-making (EIPM) have been developed, yet there is a lack of availability of indicators specifically devoted to assess and support EIPM. The present study aims to overcome this by building a set of measurable indicators for EIPM intended to infer if and to what extent health-related policies are, or are expected to be, evidence-informed for the purposes of policy planning as well as formative and summative evaluations.MethodsThe indicators for EIPM were developed and validated at international level by means of a two-round internet-based Delphi study conducted within the European project ‘REsearch into POlicy to enhance Physical Activity’ (REPOPA). A total of 82 researchers and policy-makers from the six European countries (Denmark, Finland, Italy, the Netherlands, Romania, the United Kingdom) involved in the project and international organisations were asked to evaluate the relevance and feasibility of an initial set of 23 indicators developed by REPOPA researchers on the basis of literature and knowledge gathered from the previous phases of the project, and to propose new indicators.ResultsThe first Delphi round led to the validation of 14 initial indicators and to the development of 8 additional indicators based on panellists’ suggestions; the second round led to the validation of a further 11 indicators, including 6 proposed by panellists, and to the rejection of 6 indicators. A total of 25 indicators were validated, covering EIPM issues related to human resources, documentation, participation and monitoring, and stressing different levels of knowledge exchange and involvement of researchers and other stakeholders in policy development and evaluation.ConclusionThe study overcame the lack of availability of indicators to assess if and to what extent policies are realised in an evidence-informed manner thanks to the active contribution of researchers and policy-makers. These indicators are intended to become a shared resource usable by policy-makers, researchers and other stakeholders, with a crucial impact on fostering the development of policies informed by evidence.

KW - Evidence-informed policy-makingindicatorsphysical activityDelphi methodologyco-production of knowledgepublic health

KW - Evidence-informed policy-making

KW - Physical activity

KW - Co-production of knowledge

KW - Indicators

KW - Public health

KW - Delphi methodology

KW - Administrative Personnel

KW - Public Health

KW - Europe

KW - Humans

KW - Translational Medical Research

KW - Evidence-Based Medicine

KW - Delphi Technique

KW - Exercise

KW - Research Personnel

KW - Policy Making

KW - Health Policy

U2 - 10.1186/s12961-018-0323-z

DO - 10.1186/s12961-018-0323-z

M3 - Journal article

C2 - 29855328

VL - 16

JO - Health Research Policy and Systems

JF - Health Research Policy and Systems

SN - 1478-4505

M1 - 47

ER -