Does the number of choice sets matter? Results from a web survey applying a discrete choice experiment

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

Resumé

Optimising the design of discrete choice experiments (DCE) involves maximising not only the statistical efficiency, but also how the nature and complexity of the experiment itself affects model parameters and variance. The present paper contributes by investigating the impact of the number of DCE choice sets presented to each respondent on response rate, self-reported choice certainty, perceived choice difficulty, willingness-to-pay (WTP) estimates, and response variance. A sample of 1053 respondents was exposed to 5, 9 or 17 choice sets in a DCE eliciting preferences for dental services. Our results showed no differences in response rates and no systematic differences in the respondents' self-reported perception of the uncertainty of their DCE answers. There were some differences in WTP estimates suggesting that estimated preferences are to some extent context-dependent, but no differences in standard deviations for WTP estimates or goodness-of-fit statistics. Respondents exposed to 17 choice sets had somewhat higher response variance compared to those exposed to 5 choice sets, indicating that cognitive burden may increase with the number of choice sets beyond a certain threshold. Overall, our results suggest that respondents are capable of managing multiple choice sets – in this case 17 choice sets – without problems
OriginalsprogDansk
TidsskriftHealth Economics
Vol/bind20
Udgave nummer3
Sider (fra-til)273-286
Antal sider14
ISSN1057-9230
StatusUdgivet - 2011

Citer dette

@article{7d5ab87772e04c3dbfb022749947e792,
title = "Does the number of choice sets matter? Results from a web survey applying a discrete choice experiment",
abstract = "Optimising the design of discrete choice experiments (DCE) involves maximising not only the statistical efficiency, but also how the nature and complexity of the experiment itself affects model parameters and variance. The present paper contributes by investigating the impact of the number of DCE choice sets presented to each respondent on response rate, self-reported choice certainty, perceived choice difficulty, willingness-to-pay (WTP) estimates, and response variance. A sample of 1053 respondents was exposed to 5, 9 or 17 choice sets in a DCE eliciting preferences for dental services. Our results showed no differences in response rates and no systematic differences in the respondents' self-reported perception of the uncertainty of their DCE answers. There were some differences in WTP estimates suggesting that estimated preferences are to some extent context-dependent, but no differences in standard deviations for WTP estimates or goodness-of-fit statistics. Respondents exposed to 17 choice sets had somewhat higher response variance compared to those exposed to 5 choice sets, indicating that cognitive burden may increase with the number of choice sets beyond a certain threshold. Overall, our results suggest that respondents are capable of managing multiple choice sets – in this case 17 choice sets – without problems",
author = "Mickael Bech and Trine Kj{\ae}r and Lauridsen, {J{\o}rgen Trankj{\ae}r}",
year = "2011",
language = "Dansk",
volume = "20",
pages = "273--286",
journal = "Health Economics",
issn = "1057-9230",
publisher = "JohnWiley & Sons Ltd.",
number = "3",

}

Does the number of choice sets matter? Results from a web survey applying a discrete choice experiment. / Bech, Mickael; Kjær, Trine; Lauridsen, Jørgen Trankjær.

I: Health Economics, Bind 20, Nr. 3, 2011, s. 273-286.

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

TY - JOUR

T1 - Does the number of choice sets matter? Results from a web survey applying a discrete choice experiment

AU - Bech, Mickael

AU - Kjær, Trine

AU - Lauridsen, Jørgen Trankjær

PY - 2011

Y1 - 2011

N2 - Optimising the design of discrete choice experiments (DCE) involves maximising not only the statistical efficiency, but also how the nature and complexity of the experiment itself affects model parameters and variance. The present paper contributes by investigating the impact of the number of DCE choice sets presented to each respondent on response rate, self-reported choice certainty, perceived choice difficulty, willingness-to-pay (WTP) estimates, and response variance. A sample of 1053 respondents was exposed to 5, 9 or 17 choice sets in a DCE eliciting preferences for dental services. Our results showed no differences in response rates and no systematic differences in the respondents' self-reported perception of the uncertainty of their DCE answers. There were some differences in WTP estimates suggesting that estimated preferences are to some extent context-dependent, but no differences in standard deviations for WTP estimates or goodness-of-fit statistics. Respondents exposed to 17 choice sets had somewhat higher response variance compared to those exposed to 5 choice sets, indicating that cognitive burden may increase with the number of choice sets beyond a certain threshold. Overall, our results suggest that respondents are capable of managing multiple choice sets – in this case 17 choice sets – without problems

AB - Optimising the design of discrete choice experiments (DCE) involves maximising not only the statistical efficiency, but also how the nature and complexity of the experiment itself affects model parameters and variance. The present paper contributes by investigating the impact of the number of DCE choice sets presented to each respondent on response rate, self-reported choice certainty, perceived choice difficulty, willingness-to-pay (WTP) estimates, and response variance. A sample of 1053 respondents was exposed to 5, 9 or 17 choice sets in a DCE eliciting preferences for dental services. Our results showed no differences in response rates and no systematic differences in the respondents' self-reported perception of the uncertainty of their DCE answers. There were some differences in WTP estimates suggesting that estimated preferences are to some extent context-dependent, but no differences in standard deviations for WTP estimates or goodness-of-fit statistics. Respondents exposed to 17 choice sets had somewhat higher response variance compared to those exposed to 5 choice sets, indicating that cognitive burden may increase with the number of choice sets beyond a certain threshold. Overall, our results suggest that respondents are capable of managing multiple choice sets – in this case 17 choice sets – without problems

M3 - Tidsskriftartikel

VL - 20

SP - 273

EP - 286

JO - Health Economics

JF - Health Economics

SN - 1057-9230

IS - 3

ER -