First equals most important? Order effects in vignette-based measurement
A vignette typically describes a hypothetical situation or object which respondents are asked to judge. The object is described as having different dimensions, the values of which are experimentally varied, so that their impact on respondentsâ€™ judgments can be estimated. We examine 1) whether the order in which dimensions are presented impacts estimates, and 2) under which conditions order effects are mostly likely. Using data from a web survey of students we analyze several possible conditions features of the vignette design, characteristics of respondents, and interactions between these. Our results show that strong order effects can occur, but only when the vignettes are complex.
|Date of creation:||18 Jan 2012|
|Contact details of provider:|| Postal: Publications Office, Institute for Social and Economic Research, University of Essex, Wivenhoe Park, Colchester, Essex CO4 3SQ UK|
Web page: https://www.iser.essex.ac.uk/
More information through EDIRC
|Order Information:|| Postal: Publications Office, Institute for Social and Economic Research, University of Essex, Wivenhoe Park, Colchester, Essex CO4 3SQ UK|
Web: https://www.iser.essex.ac.uk/publications/ Email:
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Borghans, Lex & Romans, Margo & Sauermann, Jan, 2010.
"What makes a good conference? Analysing the preferences of labour economists,"
Elsevier, vol. 17(5), pages 868-874, October.
- Borghans Lex & Romans Margo & Sauermann Jan, 2010. "What makes a good conference? Analysing the preferences of labor economists," Research Memorandum 020, Maastricht University, Maastricht Research School of Economics of Technology and Organization (METEOR).
- Borghans Lex & Romans Margo & Sauermann Jan, 2010. "What makes a good conference? Analysing the preferences of labour economists," ROA Research Memorandum 005, Maastricht University, Research Centre for Education and the Labour Market (ROA).
- Borghans, Lex & Romans, Margo & Sauermann, Jan, 2010. "What Makes a Good Conference? Analysing the Preferences of Labor Economists," IZA Discussion Papers 4870, Institute for the Study of Labor (IZA).
- McKEE J. McCLENDON, 1991. "Acquiescence and Recency Response-Order Effects in Interview Surveys," Sociological Methods & Research, , vol. 20(1), pages 60-103, August.
- Denise Bijlenga & Gouke J. Bonsel & Erwin Birnie, 2011. "Eliciting willingness to pay in obstetrics: comparing a direct and an indirect valuation method for complex health outcomes," Health Economics, John Wiley & Sons, Ltd., vol. 20(11), pages 1392-1406, November.
- Hermann DÃ¼lmer, 2007. "Experimental Plans in Factorial Surveys," Sociological Methods & Research, , vol. 35(3), pages 382-409, February.
- Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D., 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, September.
- Joop J. Hox & Ita G. G. Kreft & Piet L. J. Hermkens, 1991. "The Analysis of Factorial Surveys," Sociological Methods & Research, , vol. 19(4), pages 493-510, May.
- Sauer, Carsten & Liebig, Stefan & Auspurg, Katrin & Hinz, Thomas & Donaubauer, Andy & Schupp, Jürgen, 2009. "A Factorial Survey on the Justice of Earnings within the SOEP-Pretest 2008," IZA Discussion Papers 4663, Institute for the Study of Labor (IZA).
- Carsten Sauer & Stefan Liebig & Katrin Auspurg & Thomas Hinz & Andy Donaubauer & Jürgen Schupp, 2009. "A Factorial Survey on the Justice of Earnings within the SOEP-Pretest 2008," SOEPpapers on Multidisciplinary Panel Data Research 238, DIW Berlin, The German Socio-Economic Panel (SOEP).
- Scott, Anthony & Vick, Sandra, 1999. "Patients, Doctors and Contracts: An Application of Principal-Agent Theory to the Doctor-Patient Relationship," Scottish Journal of Political Economy, Scottish Economic Society, vol. 46(2), pages 111-134, May.
- Shelley Farrar & Mandy Ryan, 1999. "Response-ordering effects: a methodological issue in conjoint analysis," Health Economics, John Wiley & Sons, Ltd., vol. 8(1), pages 75-79.
- Trine Kjær & Mickael Bech & Dorte Gyrd-Hansen & Kristian Hart-Hansen, 2006. "Ordering effect and price sensitivity in discrete choice experiments: need we worry?," Health Economics, John Wiley & Sons, Ltd., vol. 15(11), pages 1217-1228. Full references (including those not matched with items on IDEAS)
When requesting a correction, please mention this item's handle: RePEc:ese:iserwp:2012-01. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jonathan Nears)
If references are entirely missing, you can add them using this form.