First equals most important? Order effects in vignette-based measurement
A vignette typically describes a hypothetical situation or object which respondents are asked to judge. The object is described as having different dimensions, the values of which are experimentally varied, so that their impact on respondentsâ€™ judgments can be estimated. We examine 1) whether the order in which dimensions are presented impacts estimates, and 2) under which conditions order effects are mostly likely. Using data from a web survey of students we analyze several possible conditions features of the vignette design, characteristics of respondents, and interactions between these. Our results show that strong order effects can occur, but only when the vignettes are complex.
|Date of creation:||18 Jan 2012|
|Contact details of provider:|| Postal: Publications Office, Institute for Social and Economic Research, University of Essex, Wivenhoe Park, Colchester, Essex CO4 3SQ UK|
Web page: https://www.iser.essex.ac.uk/
More information through EDIRC
|Order Information:|| Postal: Publications Office, Institute for Social and Economic Research, University of Essex, Wivenhoe Park, Colchester, Essex CO4 3SQ UK|
Web: https://www.iser.essex.ac.uk/publications/ Email:
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Sauer, Carsten & Liebig, Stefan & Auspurg, Katrin & Hinz, Thomas & Donaubauer, Andy & Schupp, Jürgen, 2009.
"A Factorial Survey on the Justice of Earnings within the SOEP-Pretest 2008,"
IZA Discussion Papers
4663, Institute for the Study of Labor (IZA).
- Carsten Sauer & Stefan Liebig & Katrin Auspurg & Thomas Hinz & Andy Donaubauer & Jürgen Schupp, 2009. "A Factorial Survey on the Justice of Earnings within the SOEP-Pretest 2008," SOEPpapers on Multidisciplinary Panel Data Research 238, DIW Berlin, The German Socio-Economic Panel (SOEP).
- Borghans, Lex & Romans, Margo & Sauermann, Jan, 2010. "What makes a good conference? Analysing the preferences of labour economists," Labour Economics, Elsevier, vol. 17(5), pages 868-874, October.
- Borghans Lex & Romans Margo & Sauermann Jan, 2010. "What makes a good conference? Analysing the preferences of labor economists," Research Memorandum 020, Maastricht University, Maastricht Research School of Economics of Technology and Organization (METEOR).
- Borghans Lex & Romans Margo & Sauermann Jan, 2010. "What makes a good conference? Analysing the preferences of labour economists," ROA Research Memorandum 005, Maastricht University, Research Centre for Education and the Labour Market (ROA).
- Borghans, Lex & Romans, Margo & Sauermann, Jan, 2010. "What Makes a Good Conference? Analysing the Preferences of Labor Economists," IZA Discussion Papers 4870, Institute for the Study of Labor (IZA).
- Scott, Anthony & Vick, Sandra, 1999. "Patients, Doctors and Contracts: An Application of Principal-Agent Theory to the Doctor-Patient Relationship," Scottish Journal of Political Economy, Scottish Economic Society, vol. 46(2), pages 111-134, May.
- McKEE J. McCLENDON, 1991. "Acquiescence and Recency Response-Order Effects in Interview Surveys," Sociological Methods & Research, , vol. 20(1), pages 60-103, August.
- Denise Bijlenga & Gouke J. Bonsel & Erwin Birnie, 2011. "Eliciting willingness to pay in obstetrics: comparing a direct and an indirect valuation method for complex health outcomes," Health Economics, John Wiley & Sons, Ltd., vol. 20(11), pages 1392-1406, November.
- Shelley Farrar & Mandy Ryan, 1999. "Response-ordering effects: a methodological issue in conjoint analysis," Health Economics, John Wiley & Sons, Ltd., vol. 8(1), pages 75-79.
- Trine Kjær & Mickael Bech & Dorte Gyrd-Hansen & Kristian Hart-Hansen, 2006. "Ordering effect and price sensitivity in discrete choice experiments: need we worry?," Health Economics, John Wiley & Sons, Ltd., vol. 15(11), pages 1217-1228.
- Hermann DÃ¼lmer, 2007. "Experimental Plans in Factorial Surveys," Sociological Methods & Research, , vol. 35(3), pages 382-409, February.
- Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D., 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, February.
- Joop J. Hox & Ita G. G. Kreft & Piet L. J. Hermkens, 1991. "The Analysis of Factorial Surveys," Sociological Methods & Research, , vol. 19(4), pages 493-510, May. Full references (including those not matched with items on IDEAS)
When requesting a correction, please mention this item's handle: RePEc:ese:iserwp:2012-01. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jonathan Nears)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.