IDEAS home Printed from
   My bibliography  Save this paper

First equals most important? Order effects in vignette-based measurement


  • Auspurg, Katrin
  • Jäckle, Annette


A vignette typically describes a hypothetical situation or object which respondents are asked to judge. The object is described as having different dimensions, the values of which are experimentally varied, so that their impact on respondents’ judgments can be estimated. We examine 1) whether the order in which dimensions are presented impacts estimates, and 2) under which conditions order effects are mostly likely. Using data from a web survey of students we analyze several possible conditions features of the vignette design, characteristics of respondents, and interactions between these. Our results show that strong order effects can occur, but only when the vignettes are complex.

Suggested Citation

  • Auspurg, Katrin & Jäckle, Annette, 2012. "First equals most important? Order effects in vignette-based measurement," ISER Working Paper Series 2012-01, Institute for Social and Economic Research.
  • Handle: RePEc:ese:iserwp:2012-01

    Download full text from publisher

    File URL:
    Download Restriction: no

    References listed on IDEAS

    1. Sauer, Carsten & Liebig, Stefan & Auspurg, Katrin & Hinz, Thomas & Donaubauer, Andy & Schupp, Jürgen, 2009. "A Factorial Survey on the Justice of Earnings within the SOEP-Pretest 2008," IZA Discussion Papers 4663, Institute for the Study of Labor (IZA).
    2. Scott, Anthony & Vick, Sandra, 1999. "Patients, Doctors and Contracts: An Application of Principal-Agent Theory to the Doctor-Patient Relationship," Scottish Journal of Political Economy, Scottish Economic Society, vol. 46(2), pages 111-134, May.
    3. McKEE J. McCLENDON, 1991. "Acquiescence and Recency Response-Order Effects in Interview Surveys," Sociological Methods & Research, , vol. 20(1), pages 60-103, August.
    4. Denise Bijlenga & Gouke J. Bonsel & Erwin Birnie, 2011. "Eliciting willingness to pay in obstetrics: comparing a direct and an indirect valuation method for complex health outcomes," Health Economics, John Wiley & Sons, Ltd., vol. 20(11), pages 1392-1406, November.
    5. Shelley Farrar & Mandy Ryan, 1999. "Response-ordering effects: a methodological issue in conjoint analysis," Health Economics, John Wiley & Sons, Ltd., vol. 8(1), pages 75-79.
    6. Trine Kjær & Mickael Bech & Dorte Gyrd-Hansen & Kristian Hart-Hansen, 2006. "Ordering effect and price sensitivity in discrete choice experiments: need we worry?," Health Economics, John Wiley & Sons, Ltd., vol. 15(11), pages 1217-1228.
    7. Hermann Dülmer, 2007. "Experimental Plans in Factorial Surveys," Sociological Methods & Research, , vol. 35(3), pages 382-409, February.
    8. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D. With contributions by-Name:Adamowicz,Wiktor, 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, March.
    9. Joop J. Hox & Ita G. G. Kreft & Piet L. J. Hermkens, 1991. "The Analysis of Factorial Surveys," Sociological Methods & Research, , vol. 19(4), pages 493-510, May.
    10. Borghans, Lex & Romans, Margo & Sauermann, Jan, 2010. "What makes a good conference? Analysing the preferences of labour economists," Labour Economics, Elsevier, vol. 17(5), pages 868-874, October.
    Full references (including those not matched with items on IDEAS)

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:


    Access and download statistics


    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ese:iserwp:2012-01. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jonathan Nears). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.