IDEAS home Printed from https://ideas.repec.org/a/kap/enreec/v81y2022i4d10.1007_s10640-022-00654-5.html
   My bibliography  Save this article

Ponderous, Proficient or Professional? Survey Experience and Smartphone Effects in Stated Preference Research

Author

Listed:
  • Erlend Dancke Sandorf

    (Norwegian University of Life Sciences)

  • Kristine Grimsrud

    (Research Department, Statistics Norway)

  • Henrik Lindhjem

    (Menon Centre for Environmental and Resource Economics
    Norwegian Institute for Nature Research (NINA))

Abstract

Stated preference surveys are increasingly conducted online using internet panel samples, where a fast-growing share of respondents answer on smartphones. These panel members range from novices to “professionals” in terms of previous survey experience. Little is known about the potential effects of smartphone responding and survey experience on the data quality of stated preference surveys. This paper uses a discrete choice experiment dataset on the Norwegian population’s willingness to pay to plant climate forests to explore how these two factors affect data quality. These data by type of response device, gathered using a probability-based internet panel, were combined with a unique dataset obtained from the survey company on respondents’ actual experience answering surveys on different types of devices. Our results show that differences in elicited preferences between smartphone and computer respondents are not caused by the device used, suggesting that initial concerns about smartphone responses may be exaggerated. Furthermore, more experience is associated with an increasing scale parameter (indicating lower error variance), but at a decreasing rate; and a higher propensity to choose the status quo (indicating possible simplifying strategies employed by respondents). Combined this suggest some optimal level of experience that is neither too high nor too low. We discuss the implications of our results for stated preference research and provide a few avenues for future research.

Suggested Citation

  • Erlend Dancke Sandorf & Kristine Grimsrud & Henrik Lindhjem, 2022. "Ponderous, Proficient or Professional? Survey Experience and Smartphone Effects in Stated Preference Research," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 81(4), pages 807-832, April.
    • Handle: RePEc:kap:enreec:v:81:y:2022:i:4:d:10.1007_s10640-022-00654-5
    DOI: 10.1007/s10640-022-00654-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10640-022-00654-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10640-022-00654-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Joshua Angrist & Pierre Azoulay & Glenn Ellison & Ryan Hill & Susan Feng Lu, 2017. "Economic Research Evolves: Fields and Styles," American Economic Review, American Economic Association, vol. 107(5), pages 293-297, May.
    2. Hausman, Jerry & McFadden, Daniel, 1984. "Specification Tests for the Multinomial Logit Model," Econometrica, Econometric Society, vol. 52(5), pages 1219-1240, September.
    3. Grimsrud, Kristine & Graesse, Maximo & Lindhjem, Henrik, 2020. "Using the generalised Q method in ecological economics: A better way to capture representative values and perspectives in ecosystem service management," Ecological Economics, Elsevier, vol. 170(C).
    4. Tobias Börger, 2016. "Are Fast Responses More Random? Testing the Effect of Response Time on Scale in an Online Choice Experiment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 65(2), pages 389-413, October.
    5. Sandorf, Erlend Dancke & Aanesen, Margrethe & Navrud, Ståle, 2016. "Valuing unfamiliar and complex environmental goods: A comparison of valuation workshops and internet panel surveys with videos," Ecological Economics, Elsevier, vol. 129(C), pages 50-61.
    6. Liebe, Ulf & Glenk, Klaus & Oehlmann, Malte & Meyerhoff, Jürgen, 2015. "Does the use of mobile devices (tablets and smartphones) affect survey quality and choice behaviour in web surveys?," Journal of choice modelling, Elsevier, vol. 14(C), pages 17-31.
    7. Danny Campbell & Morten Raun Mørkbak & Søren Bøye Olsen, 2017. "Response time in online stated choice experiments: the non-triviality of identifying fast and slow respondents," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 6(1), pages 17-35, January.
    8. Greene, William H. & Hensher, David A., 2003. "A latent class model for discrete choice analysis: contrasts with mixed logit," Transportation Research Part B: Methodological, Elsevier, vol. 37(8), pages 681-698, September.
    9. Sandorf, Erlend Dancke & Persson, Lars & Broberg, Thomas, 2020. "Using an integrated choice and latent variable model to understand the impact of “professional” respondents in a stated preference survey," Resource and Energy Economics, Elsevier, vol. 61(C).
    10. Erlend Dancke Sandorf, 2019. "Did You Miss Something? Inattentive Respondents in Discrete Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(4), pages 1197-1235, August.
    11. Kube, Roland & Löschel, Andreas & Mertens, Henrik & Requate, Till, 2018. "Research trends in environmental and resource economics: Insights from four decades of JEEM," Journal of Environmental Economics and Management, Elsevier, vol. 92(C), pages 433-464.
    12. Kevin J. Boyle & Mark Morrison & Darla Hatton MacDonald & Roderick Duncan & John Rose, 2016. "Investigating Internet and Mail Implementation of Stated-Preference Surveys While Controlling for Differences in Sample Frames," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 64(3), pages 401-419, July.
    13. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    14. Søren Olsen, 2009. "Choosing Between Internet and Mail Survey Modes for Choice Experiment Surveys Considering Non-Market Goods," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 44(4), pages 591-610, December.
    15. Skeie, Magnus Aa. & Lindhjem, Henrik & Skjeflo, Sofie & Navrud, Ståle, 2019. "Smartphone and tablet effects in contingent valuation web surveys – No reason to worry?," Ecological Economics, Elsevier, vol. 165(C), pages 1-1.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Askill H. Halse & Stefan Flügel & Marco Kouwenhoven & Gerard Jong & Hanne B. Sundfør & Nina Hulleberg & Guri N. Jordbakke & Henrik Lindhjem, 2023. "A minute of your time: The impact of survey recruitment method and interview location on the value of travel time," Transportation, Springer, vol. 50(5), pages 1553-1584, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Skeie, Magnus Aa. & Lindhjem, Henrik & Skjeflo, Sofie & Navrud, Ståle, 2019. "Smartphone and tablet effects in contingent valuation web surveys – No reason to worry?," Ecological Economics, Elsevier, vol. 165(C), pages 1-1.
    2. Dugstad, Anders & Grimsrud, Kristine & Kipperberg, Gorm & Lindhjem, Henrik & Navrud, Ståle, 2020. "Acceptance of wind power development and exposure – Not-in-anybody's-backyard," Energy Policy, Elsevier, vol. 147(C).
    3. Chèze, Benoît & David, Maia & Martinet, Vincent, 2020. "Understanding farmers' reluctance to reduce pesticide use: A choice experiment," Ecological Economics, Elsevier, vol. 167(C).
    4. Cécile Hérivaux & Philippe Le Coent, 2021. "Introducing Nature into Cities or Preserving Existing Peri-Urban Ecosystems? Analysis of Preferences in a Rapidly Urbanizing Catchment," Sustainability, MDPI, vol. 13(2), pages 1-34, January.
    5. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    6. Anders Dugstad & Kristine Grimsrud & Gorm Kipperberg & Henrik Lindhjem & Ståle Navrud, 2020. "Acceptance of national wind power development and exposure. A case-control choice experiment approach," Discussion Papers 933, Statistics Norway, Research Department.
    7. Kolstoe, Sonja & Naald, Brian Vander & Cohan, Alison, 2022. "A tale of two samples: Understanding WTP differences in the age of social media," Ecosystem Services, Elsevier, vol. 55(C).
    8. Liebe, Ulf & Glenk, Klaus & von Meyer-Höfer, Marie & Spiller, Achim, 2019. "A web survey application of real choice experiments," Journal of choice modelling, Elsevier, vol. 33(C).
    9. Anders Dugstad & Kristine M. Grimsrud & Gorm Kipperberg & Henrik Lindhjem & Ståle Navrud, 2021. "Scope Elasticity of Willingness to pay in Discrete Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 80(1), pages 21-57, September.
    10. Kaitlynn Sandstrom‐Mistry & Frank Lupi & Hyunjung Kim & Joseph A. Herriges, 2023. "Comparing water quality valuation across probability and non‐probability samples," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 45(2), pages 744-761, June.
    11. Askill H. Halse & Stefan Flügel & Marco Kouwenhoven & Gerard Jong & Hanne B. Sundfør & Nina Hulleberg & Guri N. Jordbakke & Henrik Lindhjem, 2023. "A minute of your time: The impact of survey recruitment method and interview location on the value of travel time," Transportation, Springer, vol. 50(5), pages 1553-1584, October.
    12. Seojeong Oh & Benjamin M. Gramig, 2023. "Valuing Ecosystem Services and Downstream Water Quality Improvement in the U.S. Corn Belt," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 85(3), pages 823-872, August.
    13. David Boto-García & Petr Mariel & José Baños Pino & Antonio Alvarez, 2022. "Tourists’ willingness to pay for holiday trip characteristics: A Discrete Choice Experiment," Tourism Economics, , vol. 28(2), pages 349-370, March.
    14. Jed J. Cohen & Johannes Reichl, 2022. "Comparing Internet and phone survey mode effects across countries and research contexts," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(1), pages 44-71, January.
    15. William F. Vásquez & Jennifer M. Trudeau & Jessica Alicea‐Planas, 2021. "Immediate and informative feedback during a pandemic: Using stated preference analysis to predict vaccine uptake rates," Health Economics, John Wiley & Sons, Ltd., vol. 30(12), pages 3123-3137, December.
    16. Daniel A. Brent & Lata Gangadharan & Anke D. Leroux & Paul A. Raschky, 2022. "Reducing bias in preference elicitation for environmental public goods," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(2), pages 280-308, April.
    17. Rambonilaza, Tina & Kerouaz, Fathallah, 2023. "Valuing harvest regulation changes in recreational fisheries with a discrete choice experiment study: What can we learn from a synthetic review?," Economic Analysis and Policy, Elsevier, vol. 79(C), pages 40-54.
    18. Grilli, Gaetano & Andrews, Barnaby & Ferrini, Silvia & Luisetti, Tiziana, 2022. "Could a mix of short- and long-term policies be the solution to tackle marine litter? Insights from a choice experiment in England and Ireland," Ecological Economics, Elsevier, vol. 201(C).
    19. Ruokamo, Enni & Kopsakangas-Savolainen, Maria & Meriläinen, Teemu & Svento, Rauli, 2019. "Towards flexible energy demand – Preferences for dynamic contracts, services and emissions reductions," Energy Economics, Elsevier, vol. 84(C).
    20. Marianne Lefebvre & Masha Maslianskaia Pautrel & Pauline Laille, 2018. "Public preferences for pesticide-free urban green spaces: a socio-economic survey [Acceptation du "Zéro-pesticides" dans les espaces publics : Étude socio-économique]," Working Papers hal-02519184, HAL.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:enreec:v:81:y:2022:i:4:d:10.1007_s10640-022-00654-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.