IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/akqhn.html
   My bibliography  Save this paper

Using Massive Online Choice Experiments to Measure Changes in Well-being

Author

Listed:
  • Brynjolfsson, Erik
  • Collis, Avinash
  • Eggers, Felix

Abstract

GDP and derived metrics such as productivity have been central to our understanding of economic progress and well-being. In principle, changes in consumer surplus provide a superior, and more direct, measure of changes in well-being, especially for digital goods. In practice, these alternatives have been difficult to quantify. We explore the potential of massive online choice experiments to measure consumer surplus. We illustrate this technique via several empirical examples which quantify the valuations of popular digital goods and categories. Our examples include incentive compatible discrete choice experiments where online and lab participants receive monetary compensation if and only if they forgo goods for pre-defined periods. For example, the median user needed a compensation of about $48 to forgo Facebook for one month. Our overall analyses reveal that digital goods have created large gains in well-being that are not reflected in conventional measures of GDP and productivity. By periodically querying a large, representative sample of goods and services, including those which are not priced in existing markets, changes in consumer surplus and other new measures of well-being derived from these online choice experiments have the potential for providing cost-effective supplements to the existing National Income and Product Accounts.

Suggested Citation

  • Brynjolfsson, Erik & Collis, Avinash & Eggers, Felix, 2019. "Using Massive Online Choice Experiments to Measure Changes in Well-being," OSF Preprints akqhn, Center for Open Science.
  • Handle: RePEc:osf:osfxxx:akqhn
    DOI: 10.31219/osf.io/akqhn
    as

    Download full text from publisher

    File URL: https://osf.io/download/5c94ea50b2396800171870cd/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/akqhn?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Greenstein, Shane & McDevitt, Ryan C., 2011. "The broadband bonus: Estimating broadband Internet's economic value," Telecommunications Policy, Elsevier, vol. 35(7), pages 617-632, August.
    2. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    3. Flynn, Terry N. & Louviere, Jordan J. & Peters, Tim J. & Coast, Joanna, 2007. "Best-worst scaling: What it can do for health care research and how to do it," Journal of Health Economics, Elsevier, vol. 26(1), pages 171-189, January.
    4. Nevo, Aviv, 2001. "Measuring Market Power in the Ready-to-Eat Cereal Industry," Econometrica, Econometric Society, vol. 69(2), pages 307-342, March.
    5. Jerry A. Hausman, 1996. "Valuation of New Goods under Perfect and Imperfect Competition," NBER Chapters, in: The Economics of New Goods, pages 207-248, National Bureau of Economic Research, Inc.
    6. Richard Schmalensee, 1978. "Entry Deterrence in the Ready-to-Eat Breakfast Cereal Industry," Bell Journal of Economics, The RAND Corporation, vol. 9(2), pages 305-327, Autumn.
    7. Richard Carson & Robert Mitchell & Michael Hanemann & Raymond Kopp & Stanley Presser & Paul Ruud, 2003. "Contingent Valuation and Lost Passive Use: Damages from the Exxon Valdez Oil Spill," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 25(3), pages 257-286, July.
    8. David M. Byrne & John G. Fernald & Marshall B. Reinsdorf, 2016. "Does the United States Have a Productivity Slowdown or a Measurement Problem?," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 47(1 (Spring), pages 109-182.
    9. Austan Goolsbee & Peter J. Klenow, 2006. "Valuing Consumer Products by the Time Spent Using Them: An Application to the Internet," American Economic Review, American Economic Association, vol. 96(2), pages 108-113, May.
    10. Timothy C. Haab & Matthew G. Interis & Daniel R. Petrolia & John C. Whitehead, 2013. "From Hopeless to Curious? Thoughts on Hausman's "Dubious to Hopeless" Critique of Contingent Valuation," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 35(4), pages 593-612.
    11. Min Ding & Rajdeep Grewal & John Liechty, 2005. "Incentive-aligned conjoint analysis," Framed Field Experiments 00139, The Field Experiments Website.
    12. John C. Whitehead, 2002. "Incentive Incompatibility and Starting-Point Bias in Iterative Valuation Questions," Land Economics, University of Wisconsin Press, vol. 78(2), pages 285-297.
    13. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    14. Dan Ariely & George Loewenstein & Drazen Prelec, 2003. ""Coherent Arbitrariness": Stable Demand Curves Without Stable Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 73-106.
    15. Richard T. Carson & Theodore Groves & John A. List, 2014. "Consequentiality: A Theoretical and Experimental Exploration of a Single Binary Choice," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 1(1), pages 171-207.
    16. Erik Brynjolfsson & Daniel Rock & Chad Syverson, 2018. "Artificial Intelligence and the Modern Productivity Paradox: A Clash of Expectations and Statistics," NBER Chapters, in: The Economics of Artificial Intelligence: An Agenda, pages 23-57, National Bureau of Economic Research, Inc.
    17. Kahneman, Daniel & Knetsch, Jack L & Thaler, Richard H, 1990. "Experimental Tests of the Endowment Effect and the Coase Theorem," Journal of Political Economy, University of Chicago Press, vol. 98(6), pages 1325-1348, December.
    18. Daniel Kahneman & Jack L. Knetsch & Richard H. Thaler, 1991. "Anomalies: The Endowment Effect, Loss Aversion, and Status Quo Bias," Journal of Economic Perspectives, American Economic Association, vol. 5(1), pages 193-206, Winter.
    19. Chad Syverson, 2017. "Challenges to Mismeasurement Explanations for the US Productivity Slowdown," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 165-186, Spring.
    20. Jeremy Greenwood & Karen A. Kopecky, 2013. "Measuring The Welfare Gain From Personal Computers," Economic Inquiry, Western Economic Association International, vol. 51(1), pages 336-347, January.
    21. Dale W. Jorgenson & Daniel T. Slesnick, 2014. "Measuring Social Welfare in the U.S. National Accounts," NBER Chapters, in: Measuring Economic Sustainability and Progress, pages 43-88, National Bureau of Economic Research, Inc.
    22. Michael Spence & Bruce Owen, 1977. "Television Programming, Monopolistic Competition, and Welfare," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 91(1), pages 103-126.
    23. Office of Health Economics, 2007. "The Economics of Health Care," For School 001490, Office of Health Economics.
    24. Kuznets, Simon, 1973. "Modern Economic Growth: Findings and Reflections," American Economic Review, American Economic Association, vol. 63(3), pages 247-258, June.
    25. Joel Waldfogel, 2012. "Copyright Protection, Technological Change, and the Quality of New Products: Evidence from Recorded Music since Napster," Journal of Law and Economics, University of Chicago Press, vol. 55(4), pages 715-740.
    26. Hanemann, W Michael, 1991. "Willingness to Pay and Willingness to Accept: How Much Can They Differ?," American Economic Review, American Economic Association, vol. 81(3), pages 635-647, June.
    27. Jim Giles, 2005. "Internet encyclopaedias go head to head," Nature, Nature, vol. 438(7070), pages 900-901, December.
    28. Martin Feldstein, 2017. "Underestimating the Real Growth of GDP, Personal Income, and Productivity," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 145-164, Spring.
    29. Charles I. Jones & Peter J. Klenow, 2016. "Beyond GDP? Welfare across Countries and Time," American Economic Review, American Economic Association, vol. 106(9), pages 2426-2457, September.
    30. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D. With contributions by-Name:Adamowicz,Wiktor, 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, October.
    31. Dale W. Jorgenson & J. Steven Landefeld & Paul Schreyer, 2014. "Measuring Economic Sustainability and Progress," NBER Books, National Bureau of Economic Research, Inc, number jorg12-1.
    32. Richard T. Carson, 2012. "Contingent Valuation: A Practical Alternative When Prices Aren't Available," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 27-42, Fall.
    33. Winton Bates, 2009. "Gross national happiness," Asian-Pacific Economic Literature, The Crawford School, The Australian National University, vol. 23(2), pages 1-16, November.
    34. Charles R. Hulten, 1978. "Growth Accounting with Intermediate Inputs," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 45(3), pages 511-518.
    35. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    36. Bishop, Richard C. & Heberlein, Thomas A., 1979. "Measuring Values Of Extramarket Goods: Are Indirect Measures Biased?," 1979 Annual Meeting, July 29-August 1, Pullman, Washington 277818, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    37. Peter A. Diamond & Jerry A. Hausman, 1994. "Contingent Valuation: Is Some Number Better than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 8(4), pages 45-64, Fall.
    38. Jerry Hausman, 2012. "Contingent Valuation: From Dubious to Hopeless," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 43-56, Fall.
    39. Dale W. Jorgenson & J. Steven Landefeld & Paul Schreyer, 2014. "Introduction to "Measuring Economic Sustainability and Progress"," NBER Chapters, in: Measuring Economic Sustainability and Progress, pages 1-16, National Bureau of Economic Research, Inc.
    40. Richard T. Carson & Miko_aj Czajkowski, 2014. "The discrete choice experiment approach to environmental contingent valuation," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 9, pages 202-235, Edward Elgar Publishing.
    41. Richard C. Bishop & Thomas A. Heberlein, 1979. "Measuring Values of Extramarket Goods: Are Indirect Measures Biased?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 61(5), pages 926-930.
    42. Peter Cohen & Robert Hahn & Jonathan Hall & Steven Levitt & Robert Metcalfe, 2016. "Using Big Data to Estimate Consumer Surplus: The Case of Uber," NBER Working Papers 22627, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    2. Richard C. Bishop & Kevin J. Boyle, 2021. "On Adding-Up as a Validity Criterion for Stated-Preference Studies," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 80(3), pages 587-601, November.
    3. Basu, Amita & Srinivasan, Narayanan, 2021. "A Modified Contingent Valuation Method Shrinks Gain-Loss Asymmetry," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    4. Banzhaf, H. Spencer, 2016. "Constructing markets: environmental economics and the contingent valuation controversy," MPRA Paper 78814, University Library of Munich, Germany.
    5. John K. Horowitz & Kenneth E. McConnell & James J. Murphy, 2013. "Behavioral foundations of environmental economics and valuation," Chapters, in: John A. List & Michael K. Price (ed.), Handbook on Experimental Economics and the Environment, chapter 4, pages 115-156, Edward Elgar Publishing.
    6. Amoah, Anthony & Ferrini, Silvia & Schaafsma, Marije, 2019. "Electricity outages in Ghana: Are contingent valuation estimates valid?," Energy Policy, Elsevier, vol. 135(C).
    7. Baker, Rick & Ruting, Brad, 2014. "Environmental Policy Analysis: A Guide to Non‑Market Valuation," 2014 Conference (58th), February 4-7, 2014, Port Macquarie, Australia 165810, Australian Agricultural and Resource Economics Society.
    8. Richard C. Bishop & Kevin J. Boyle, 2019. "Reliability and Validity in Nonmarket Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 72(2), pages 559-582, February.
    9. Catherine L. Kling & Daniel J. Phaneuf & Jinhua Zhao, 2012. "From Exxon to BP: Has Some Number Become Better Than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 3-26, Fall.
    10. Richard T. Carson & Miko_aj Czajkowski, 2014. "The discrete choice experiment approach to environmental contingent valuation," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 9, pages 202-235, Edward Elgar Publishing.
    11. Helga Fehr-Duda & Robin Schimmelpfennig, 2018. "Wider die Zahlengläubigkeit: Sind Befragungsergebnisse eine gute Grundlage für wirtschaftspolitische Entscheidungen?," ECON - Working Papers 297, Department of Economics - University of Zurich, revised Dec 2018.
    12. Brynjolfsson, Erik & Collis, Avinash & Diewert, W. Erwin & Eggers, Felix & Fox, Kevin J., 2019. "GDP-B: Accounting for the Value of New and Free Goods in the Digital Economy," OSF Preprints sptfu, Center for Open Science.
    13. Charles R. Hulten & Leonard I. Nakamura, 2017. "Accounting for Growth in the Age of the Internet The Importance of Output-Saving Technical Change," Working Papers 17-24, Federal Reserve Bank of Philadelphia.
    14. Manuel Frondel & Stephan Sommer & Lukas Tomberg, 2021. "WTA-WTP Disparity: The Role of Perceived Realism of the Valuation Setting," Land Economics, University of Wisconsin Press, vol. 97(1), pages 196-206.
    15. Lopez-Becerra, E.I. & Alcon, F., 2021. "Social desirability bias in the environmental economic valuation: An inferred valuation approach," Ecological Economics, Elsevier, vol. 184(C).
    16. Felix Schläpfer, 2021. "Inadequate Standards in the Valuation of Public Goods and Ecosystem Services: Why Economists, Environmental Scientists and Policymakers Should Care," Sustainability, MDPI, vol. 13(1), pages 1-10, January.
    17. Pierre-Alexandre Mahieu & Henrik Andersson & Olivier Beaumais & Romain Crastes & François-Charles Wolff, 2014. "Is Choice Experiment Becoming more Popular than Contingent Valuation? A Systematic Review in Agriculture, Environment and Health," Working Papers 2014.12, FAERE - French Association of Environmental and Resource Economists.
    18. Svensson, Mikael, 2006. "The Value of a Statistical Life in Sweden Estimates from Two Studies using the "Certainty Approach" Calibration," Working Papers 2006:6, Örebro University, School of Business, revised 12 May 2009.
    19. Sawe, Nik, 2017. "Using neuroeconomics to understand environmental valuation," Ecological Economics, Elsevier, vol. 135(C), pages 1-9.
    20. Wainger, Lisa A. & Helcoski, Ryan & Farge, Kevin W. & Espinola, Brandy A. & Green, Gary T., 2018. "Evidence of a Shared Value for Nature," Ecological Economics, Elsevier, vol. 154(C), pages 107-116.

    More about this item

    JEL classification:

    • E01 - Macroeconomics and Monetary Economics - - General - - - Measurement and Data on National Income and Product Accounts and Wealth; Environmental Accounts
    • E16 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Social Accounting Matrix
    • O1 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development
    • O4 - Economic Development, Innovation, Technological Change, and Growth - - Economic Growth and Aggregate Productivity

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:akqhn. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.