IDEAS home Printed from https://ideas.repec.org/a/spr/astaws/v10y2016i2d10.1007_s11943-016-0191-3.html
   My bibliography  Save this article

Big Data is a big deal but how much data do we need?
[Big Data gut und schön. Aber wie viel Data brauchen wir?]

Author

Listed:
  • Nikolaos Askitas

    (Institute for the Study of Labor)

Abstract

Those with a more conservative disposition might believe that Big Data is a short-lived fad and they may in fact be partially right. Others by contrast – especially those who dispassionately note that digitization is only now beginning to deliver its payload – may beg to differ. I argue that all things considered, Big Data will likely cease to exist, not so much because it is a fad but quite likely because all data will eventually be Big Data. In this essay, with the law of diminishing returns in the back of my mind, I use diverse examples, in an effort to shed some light on the question of “how much data do we really need”. My intend is not to exhaustively explore the answers so much as it is to provoke thought among the reader. I argue that depending on the use case both a data deficit and an abundance thereof may be counterproductive and that the various stakeholders, from lay persons and data experts to firms and the society at large, are probably faced with different, and possibly conflicting, optimization problems, whereby nothing will free us from having to continuously ponder on how much data is enough data. Finally the greatest challenges that data-intensive societies are likely to face might include positive reinforcement, feedback mechanisms and data endogeneity.

Suggested Citation

  • Nikolaos Askitas, 2016. "Big Data is a big deal but how much data do we need? [Big Data gut und schön. Aber wie viel Data brauchen wir?]," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 10(2), pages 113-125, October.
  • Handle: RePEc:spr:astaws:v:10:y:2016:i:2:d:10.1007_s11943-016-0191-3
    DOI: 10.1007/s11943-016-0191-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11943-016-0191-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11943-016-0191-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Nikolaos Askitas & Klaus F. Zimmermann, 2015. "The internet as a data source for advancement in social sciences," International Journal of Manpower, Emerald Group Publishing Limited, vol. 36(1), pages 2-12, April.
    2. Ron S. Kenett & Galit Shmueli, 2014. "On information quality," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 177(1), pages 3-38, January.
    3. Robert J. Shiller, 2015. "Irrational Exuberance," Economics Books, Princeton University Press, edition 3, number 10421.
    4. Jon Kleinberg & Jens Ludwig & Sendhil Mullainathan & Ziad Obermeyer, 2015. "Prediction Policy Problems," American Economic Review, American Economic Association, vol. 105(5), pages 491-495, May.
    5. Natalie Shlomo & Harvey Goldstein, 2015. "Editorial: Big data in social research," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(4), pages 787-790, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Engels, Barbara, 2016. "Big-Data-Analyse: Ein Einstieg für Ökonomen," IW-Kurzberichte 78.2016, Institut der deutschen Wirtschaft (IW) / German Economic Institute.
    2. Ralf Thomas Münnich & Markus Zwick, 2016. "Big Data und was nun? Neue Datenbestände und ihre Auswirkungen," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 10(2), pages 73-77, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daisuke Ikeda & Toan Phan & Timothy Sablik, 2020. "Asset Bubbles and Global Imbalances," Richmond Fed Economic Brief, Federal Reserve Bank of Richmond, vol. 20, pages 1-4, January.
    2. Joshua Schwartzstein & Adi Sunderam, 2021. "Using Models to Persuade," American Economic Review, American Economic Association, vol. 111(1), pages 276-323, January.
    3. Aiello, Francesco & Albanese, Giuseppe & Piselli, Paolo, 2019. "Good value for public money? The case of R&D policy," Journal of Policy Modeling, Elsevier, vol. 41(6), pages 1057-1076.
    4. Naguib, Costanza, 2019. "Estimating the Heterogeneous Impact of the Free Movement of Persons on Relative Wage Mobility," Economics Working Paper Series 1903, University of St. Gallen, School of Economics and Political Science.
    5. Nwaobi, Godwin, 2019. "University Postgraduate Research Programmes: Digitization(ICT),Innovations and Applications," MPRA Paper 96730, University Library of Munich, Germany.
    6. David Vidal-Tomás & Simone Alfarano, 2020. "An agent-based early warning indicator for financial market instability," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 15(1), pages 49-87, January.
    7. Erik Heilmann & Janosch Henze & Heike Wetzel, 2021. "Machine learning in energy forecasts with an application to high frequency electricity consumption data," MAGKS Papers on Economics 202135, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    8. Resce, Giuliano & Vaquero-Piñeiro, Cristina, 2022. "Predicting agri-food quality across space: A Machine Learning model for the acknowledgment of Geographical Indications," Food Policy, Elsevier, vol. 112(C).
    9. Edward L. Glaeser & Scott Duke Kominers & Michael Luca & Nikhil Naik, 2018. "Big Data And Big Cities: The Promises And Limitations Of Improved Measures Of Urban Life," Economic Inquiry, Western Economic Association International, vol. 56(1), pages 114-137, January.
    10. Tranos, Emmanouil & Incera, Andre Carrascal & Willis, George, 2022. "Using the web to predict regional trade flows: data extraction, modelling, and validation," OSF Preprints 9bu5z, Center for Open Science.
    11. Taner Akan & Tim Solle, 2022. "Do macroeconomic and financial governance matter? Evidence from Germany, 1950–2019," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 17(4), pages 993-1045, October.
    12. Bryan T. Kelly & Asaf Manela & Alan Moreira, 2019. "Text Selection," NBER Working Papers 26517, National Bureau of Economic Research, Inc.
    13. Shan Huang & Michael Allan Ribers & Hannes Ullrich, 2021. "The Value of Data for Prediction Policy Problems: Evidence from Antibiotic Prescribing," Discussion Papers of DIW Berlin 1939, DIW Berlin, German Institute for Economic Research.
    14. Pierpaolo D’Urso & Vincenzina Vitale, 2021. "Modeling Local BES Indicators by Copula-Based Bayesian Networks," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 153(3), pages 823-847, February.
    15. Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2020. "Optimal data collection for randomized control trials [Microcredit impacts: Evidence from a randomized microcredit program placement experiment by Compartamos Banco]," The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 1-31.
    16. Alan Randall, 2022. "Driving with Eyes on the Rear-View Mirror—Why Weak Sustainability Is Not Enough," Sustainability, MDPI, vol. 14(16), pages 1-13, August.
    17. Resce, Giuliano, 2022. "The impact of political and non-political officials on the financial management of local governments," Journal of Policy Modeling, Elsevier, vol. 44(5), pages 943-962.
    18. Jesús Fernández-Villaverde & Oren Levintal, 2024. "The Distributional Effects of Asset Returns," NBER Working Papers 32182, National Bureau of Economic Research, Inc.
    19. Delogu, Marco & Lagravinese, Raffaele & Paolini, Dimitri & Resce, Giuliano, 2024. "Predicting dropout from higher education: Evidence from Italy," Economic Modelling, Elsevier, vol. 130(C).
    20. Cortés, Kristle & Duchin, Ran & Sosyura, Denis, 2016. "Clouded judgment: The role of sentiment in credit origination," Journal of Financial Economics, Elsevier, vol. 121(2), pages 392-413.

    More about this item

    Keywords

    Big Data; Endogeneity; Social science; Causality; Prediction;
    All these keywords.

    JEL classification:

    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:astaws:v:10:y:2016:i:2:d:10.1007_s11943-016-0191-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.