IDEAS home Printed from https://ideas.repec.org/p/bdi/opques/qef_329_16.html
   My bibliography  Save this paper

Using external sources to understand sample survey bias: the case of the Invind survey

Author

Listed:
  • Leandro D�Aurizio

    (IVASS)

  • Giuseppina Papadia

    (Bank of Italy)

Abstract

We look at two sources of bias in survey estimates of the Bank of Italy�s Survey of Industrial and Services Firms conducted yearly on a panel of enterprises: 1) the bias owing to panel attrition caused by the differences between units entering and exiting the sample and those participating more regularly in the survey; 2) the bias created by delays in the distributional data on the reference population, needed for computing the survey weights. By comparing an array of performance indicators (available in an integrated database) for the firms regularly participating against those participating more erratically, we find that panel attrition has a limited effect on the official aggregate estimates, since they are determined by larger firms, which tend to participate regularly in the survey. Smaller firms� erratic participation, the comparatively worse performance of the units exiting the sample and the higher-than-average age of the firms in the sample call for a careful assessment of the estimates that are not influenced by firm size. Finally, for the less recent years we measure the extent to which the estimates vary if we use the revised information on the reference population, and we find that the delays in updating significantly bias the aggregate estimates only when the population size is highly unstable, with negligible effects on the estimates less dependent on firm size.

Suggested Citation

  • Leandro D�Aurizio & Giuseppina Papadia, 2016. "Using external sources to understand sample survey bias: the case of the Invind survey," Questioni di Economia e Finanza (Occasional Papers) 329, Bank of Italy, Economic Research and International Relations Area.
  • Handle: RePEc:bdi:opques:qef_329_16
    as

    Download full text from publisher

    File URL: https://www.bancaditalia.it/pubblicazioni/qef/2016-0329/QEF_329_16.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gary Solon & Steven J. Haider & Jeffrey M. Wooldridge, 2015. "What Are We Weighting For?," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 301-316.
    2. Ivan Faiella, 2010. "The use of survey weights in regression analysis," Temi di discussione (Economic working papers) 739, Bank of Italy, Economic Research and International Relations Area.
    3. Claudia Biancotti & Giovanni D'Alessio & Andrea Neri, 2004. "Errori di misura nell�indagine sui bilanci delle famiglie italiane," Temi di discussione (Economic working papers) 520, Bank of Italy, Economic Research and International Relations Area.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ehrmann, Michael & Ziegelmeyer, Michael, 2014. "Household Risk Management and Actual Mortgage Choice in the Euro Area," MEA discussion paper series 201406, Munich Center for the Economics of Aging (MEA) at the Max Planck Institute for Social Law and Social Policy.
    2. Ampudia, Miguel & Ehrmann, Michael, 2017. "Macroeconomic experiences and risk taking of euro area households," European Economic Review, Elsevier, vol. 91(C), pages 146-156.
    3. D’Aurizio Leandro & Papadia Giuseppina, 2019. "Using Administrative Data to Evaluate Sampling Bias in a Business Panel Survey," Journal of Official Statistics, Sciendo, vol. 35(1), pages 67-92, March.
    4. repec:mea:meawpa:14283 is not listed on IDEAS
    5. Sims, Katharine R.E. & Alix-Garcia, Jennifer M., 2017. "Parks versus PES: Evaluating direct and incentive-based land conservation in Mexico," Journal of Environmental Economics and Management, Elsevier, vol. 86(C), pages 8-28.
    6. Austin L. Wright, 2016. "Economic Shocks and Rebel," HiCN Working Papers 232, Households in Conflict Network.
    7. Marek Golinski & Dorota Baczkiewicz, 2021. "Analysis of Factors Influencing the Teamwork Competences of Managers Starting their Professional Career," European Research Studies Journal, European Research Studies Journal, vol. 0(Special 2), pages 64-76.
    8. repec:osf:osfxxx:sw6kd_v1 is not listed on IDEAS
    9. Wang, Huixia & Wang, Chenggang & Halliday, Timothy J., 2018. "Health and health inequality during the great recession: Evidence from the PSID," Economics & Human Biology, Elsevier, vol. 29(C), pages 17-30.
    10. Durlauf, Steven N. & Navarro, Salvador & Rivers, David A., 2016. "Model uncertainty and the effect of shall-issue right-to-carry laws on crime," European Economic Review, Elsevier, vol. 81(C), pages 32-67.
    11. Sharpe, Jamie & Bollinger, Christopher R., 2020. "Who competes with whom? Using occupation characteristics to estimate the impact of immigration on native wages," Labour Economics, Elsevier, vol. 66(C).
    12. Ilaria Natali & Mathias Dewatripont & Victor Ginsburgh & Michel Goldman & Patrick Legros, 2023. "Prescription opioids and economic hardship in France," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 24(9), pages 1473-1504, December.
    13. Guido Neidhöfer, 2019. "Intergenerational mobility and the rise and fall of inequality: Lessons from Latin America," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 17(4), pages 499-520, December.
    14. Terence C. Cheng & Pravin K. Trivedi, 2015. "Attrition Bias in Panel Data: A Sheep in Wolf's Clothing? A Case Study Based on the Mabel Survey," Health Economics, John Wiley & Sons, Ltd., vol. 24(9), pages 1101-1117, September.
    15. Janssens, C. & Van Den Broeck, G. & Maertens, M. & Lambrecht, I., 2018. "Mother s Non-Farm Entrepreneurship and Child Secondary Education in Rural Ghana," 2018 Conference, July 28-August 2, 2018, Vancouver, British Columbia 277038, International Association of Agricultural Economists.
    16. Glei, Dana A. & Weinstein, Maxine, 2023. "Economic distress, obesity, and the rise in pain," Social Science & Medicine, Elsevier, vol. 339(C).
    17. Bénédicte Apouey & Gabriel Picone, 2014. "Social Interactions And Malaria Preventive Behaviors In Sub‐Saharan Africa," Health Economics, John Wiley & Sons, Ltd., vol. 23(9), pages 994-1012, September.
    18. Kalbfuss, Jörg & Odermatt, Reto & Stutzer, Alois, 2024. "Medical marijuana laws and mental health in the United States," Health Economics, Policy and Law, Cambridge University Press, vol. 19(3), pages 307-322, July.
    19. Dimitrios Nikolaou & Laura M. Crispin, 2022. "Estimating the effects of sports and physical exercise on bullying," Contemporary Economic Policy, Western Economic Association International, vol. 40(2), pages 283-303, April.
    20. Eliasson, Kent & Hansson, Pär & Lindvert, Markus, 2018. "Decomposing value chains within Swedish multinationals," Working Papers 2018:9, Örebro University, School of Business.
    21. Sebastian Barfort & Nikolaj Harmon & Frederik Hjorth & Asmus Leth Olsen, 2015. "Dishonesty and Selection into Public Service in Denmark: Who Runs the World’s Least Corrupt Public Sector?," Discussion Papers 15-12, University of Copenhagen. Department of Economics.
    22. Asmussen, Katherine E. & Mondal, Aupal & Bhat, Chandra R., 2022. "Adoption of partially automated vehicle technology features and impacts on vehicle miles of travel (VMT)," Transportation Research Part A: Policy and Practice, Elsevier, vol. 158(C), pages 156-179.

    More about this item

    Keywords

    business sample surveys; panel surveys; attrition; external information; integration of multiple information sources.;
    All these keywords.

    JEL classification:

    • C82 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Macroeconomic Data; Data Access
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bdi:opques:qef_329_16. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/bdigvit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.