IDEAS home Printed from https://ideas.repec.org/p/bol/bodewp/wp1227.html

Benchmark-Guided Sample Construction from Non-Probability Firm Databases

Author

Listed:
  • Silvia Sarpietro
  • Tommaso Sonno

Abstract

Commercial firm-level databases are not probability samples, and their selective coverage can distort estimates of unconditional population objects such as aggregate productivity and firm-size distributions. At the same time, researchers may want to work with a smaller analytical sample because the full database is costly to process or uneven in data quality. This paper proposes a benchmark-guided stratified subset-selection algorithm for this setting. Given a target sample size and official cell-level aggregate statistics, the method selects firms so that the retained sample matches official sector-by-size cell counts and aligns within-cell benchmark moments. The selected sample is then adjusted using mild post-stratification weights. The algorithm can be viewed as a sparse, design stage analogue of calibration. We evaluate the method using Italian manufacturing firms from Orbis in 2022, with OECD Structural Business Statistics as external benchmarks. In the raw Orbis pool, cell-weighted turnover per employee is overstated by about 14%. The proposed algorithm reduces this distortion to about 5% and produces near-uniform final weights, while post-stratification alone leaves the distortion essentially unchanged. Full-pool calibration reproduces the moments it constrains, but in this application it performs less well on non-targeted functionals, and bounded cell-level calibration becomes infeasible in many cells under finer stratifications. The results show that benchmark-guided subset selection can complement weighting-based corrections when researchers work with large non-probability firm databases and want a smaller sample aligned with official aggregate statistics.

Suggested Citation

  • Silvia Sarpietro & Tommaso Sonno, 2026. "Benchmark-Guided Sample Construction from Non-Probability Firm Databases," Working Papers wp1227, Dipartimento Scienze Economiche, Universita' di Bologna.
  • Handle: RePEc:bol:bodewp:wp1227
    as

    Download full text from publisher

    File URL: http://amsacta.unibo.it/9061/1/WP1227.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Şebnem Kalemli- Özcan & Bent E. Sørensen & Carolina Villegas-Sanchez & Vadym Volosovych & Sevcan Yeşiltaş, 2024. "How to Construct Nationally Representative Firm-Level Data from the Orbis Global Database: New Facts on SMEs and Aggregate Implications for Industry Concentration," American Economic Journal: Macroeconomics, American Economic Association, vol. 16(2), pages 353-374, April.
    2. Hainmueller, Jens, 2012. "Entropy Balancing for Causal Effects: A Multivariate Reweighting Method to Produce Balanced Samples in Observational Studies," Political Analysis, Cambridge University Press, vol. 20(1), pages 25-46, January.
    3. Jan De Loecker & Jan Eeckhout & Gabriel Unger, 2020. "The Rise of Market Power and the Macroeconomic Implications [“Econometric Tools for Analyzing Market Outcomes”]," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(2), pages 561-644.
    4. Judith K. Hellerstein & Guido W. Imbens, 1999. "Imposing Moment Restrictions From Auxiliary Data By Weighting," The Review of Economics and Statistics, MIT Press, vol. 81(1), pages 1-14, February.
    5. Jean-Claude Deville & Yves Tille, 2004. "Efficient balanced sampling: The cube method," Biometrika, Biometrika Trust, vol. 91(4), pages 893-912, December.
    6. Yilin Chen & Pengfei Li & Changbao Wu, 2020. "Doubly Robust Inference With Nonprobability Survey Samples," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(532), pages 2011-2021, December.
    7. Jae Kwang Kim & Seho Park & Yilin Chen & Changbao Wu, 2021. "Combining non‐probability and probability survey samples through mass imputation," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(3), pages 941-963, July.
    8. Rui Chen & Guanhua Chen & Menggang Yu, 2023. "Entropy balancing for causal generalization with target sample summary information," Biometrics, The International Biometric Society, vol. 79(4), pages 3179-3190, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hengfang Wang & Jae Kwang Kim, 2025. "Information projection approach to smoothed propensity score weighting for handling selection bias under missing at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 77(1), pages 127-153, February.
    2. Ufuk Akcigit & Sina T. Ates, 2023. "What Happened to US Business Dynamism?," Journal of Political Economy, University of Chicago Press, vol. 131(8), pages 2059-2124.
    3. Pedro H. C. Sant'Anna & Xiaojun Song & Qi Xu, 2022. "Covariate distribution balance via propensity scores," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1093-1120, September.
    4. Sixia Chen & Alexandra May Woodruff & Janis Campbell & Sara Vesely & Zheng Xu & Cuyler Snider, 2023. "Combining Probability and Nonprobability Samples by Using Multivariate Mass Imputation Approaches with Application to Biomedical Research," Stats, MDPI, vol. 6(2), pages 1-9, May.
    5. Li, Jay Y. & Tang, Dragon Yongjun, 2022. "Product market competition with CDS," Journal of Corporate Finance, Elsevier, vol. 73(C).
    6. Philippon, Thomas & Gutierrez, German, 2018. "How EU Markets Became More Competitive Than US Markets: A Study of Institutional Drift," CEPR Discussion Papers 12983, Centre for Economic Policy Research.
    7. Ieva Burakauskaitė & Andrius Čiginas, 2023. "An Approach to Integrating a Non-Probability Sample in the Population Census," Mathematics, MDPI, vol. 11(8), pages 1-14, April.
    8. Ha, Sangeun & Ma, Fangyuan & Žaldokas, Alminas, 2024. "Motivating collusion," Journal of Financial Economics, Elsevier, vol. 154(C).
    9. Matej Bajgar & Giuseppe Berlingieri & Sara Calligaris & Chiara Criscuolo & Jonathan Timmis, 2025. "Industry concentration in Europe and North America," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 34(3), pages 407-424.
    10. Caggese, Andrea & Chiavari, Andrea & Goraya, Sampreet & Villegas‑Sanchez, Carolina, 2025. "Climate change, firms and aggregate productivity," Research Bulletin, European Central Bank, vol. 132.
    11. Liu, Huilong & Wang, Yifei & Xie, Jing & Yin, Jun, 2026. "Judicial independence and firms’ labor share: Evidence from a quasi-natural experiment in China," Journal of Asian Economics, Elsevier, vol. 102(C).
    12. Alexander G. Nikolaev & Sheldon H. Jacobson & Wendy K. Tam Cho & Jason J. Sauppe & Edward C. Sewell, 2013. "Balance Optimization Subset Selection (BOSS): An Alternative Approach for Causal Inference with Observational Data," Operations Research, INFORMS, vol. 61(2), pages 398-412, April.
    13. Ferrando, Annalisa & McAdam, Peter & Petroulakis, Filippos & Vives, Xavier, 2021. "Product market structure and monetary policy: evidence from the Euro Area," Working Paper Series 2632, European Central Bank.
    14. Villegas-Sanchez, Carolina & Díez, Federico & Fan, Jiayue, 2019. "Global Declining Competition," CEPR Discussion Papers 13696, Centre for Economic Policy Research.
    15. Matias Covarrubias & Germán Gutiérrez & Thomas Philippon, 2019. "From Good to Bad Concentration? US Industries over the Past 30 Years," NBER Chapters, in: NBER Macroeconomics Annual 2019, volume 34, pages 1-46, National Bureau of Economic Research, Inc.
    16. Kwun Chuen Gary Chan & Sheung Chi Phillip Yam & Zheng Zhang, 2016. "Globally efficient non-parametric inference of average treatment effects by empirical balancing calibration weighting," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(3), pages 673-700, June.
    17. Damioli, Giacomo & Van Roy, Vincent & Vertesy, Daniel & Vivarelli, Marco, 2024. "Is Artificial Intelligence Generating a New Paradigm? Evidence from the Emerging Phase," IZA Discussion Papers 17183, IZA Network @ LISER.
    18. Damioli, Giacomo & Van Roy, Vincent & Vertesy, Daniel & Vivarelli, Marco, 2025. "Is artificial intelligence leading to a new technological paradigm?," Structural Change and Economic Dynamics, Elsevier, vol. 72(C), pages 347-359.
    19. Chien-Min Huang & F. Jay Breidt, 2023. "A dual-frame approach for estimation with respondent-driven samples," METRON, Springer;Sapienza Università di Roma, vol. 81(1), pages 65-81, April.

    More about this item

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bol:bodewp:wp1227. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dipartimento Scienze Economiche, Universita' di Bologna (email available below). General contact details of provider: https://edirc.repec.org/data/sebolit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.