IDEAS home Printed from https://ideas.repec.org/p/trr/wpaper/201910.html
   My bibliography  Save this paper

A Generalized Calibration Approach Ensuring Coherent Estimates with Small Area Constraints

Author

Listed:
  • Jan Pablo Burgard
  • Ralf Münnich
  • Martin Rupp

Abstract

Within this article, a generalized calibration approach is presented, which provides coherent and efficient estimates considering a high number of constraints on different hierarchical levels. These constraints may be obtained from different sources such as survey data, register data, administrative data, or even other sources like big data derived using different estimation approaches, including small area techniques on different levels of interest. In order to incorporate a possible heterogeneous quality and the multitude of the constraints, a relaxation of selected constraints is proposed. In that regard, predefined tolerances are assigned to hardly achievable constraints, mostly at low aggregation levels, or sample estimates with non-negligible variances. In addition, the presented generalized calibration approach allows the use of box-constraints for the calibration weights in order to avoid an inappropriate high variation of the resulting weights. Furthermore, various penalty functions are presented in order to accommodate particular circumstances in applications. The proposed iterative algorithm provably finds the optimal solution and the numerical implementation is able to deal with a huge data base such as the set of all households in Germany. The performance is demonstrated in a short simulation study.

Suggested Citation

  • Jan Pablo Burgard & Ralf Münnich & Martin Rupp, 2019. "A Generalized Calibration Approach Ensuring Coherent Estimates with Small Area Constraints," Research Papers in Economics 2019-10, University of Trier, Department of Economics.
  • Handle: RePEc:trr:wpaper:201910
    as

    Download full text from publisher

    File URL: http://www.uni-trier.de/fileadmin/fb4/prof/VWL/EWF/Research_Papers/2019-10.pdf
    File Function: First version, 2019
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wu C. & Sitter R. R, 2001. "A Model-Calibration Approach to Using Complete Auxiliary Information From Survey Data," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 185-193, March.
    2. Jean-Francois Beaumont & Cynthia Bocci, 2008. "Another look at ridge calibration," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilità e Statistiche Applicate - University of Rome, vol. 0(1), pages 5-20.
    3. Nikos Tzavidis & Li‐Chun Zhang & Angela Luna & Timo Schmid & Natalia Rojas‐Perilla, 2018. "From start to finish: a framework for the production of small area official statistics," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(4), pages 927-979, October.
    4. Montanari, Giorgio E. & Ranalli, M. Giovanna, 2005. "Nonparametric Model Calibration Estimation in Survey Sampling," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1429-1442, December.
    5. J. Chen, 2002. "Using empirical likelihood methods to obtain range restricted weights in regression estimators for surveys," Biometrika, Biometrika Trust, vol. 89(1), pages 230-237, March.
    6. Ralf Münnich & Jan Burgard & Martin Vogt, 2013. "Small Area-Statistik: Methoden und Anwendungen," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 6(3), pages 149-191, March.
    7. Siegfried Gabler & Matthias Ganninger & Ralf Münnich, 2012. "Optimal allocation of the sample size to strata under box constraints," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 75(2), pages 151-161, February.
    8. Ralf Münnich & Ekkehard Sachs & Matthias Wagner, 2012. "Numerical solution of optimal allocation problems in stratified sampling under box constraints," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 96(3), pages 435-450, July.
    9. Ralf Münnich & Ekkehard Sachs & Matthias Wagner, 2012. "Calibration of estimator-weights via semismooth Newton method," Journal of Global Optimization, Springer, vol. 52(3), pages 471-485, March.
    10. Liqun Qi, 1993. "Convergence Analysis of Some Algorithms for Solving Nonsmooth Equations," Mathematics of Operations Research, INFORMS, vol. 18(1), pages 227-244, February.
    11. Takis Merkouris, 2004. "Combining Independent Regression Estimators From Multiple Surveys," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 1131-1139, December.
    12. Jan Pablo Burgard & Jan-Philipp Kolb & Hariolf Merkle & Ralf Münnich, 2017. "Synthetic data for open and reproducible methodological research in social sciences and official statistics," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 11(3), pages 233-244, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jan Pablo Burgard & Joscha Krause & Ralf Münnich, 2020. "A Study of Discontinuity Effects in Regression Inference based on Web-Augmented Mixed Mode Surveys," Research Papers in Economics 2020-03, University of Trier, Department of Economics.
    2. Anne Konrad & Jan Pablo Burgard & Ralf Münnich, 2021. "A Two‐level GREG Estimator for Consistent Estimation in Household Surveys," International Statistical Review, International Statistical Institute, vol. 89(3), pages 635-656, December.
    3. Burgard Jan Pablo & Dieckmann Hanna & Krause Joscha & Merkle Hariolf & Münnich Ralf & Neufang Kristina M. & Schmaus Simon, 2020. "A generic business process model for conducting microsimulation studies," Statistics in Transition New Series, Polish Statistical Association, vol. 21(4), pages 191-211, August.
    4. Sara Bleninger & Michael Fürnrohr & Hans Kiesl & Walter Krämer & Helmut Küchenhoff & Jan Pablo Burgard & Ralf Münnich & Martin Rupp, 2020. "Kommentare und Erwiderung zu: Qualitätszielfunktionen für stark variierende Gemeindegrößen im Zensus 2021 [Comments and rejoinder: quality measures respecting highly varying community sizes within ," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 14(1), pages 67-98, March.
    5. Jan Pablo Burgard & Hanna Dieckmann & Joscha Krause & Hariolf Merkle & Ralf Münnich & Kristina M. Neufang & Simon Schmaus, 2020. "A generic business process model for conducting microsimulation studies," Statistics in Transition New Series, Polish Statistical Association, vol. 21(4), pages 191-211, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Denis Devaud & Yves Tillé, 2019. "Deville and Särndal’s calibration: revisiting a 25-years-old successful optimization problem," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(4), pages 1033-1065, December.
    2. Friedrich, Ulf & Münnich, Ralf & de Vries, Sven & Wagner, Matthias, 2015. "Fast integer-valued algorithms for optimal allocations under constraints in stratified sampling," Computational Statistics & Data Analysis, Elsevier, vol. 92(C), pages 1-12.
    3. Ralf Münnich & Siegfried Gabler & Christian Bruch & Jan Pablo Burgard & Tobias Enderle & Jan-Philipp Kolb & Thomas Zimmermann, 2015. "Tabellenauswertungen im Zensus unter Berücksichtigung fehlender Werte," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 9(3), pages 269-304, December.
    4. Changbao Wu & Shixiao Zhang, 2019. "Comments on: Deville and Särndal’s calibration: revisiting a 25 years old successful optimization problem," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(4), pages 1082-1086, December.
    5. Ralf Münnich & Jan Pablo Burgard & Siegfried Gabler & Matthias Ganninger & Jan-Philipp Kolb, 2016. "Small Area Estimation In The German Census 2011," Statistics in Transition New Series, Polish Statistical Association, vol. 17(1), pages 25-40, March.
    6. M. Rueda & I. Sánchez-Borrego & A. Arcos & S. Martínez, 2010. "Model-calibration estimation of the distribution function using nonparametric regression," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 71(1), pages 33-44, January.
    7. Barranco-Chamorro, I. & Jiménez-Gamero, M.D. & Moreno-Rebollo, J.L. & Muñoz-Pichardo, J.M., 2012. "Case-deletion type diagnostics for calibration estimators in survey sampling," Computational Statistics & Data Analysis, Elsevier, vol. 56(7), pages 2219-2236.
    8. Allafi, Sabine & Lohn, Alexandra & Nölting, Christopher & Maier, Alexander, 2022. "Die neue Strukturstatistik im Handels- und Dienstleistungsbereich," WISTA – Wirtschaft und Statistik, Statistisches Bundesamt (Destatis), Wiesbaden, vol. 74(5), pages 22-31.
    9. Saeideh Kamgar & Florian Meinfelder & Ralf Münnich & Hamidreza Navvabpour, 2020. "Estimation within the new integrated system of household surveys in Germany," Statistical Papers, Springer, vol. 61(5), pages 2091-2117, October.
    10. Anne Konrad & Jan Pablo Burgard & Ralf Münnich, 2021. "A Two‐level GREG Estimator for Consistent Estimation in Household Surveys," International Statistical Review, International Statistical Institute, vol. 89(3), pages 635-656, December.
    11. Jan Pablo Burgard & Ralf Münnich & Martin Rupp, 2020. "Qualitätszielfunktionen für stark variierende Gemeindegrößen im Zensus 2021 [Quality measures respecting highly varying community sizes within the 2021 German Census]," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 14(1), pages 5-65, March.
    12. Dong Liang & Genevieve Nesslage & Michael Wilberg & Thomas Miller, 2017. "Bayesian Calibration of Blue Crab (Callinectes sapidus) Abundance Indices Based on Probability Surveys," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 22(4), pages 481-497, December.
    13. Sumanta Adhya & Tathagata Banerjee & Gaurangadeb Chattopadhyay, 2012. "Inference on finite population categorical response: nonparametric regression-based predictive approach," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 96(1), pages 69-98, January.
    14. Yves G. Berger & Ewa Kabzińska, 2020. "Empirical Likelihood Approach for Aligning Information from Multiple Surveys," International Statistical Review, International Statistical Institute, vol. 88(1), pages 54-74, April.
    15. Luis Castro-Martín & María del Mar Rueda & Ramón Ferri-García & César Hernando-Tamayo, 2021. "On the Use of Gradient Boosting Methods to Improve the Estimation with Data Obtained with Self-Selection Procedures," Mathematics, MDPI, vol. 9(23), pages 1-23, November.
    16. Ann-Kristin Kreutzmann, 2018. "Estimation of sample quantiles: challenges and issues in the context of income and wealth distributions [Die Schätzung von Quantilen: Herausforderungen und Probleme im Kontext von Einkommens- und V," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 12(3), pages 245-270, December.
    17. Ying Sheng & Yifei Sun & Chiung‐Yu Huang & Mi‐Ok Kim, 2022. "Synthesizing external aggregated information in the presence of population heterogeneity: A penalized empirical likelihood approach," Biometrics, The International Biometric Society, vol. 78(2), pages 679-690, June.
    18. Maria del Mar Rueda, 2019. "Comments on: Deville and Särndal’s calibration: revisiting a 25 years old successful optimization problem," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(4), pages 1077-1081, December.
    19. Jan Breitkreuz & Gabriela Brückner & Jan Pablo Burgard & Joscha Krause & Ralf Münnich & Helmut Schröder & Katrin Schüssel, 2019. "Schätzung kleinräumiger Krankheitshäufigkeiten für die deutsche Bevölkerung anhand von Routinedaten am Beispiel von Typ-2-Diabetes [Estimation of regional diabetes type 2 prevalence in the German p," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 13(1), pages 35-72, April.
    20. Changbao Wu & Wilson W. Lu, 2016. "Calibration Weighting Methods for Complex Surveys," International Statistical Review, International Statistical Institute, vol. 84(1), pages 79-98, April.

    More about this item

    Keywords

    Calibration; general regression estimator; coherent estimates; sampling weights; soft constraints; box-constraints; semismooth Newton;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:trr:wpaper:201910. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Matthias Neuenkirch (email available below). General contact details of provider: https://edirc.repec.org/data/petride.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.