IDEAS home Printed from https://ideas.repec.org/p/leu/wpaper/10.html
   My bibliography  Save this paper

Microdata Adjustment by the Minimum Information Loss Principle

Author

Listed:
  • Joachim Merz

    (LEUPHANA University Lüneburg,Department of Economic, Behaviour and Law Sciences, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)))

Abstract

Microdata have become increasingly important for economic and social analyses. One striking problem with almost any practical analysis of microdata, microdata as a singular cross or longitudinal sample or within (static) microsimulation, is to achieve representative results. In this study a consistent solution of the microdata adjustment problem - that is to achieve representative results by re-weighting microdata to fit aggregate control data - is presented based on the Minimum Information Loss (MIL) principle. Based on information theory this principle satisfies the desired positivity constraint on the weighting factors to be computed. For the consistent solution which simultaneously adjusts hierarchical microdata (e.g. household and personal information), a fast numerical solution by a specific modified Newton-Raphson (MN) procedure with a global exponential approximation is proposed. Practical experiences for large microdata sets in a pension reform analysis with e.g. more than 60.000 households and 240 restrictions simultaneously to be achieved within the Sfb 3 microsimulation model show that this MN procedure was able to rather largely reduce the computional expenses by 75%. The available efficient PC-computer program ADJUST is also succesfully applied in a described microsimulation analyses of the recent 1990 German tax reform investigating the impacts on market and non-market labour supply within the formal and informal economy, and in a recent firm microsimulation analysion explaining factors of successful firms in the German engineering industry.

Suggested Citation

  • Joachim Merz, 1994. "Microdata Adjustment by the Minimum Information Loss Principle," FFB-Discussionpaper 10, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
  • Handle: RePEc:leu:wpaper:10
    as

    Download full text from publisher

    File URL: http://www.leuphana.de/fileadmin/user_upload/Forschungseinrichtungen/ffb/files/DP_10_neu.pdf
    File Function: First version, 1994
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Merz, Joachim, 1994. "Microsimulation - A Survey of Methods and Applications for Analyzing Economic and Social Policy," MPRA Paper 7232, University Library of Munich, Germany.
    2. Merz, Joachim, 1991. "Microsimulation -- A survey of principles, developments and applications," International Journal of Forecasting, Elsevier, vol. 7(1), pages 77-104, May.
    3. Finke, Renate & Theil, Henri, 1984. "An extended version of minimum information estimation of allocation models," Economics Letters, Elsevier, vol. 15(3-4), pages 229-233.
    4. Merz, Joachim, 1993. "Microsimulation as an Instrument to Evaluate Economic and Social Programmes," MPRA Paper 7236, University Library of Munich, Germany.
    5. Merz, Joachim & Wolff, Klaus G, 1993. "The Shadow Economy: Illicit Work and Household Production: A Microanalysis of West Germany," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 39(2), pages 177-194, June.
    6. Theil, Henri & Finke, Renate & Flood, Lennart R., 1984. "Minimum information estimation of allocation models," Economics Letters, Elsevier, vol. 15(3-4), pages 251-256.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Joachim Merz & Lars Rusch, 2015. "MICSIM-4j - A General Microsimulation Model User Guide (Version 1.1)," FFB-Discussionpaper 100, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    2. Nicola Branson, 2009. "Re-weighting the OHS and LFS National household Survey Data to create a consistent series over time: A Cross Entropy Estimation Approach," SALDRU Working Papers 38, Southern Africa Labour and Development Research Unit, University of Cape Town.
    3. Joachim Merz & Dominik Hanglberger & Rafael Rucha, 2009. "The Timing of Daily Demand for Goods and Services – Multivariate Probit Estimates and Microsimulation Results for an Aged Population with German Time Use Diary Data," FFB-Discussionpaper 77, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    4. Merz, Joachim, 1995. "MICSIM : Concept, Developments and Applications of a PC-Microsimulation Model for Research and Teaching," MPRA Paper 16029, University Library of Munich, Germany.
    5. Agenor, Pierre-Richard & Chen, Derek H.C. & Grimm, Michael, 2004. "Linking representative household models with household surveys for poverty analysis : a comparison of alternative methodologies," Policy Research Working Paper Series 3343, The World Bank.
    6. Joachim Merz & Henning Stolze, 2005. "Representative Time Use Data and Calibration of the American Time Use Studies 1965-1999," FFB-Discussionpaper 54, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg, revised Jan 2006.
    7. Joachim Merz, 2002. "Zur Kumulation von Haushaltsstichproben," FFB-Discussionpaper 37, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    8. Grösche, Peter & Schröder, Carsten, 2011. "Eliciting public support for greening the electricity mix using random parameter techniques," Energy Economics, Elsevier, vol. 33(2), pages 363-370, March.
    9. Peter Grösche & Carsten Schröder, 2010. "Eliciting Public Support for Greening the Electricity Mix Using Random Parameter Techniques," Ruhr Economic Papers 0233, Rheinisch-Westfälisches Institut für Wirtschaftsforschung, Ruhr-Universität Bochum, Universität Dortmund, Universität Duisburg-Essen.
    10. Merz, Joachim, 1993. "Market and Non-market Labor Supply and Recent German Tax Reform Impacts - Behavioral Response in a Combined Dynamic and Static Microsimulation Model," MPRA Paper 7235, University Library of Munich, Germany.
    11. Joachim Merz & Paul Böhm & Dominik Hanglberger & J.F. Rafael Rucha & Henning Stolze, 2007. "Wann werden Serviceleistungen nachgefragt? Ein Mikrosimulationsmodell alternativer Ladenöffnungszeiten mit Daten der Zeitbudgeterhebung ServSim," FFB-Discussionpaper 70, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    12. Merz, Joachim & Lang, Rainer, 1997. "Preferred vs. Actual Working Hours - A Ten Years Paneleconometric Analysis for Professions, Entrepreneurs and Employees in Germany," MPRA Paper 7142, University Library of Munich, Germany.
    13. Anders Klevmarken, 2022. "Statistical Inference in Micro-simulation Models: Incorporating External Information," International Journal of Microsimulation, International Microsimulation Association, vol. 15(1), pages 111-120.
    14. repec:zbw:rwirep:0233 is not listed on IDEAS
    15. Joachim Merz & Henning Stolze, 2008. "Representative time use data and new harmonised calibration of the American Heritage Time Use Data (AHTUD) 1965-1999," electronic International Journal of Time Use Research, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)) and The International Association for Time Use Research (IATUR), vol. 5(1), pages 90-126, November.
    16. Christof Schatz & Joachim Merz, 2000. "Die Rentenreform in der Diskussion Ein Mikrosimulationsmodell für die Altersvorsorge in Deutschland (AVID-PRO)," FFB-Discussionpaper 28, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    17. Boysen-Hogrefe, Jens & Göttert, Marcell & Jäger, Philipp & Jessen, Robin, 2020. "Der Einfluss der Lohnspreizung und der Haushaltszusammensetzung auf die Lohnsteuereinnahmen," Kieler Beiträge zur Wirtschaftspolitik 25, Kiel Institute for the World Economy (IfW Kiel).
    18. Widmaier, Ulrich & Niggemann, Hiltrud & Merz, Joachim, 1994. "What makes the Difference between Unsuccessful and Successful Firms in the German Mechanical Engineering Industry?," MPRA Paper 7230, University Library of Munich, Germany.
    19. Gijs Dekkers, 2015. "The simulation properties of microsimulation models with static and dynamic ageing a brief guide into choosing one type of model over the other," International Journal of Microsimulation, International Microsimulation Association, vol. 8(1), pages 97-109.
    20. Joachim Merz & Dominik Hanglberger & Rafael Rucha, 2010. "The Timing of Daily Demand for Goods and Services—Microsimulation Policy Results of an Aging Society, Increasing Labour Market Flexibility, and Extended Public Childcare in Germany," Journal of Consumer Policy, Springer, vol. 33(2), pages 119-141, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Merz, Joachim, 1995. "MICSIM : Concept, Developments and Applications of a PC-Microsimulation Model for Research and Teaching," MPRA Paper 16029, University Library of Munich, Germany.
    2. Joachim Merz & Henning Stolze, 2005. "Representative Time Use Data and Calibration of the American Time Use Studies 1965-1999," FFB-Discussionpaper 54, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg, revised Jan 2006.
    3. Joachim Merz & Henning Stolze, 2008. "Representative time use data and new harmonised calibration of the American Heritage Time Use Data (AHTUD) 1965-1999," electronic International Journal of Time Use Research, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)) and The International Association for Time Use Research (IATUR), vol. 5(1), pages 90-126, November.
    4. Ulrich Widmaier & Hiltrud Niggemann & Joachim Merz, 1994. "What makes the Difference between Unsuccessful and Successful Firms in the German Mechanical Engineering Industry?," FFB-Discussionpaper 11, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    5. de Kam, C. A. & de Haan, J. & Giles, C. & Manresa, A. & Berenguer, E. & Calonge, S., 1996. "Who pays the taxes?," MPRA Paper 7146, University Library of Munich, Germany.
      • C. A. de Kam & J. de Haan & C. Giles & A. Manresa & E. Berenguer & S. Calonge & J. Merz, 1996. "Who pays the taxes?," FFB-Discussionpaper 18, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    6. Merz, Joachim, 2002. "Zur Kumulation von Haushaltsstichproben," MPRA Paper 5991, University Library of Munich, Germany.
    7. Chen, Dongling & Seale, James L., Jr., 2003. "The Informational Fit and Maximum Likelihood in a Pooled Cross-Country Demand System with Autocorrelation," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 35(Supplemen), pages 1-7.
    8. Joachim Merz & Lars Rusch, 2015. "MICSIM-4j - A General Microsimulation Model User Guide (Version 1.1)," FFB-Discussionpaper 100, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    9. Franziska Gassmann & Cecile Cherrier & Andrés Mideros Mora & Pierre Mohnen, 2013. "Making the Investment Case for Social Protection: Methodological challenges with lessons learnt from a recent study in Cambodia," Papers inwopa694, Innocenti Working Papers.
    10. Merz, Joachim, 1993. "Microsimulation as an Instrument to Evaluate Economic and Social Programmes," MPRA Paper 7236, University Library of Munich, Germany.
    11. Friedrich Schneider, 2012. "The Shadow Economy and Tax Evasion: What Do We (Not) Know?," CESifo Forum, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 13(02), pages 03-12, July.
    12. repec:hal:wpspec:info:hdl:2441/f4rshpf3v1umfa09lat214kj4 is not listed on IDEAS
    13. Herwig Immervoll & Cathal O'Donoghue, 2009. "Towards a multi-purpose framework for tax-benefit microsimulation: lessons from EUROMOD," International Journal of Microsimulation, International Microsimulation Association, vol. 2(2), pages 43-54.
    14. Ahmed, Vaqar & O' Donoghue, Cathal, 2007. "CGE-Microsimulation Modelling: A Survey," MPRA Paper 9307, University Library of Munich, Germany.
    15. Larrivee, John & Shaffer, Ron E., 2007. "Understanding the Local Unrecorded Economy: Informal Work and Home Production in Non-Metropolitan Wisconsin," Journal of Regional Analysis and Policy, Mid-Continent Regional Science Association, vol. 37(2), pages 1-17.
    16. Martin Spielauer & René Houle, 2004. "Sample size and statistical significance of hazard regression parameters. An exploration by means of Monte Carlo simulation of four transition models based on Hungarian GGS data," MPIDR Working Papers WP-2004-020, Max Planck Institute for Demographic Research, Rostock, Germany.
    17. Barros, Carlos Pestana & Prieto-Rodriguez, Juan, 2008. "A revenue-neutral tax reform to increase demand for public transport services," Transportation Research Part A: Policy and Practice, Elsevier, vol. 42(4), pages 659-672, May.
    18. Ivan Stoykov & Paraskeva Dimitrova, 1999. "The Hidden Economy – Measurement and Influence," Economic Studies journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 1, pages 3-43.
    19. Sadettin Erksoy, 1994. "The Effects of Higher Unemployment on the Distribution of Income in Canada: 1981-1987," Canadian Public Policy, University of Toronto Press, vol. 20(3), pages 318-328, September.
    20. Unay-Gailhard, İlkay & Baqueiro-Espinosa, Omar, 2015. "Adaptation of a microsimulation model at the municipality level: demographic and employment evolution in the Altmark region of Germany," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 91(12), pages 1088-1103.
    21. Joachim, Merz & Henning, Stolz & Markus, Zwick, 2002. "Professions, entrepreneurs, employees and the new German tax (cut) reform 2000 - A MICSIM microsimulation analysis of distributional impacts," MPRA Paper 6345, University Library of Munich, Germany.

    More about this item

    Keywords

    Microdata Adjustment; Microanalyses; Microsimulation; Minimum Information Loss; Modified Newton- Raphson Algorithm; PC program package ADJUST;
    All these keywords.

    JEL classification:

    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:leu:wpaper:10. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Merz (email available below). General contact details of provider: https://edirc.repec.org/data/fbluede.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.