IDEAS home Printed from https://ideas.repec.org/a/ijm/journl/v8y2015i2p83-127.html
   My bibliography  Save this article

Regression-Style Models for Parameter Estimation in Dynamic Microsimulation: An Empirical Performance Assessment

Author

Listed:
  • Jessica M. Mc Lay

    (Centre of Methods and Policy Application in the Social Sciences, The University of Auckland)

  • Roy Lay-Yee

    (Centre of Methods and Policy Application in the Social Sciences, The University of Auckland)

  • Barry J. Milne

    (Centre of Methods and Policy Application in the Social Sciences, The University of Auckland)

  • Peter Davis

    (Centre of Methods and Policy Application in the Social Sciences, The University of Auckland)

Abstract

Microsimulation models seek to represent real-world processes and can generate extensive amounts of synthetic data. The parameters that drive the data generation process are often estimated by statistical models, such as linear regression models. There are many models that could be considered for this purpose. We compare six potential models, discuss the assumptions of these models, and perform an empirical assessment that compares synthetic data simulated from these models with observed data. We chose six regression-style models that can be easily implemented in standard statistical software: an ordinary least squares regression model with a lagged dependent variable, two random effects models (with and without an autoregressive order 1within-unit error structure), a fixed effects model, a hybrid model combining features from both fixed and random effects models, and a dynamic panel model estimated with system generalised method of moments. The criterion for good performance was the proximity of fit of simulated data to the observed data on various characteristics. We found evidence of violated assumptions in our data for all the models but found that, for the majority of data characteristics assessed, all the models produced synthetic data that were a reasonable approximation to the observed data, with some models performing better or worse for particular characteristics. We hope more modellers will consider and test the assumptions of models used for parameter estimation and experiment with different model specifications resulting in higher quality microsimulation models and other research applications.

Suggested Citation

  • Jessica M. Mc Lay & Roy Lay-Yee & Barry J. Milne & Peter Davis, 2015. "Regression-Style Models for Parameter Estimation in Dynamic Microsimulation: An Empirical Performance Assessment," International Journal of Microsimulation, International Microsimulation Association, vol. 8(2), pages 83-127.
  • Handle: RePEc:ijm:journl:v:8:y:2015:i:2:p:83-127
    as

    Download full text from publisher

    File URL: http://www.microsimulation.org/IJM/V8_2/4_McLay_Lay-Yee_Milne_Davis.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Arellano, Manuel & Bover, Olympia, 1995. "Another look at the instrumental variable estimation of error-components models," Journal of Econometrics, Elsevier, vol. 68(1), pages 29-51, July.
    3. Luca Spataro, 2002. "New Tools in Micromodeling Retirement Decisions: Overview and Applications to the Italian Case," Computing in Economics and Finance 2002 109, Society for Computational Economics.
    4. Terance J. Rephann & Einar Holm, 2004. "Economic-Demographic Effects of Immigration: Results from a Dynamic Spatial Microsimulation Model," International Regional Science Review, , vol. 27(4), pages 379-410, October.
    5. Matteo Richiardi & Ambra Poggi, 2012. "Imputing Individual Effects in Dynamic Microsimulation Models. An application of the Rank Method," Carlo Alberto Notebooks 267, Collegio Carlo Alberto.
    6. Holtz-Eakin, Douglas & Newey, Whitney & Rosen, Harvey S, 1988. "Estimating Vector Autoregressions with Panel Data," Econometrica, Econometric Society, vol. 56(6), pages 1371-1395, November.
    7. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    8. M. Hashem Pesaran, 2021. "General diagnostic tests for cross-sectional dependence in panels," Empirical Economics, Springer, vol. 60(1), pages 13-50, January.
    9. Stephen R. Bond, 2002. "Dynamic panel data models: a guide to micro data methods and practice," Portuguese Economic Journal, Springer;Instituto Superior de Economia e Gestao, vol. 1(2), pages 141-162, August.
    10. Matteo Richiardi & Ambra Poggi, 2014. "Imputing Individual Effects in Dynamic Microsimulation Models. An application to household formation and labour market participation in Italy," International Journal of Microsimulation, International Microsimulation Association, vol. 7(2), pages 3-39.
    11. van Sonsbeek, Jan-Maarten, 2010. "Micro simulations on the effects of ageing-related policy measures," Economic Modelling, Elsevier, vol. 27(5), pages 968-979, September.
    12. Stephen Bond, 2002. "Dynamic panel data models: a guide to microdata methods and practice," CeMMAP working papers CWP09/02, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    13. Christopher Zorn, 2001. "Estimating between‐ and within‐cluster covariate effects, with an application to models of international disputes," International Interactions, Taylor & Francis Journals, vol. 27(4), pages 433-445, June.
    14. Constantijn W.A. Panis, 2003. "Microsimulations in the Presence of Heterogeneity," Working Papers wp048, University of Michigan, Michigan Retirement Research Center.
    15. Mahmood Zafar & Khan Salahuddin, 2009. "On the Use of K-Fold Cross-Validation to Choose Cutoff Values and Assess the Performance of Predictive Models in Stepwise Regression," The International Journal of Biostatistics, De Gruyter, vol. 5(1), pages 1-21, July.
    16. Grazzini, Jakob & Richiardi, Matteo, 2015. "Estimation of ergodic agent-based models by simulated minimum distance," Journal of Economic Dynamics and Control, Elsevier, vol. 51(C), pages 148-165.
    17. Carl Emmerson & Howard Reed & Andrew Shephard, 2004. "An assessment of PenSim2," IFS Working Papers W04/21, Institute for Fiscal Studies.
    18. Wolfson, Michael, 1995. "Socio-economic Statistics and Public Policy: A New Role for Microsimulation Modeling," Analytical Studies Branch Research Paper Series 1995081e, Statistics Canada, Analytical Studies Branch.
    19. Manuel Arellano & Stephen Bond, 1991. "Some Tests of Specification for Panel Data: Monte Carlo Evidence and an Application to Employment Equations," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(2), pages 277-297.
    20. Anderson, T. W. & Hsiao, Cheng, 1982. "Formulation and estimation of dynamic models using panel data," Journal of Econometrics, Elsevier, vol. 18(1), pages 47-82, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Johannes Geyer & Salmai Qari & Hermann Buslei & Peter Haan, 2021. "DySiMo Dokumentation: Version 1.0," Data Documentation 101, DIW Berlin, German Institute for Economic Research.
    2. Barry J. Milne & Roy Lay-Yee & Jessica M. Mc Lay & Janet Pearson & Martin von Randow & Peter Davis, 2015. "Modelling the Early life-course (MELC): A Microsimulation Model of Child Development in New Zealand," International Journal of Microsimulation, International Microsimulation Association, vol. 8(2), pages 28-60.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marcus Tamm & Harald Tauchmann & Stefan Greß & Jürgen Wasem, 2005. "Price Elasticities and Social Health Insurance Choice in Germany: A Dynamic Panel Data Approach," RWI Discussion Papers 0028, Rheinisch-Westfälisches Institut für Wirtschaftsforschung.
    2. repec:zbw:inwedp:652016 is not listed on IDEAS
    3. Cristina Aybar-Arias & Alejandro Casino-Martínez & José López-Gracia, 2012. "On the adjustment speed of SMEs to their optimal capital structure," Small Business Economics, Springer, vol. 39(4), pages 977-996, November.
    4. Jan F. Kiviet, 2005. "Judging Contending Estimators by Simulation: Tournaments in Dynamic Panel Data Models," Tinbergen Institute Discussion Papers 05-112/4, Tinbergen Institute.
    5. Ulaşan, Bülent, 2012. "Cross-country growth empirics and model uncertainty: An overview," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 6, pages 1-69.
    6. Feichtinger, Paul & Salhofer, Klaus, 2016. "Decoupled Single Farm Payments of the CAP and Land Rental Prices," Discussion Papers DP-65-2016, University of Natural Resources and Life Sciences, Vienna, Department of Economics and Social Sciences, Institute for Sustainable Economic Development.
    7. David Roodman, 2006. "How to Do xtabond2," North American Stata Users' Group Meetings 2006 8, Stata Users Group.
    8. Seidu, Ayuba & Onel, Gulcan & Moss, Charles Britt, 2018. "Impact of International Remittance on Out-Farm Labor Migration in Developing Countries: A Dynamic Panel Data Analysis," 2018 Annual Meeting, February 2-6, 2018, Jacksonville, Florida 266531, Southern Agricultural Economics Association.
    9. David Roodman, 2009. "A Note on the Theme of Too Many Instruments," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(1), pages 135-158, February.
    10. repec:zbw:rwidps:0028 is not listed on IDEAS
    11. Youssef, Ahmed & Abonazel, Mohamed R., 2015. "Alternative GMM Estimators for First-order Autoregressive Panel Model: An Improving Efficiency Approach," MPRA Paper 68674, University Library of Munich, Germany.
    12. Paul Feichtinger & Klaus Salhofer, 2016. "Decoupled Single Farm Payments of the CAP and Land Rental Prices," Working Papers 652016, University of Natural Resources and Life Sciences, Vienna, Department of Economics and Social Sciences, Institute for Sustainable Economic Development.
    13. Greß, Stefan & Tamm, Marcus & Tauchmann, Harald & Wasem, Jürgen, 2005. "Price Elasticities and Social Health Insurance Choice in Germany: A Dynamic Panel Data Approach," RWI Discussion Papers 28, RWI - Leibniz-Institut für Wirtschaftsforschung.
    14. Ogunniyi, Adebayo Isaiah & Mavrotas, George & Olagunju, Kehinde Oluseyi & Fadare, Olusegun & Adedoyin, Rufai, 2020. "Governance quality, remittances and their implications for food and nutrition security in Sub-Saharan Africa," World Development, Elsevier, vol. 127(C).
    15. Emmi Martikainen, 2014. "Does file-sharing reduce DVD sales?," Netnomics, Springer, vol. 15(1), pages 9-31, July.
    16. Dolton, Peter & Bondibene, Chiara Rosazza & Stops, Michael, 2015. "Identifying the employment effect of invoking and changing the minimum wage: A spatial analysis of the UK," Labour Economics, Elsevier, vol. 37(C), pages 54-76.
    17. Martikainen, Emmi & Schmiedel, Heiko & Takalo, Tuomas, 2015. "Convergence of European retail payments," Journal of Banking & Finance, Elsevier, vol. 50(C), pages 81-91.
    18. David Roodman, 2009. "How to do xtabond2: An introduction to difference and system GMM in Stata," Stata Journal, StataCorp LP, vol. 9(1), pages 86-136, March.
    19. Claire Senot & Aravind Chandrasekaran & Peter T. Ward & Anita L. Tucker & Susan D. Moffatt-Bruce, 2016. "The Impact of Combining Conformance and Experiential Quality on Hospitals’ Readmissions and Cost Performance," Management Science, INFORMS, vol. 62(3), pages 829-848, March.
    20. Bakhat, Mohcine & Labandeira, Xavier & Labeaga, José M. & López-Otero, Xiral, 2017. "Elasticities of transport fuels at times of economic crisis: An empirical analysis for Spain," Energy Economics, Elsevier, vol. 68(S1), pages 66-80.
    21. Aykut Karakaya & Ayten Turan Kurtaran & Ahmet Kurtaran, 2017. "Firm Value and External Financing Needs," International Journal of Economics and Finance, Canadian Center of Science and Education, vol. 9(6), pages 69-81, June.
    22. Bertrand, Olivier & Zuniga, Pluvia, 2006. "R&D and M&A: Are cross-border M&A different? An investigation on OECD countries," International Journal of Industrial Organization, Elsevier, vol. 24(2), pages 401-423, March.

    More about this item

    Keywords

    Microsimulation; panel data analysis; simulation; dynamic model; estimation techniques; model assumptions.;
    All these keywords.

    JEL classification:

    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ijm:journl:v:8:y:2015:i:2:p:83-127. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jinjing Li (email available below). General contact details of provider: http://www.microsimulation.org/ijm/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.