IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/erhak_v1.html

Simulating area-level population outcomes: Should we use Multilevel Regression and Poststratification over Spatial Microsimulation?

Author

Listed:
  • Beecham, Roger
  • Clark, Stephen

Abstract

Estimating unknown outcomes at small-area population level is a routine task in spatial analysis. We demonstrate how Multilevel Regression and Poststratification (MRP), now widely used in political polling, overcomes some deficiencies in Spatial Microsimulation (SPM), the de facto approach in quantitative geography. Using individual-level data from Health Survey for England and population-level data from 2021 UK Census, we evaluate MRP and SPM at estimating two known health outcomes that occur with high and low frequency in the population. With few constraints there are only slight differences in estimation between the two approaches. With more and especially area-level constraints extreme errors in the SPM estimates begin to accumulate, and these are particularly pronounced for the low-frequency outcome. Additionally, where uncertainty ranges from MRP posteriors begin to widen we find they map to groundtruthed errors, providing a useful validity check when the true population distribution is unknown. This is the first direct comparison of MRP and SPM for small-area estimation. Alongside metrics for evaluating estimates, we highlight the value of area-level variables that constrain outcomes or that may capture varying processes over spatial units, and of a principled approach to model specification and uncertainty quantification – both central to MRP practice.

Suggested Citation

  • Beecham, Roger & Clark, Stephen, 2026. "Simulating area-level population outcomes: Should we use Multilevel Regression and Poststratification over Spatial Microsimulation?," SocArXiv erhak_v1, Center for Open Science.
    • Handle: RePEc:osf:socarx:erhak_v1
    DOI: 10.31219/osf.io/erhak_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/696a3969f7278364ee8da60a/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/erhak_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kevin Chapuis & Patrick Taillandier & Alexis Drogoul, 2022. "Generation of Synthetic Populations in Social Simulations: A Review of Methods and Practices," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 25(2), pages 1-6.
    2. repec:osf:socarx:qzjwb_v1 is not listed on IDEAS
    3. Park, David K. & Gelman, Andrew & Bafumi, Joseph, 2004. "Bayesian Multilevel Estimation with Poststratification: State-Level Estimates from National Polls," Political Analysis, Cambridge University Press, vol. 12(4), pages 375-385.
    4. Jake M. Hofman & Duncan J. Watts & Susan Athey & Filiz Garip & Thomas L. Griffiths & Jon Kleinberg & Helen Margetts & Sendhil Mullainathan & Matthew J. Salganik & Simine Vazire & Alessandro Vespignani, 2021. "Integrating explanation and prediction in computational social science," Nature, Nature, vol. 595(7866), pages 181-188, July.
    5. Duc Minh La & Hai L. Vu & Liton Kamruzzaman & Eric Miller, 2025. "Population synthesis: a problem-based review," Transport Reviews, Taylor & Francis Journals, vol. 45(3), pages 366-389, May.
    6. Wolf, Levi John, 2022. "The Right to Rule by Thumb: A Comment on Epistemology in "A Route Map for Successful Applications of Geographically-Weighted Regression"," SocArXiv qzjwb, Center for Open Science.
    7. L. Ingber, 1993. "Simulated annealing: Practice versus theory," Lester Ingber Papers 93sa, Lester Ingber.
    8. Wang, Wei & Rothschild, David & Goel, Sharad & Gelman, Andrew, 2015. "Forecasting elections with non-representative polls," International Journal of Forecasting, Elsevier, vol. 31(3), pages 980-991.
    9. Kirk Harland & Alison Heppenstall & Dianna Smith & Mark Birkin, 2012. "Creating Realistic Synthetic Populations at Varying Spatial Scales: A Comparative Critique of Population Synthesis Techniques," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 15(1), pages 1-1.
    10. Tom Wilson & Irina Grossman & Monica Alexander & Phil Rees & Jeromey Temple, 2022. "Methods for Small Area Population Forecasts: State-of-the-Art and Research Needs," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 41(3), pages 865-898, June.
    11. Mark Birkin & Graham Clarke, 2012. "The enhancement of spatial microsimulation models using geodemographics," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 49(2), pages 515-532, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Temporão, Mickael & Dufresne, Yannick & Savoie, Justin & Linden, Clifton van der, 2019. "Crowdsourcing the vote: New horizons in citizen forecasting," International Journal of Forecasting, Elsevier, vol. 35(1), pages 1-10.
    2. James William Benjamin Elsey & David Manheim & Abigail Marsh & Virginia Schmit & David Moss, 2024. "Ethical acceptability of human challenge trials: Consultation with the US public and with research personnel," PLOS ONE, Public Library of Science, vol. 19(10), pages 1-18, October.
    3. repec:osf:osfxxx:pg2wt_v1 is not listed on IDEAS
    4. Yonatan Ben-Shalom & Ignacio Martinez & Mariel Finucane, "undated". "Risk of Workforce Exit Due to Disability: State Differences in 2003–2016," Mathematica Policy Research Reports 8aed03744a06419dbda68be8c, Mathematica Policy Research.
    5. Skinner, Benjamin T. & Doyle, William R., 2024. "Predicting postsecondary attendance by family income in the United States using multilevel regression with poststratification," Economics of Education Review, Elsevier, vol. 99(C).
    6. Laura C. Dawkins & Daniel B. Williamson & Stewart W. Barr & Sally R. Lampkin, 2020. "‘What drives commuter behaviour?': a Bayesian clustering approach for understanding opposing behaviours in social surveys," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(1), pages 251-280, January.
    7. Cerina, Roberto & Duch, Raymond, 2020. "Measuring public opinion via digital footprints," International Journal of Forecasting, Elsevier, vol. 36(3), pages 987-1002.
    8. Abdoul Razac Sané & Pierre-Olivier Vandanjon & Rachid Belaroussi & Pierre Hankach, 2025. "A comprehensive investigation of variational auto-encoders for population synthesis," Journal of Computational Social Science, Springer, vol. 8(1), pages 1-34, February.
    9. Montalvo, José G. & Papaspiliopoulos, Omiros & Stumpf-Fétizon, Timothée, 2019. "Bayesian forecasting of electoral outcomes with new parties’ competition," European Journal of Political Economy, Elsevier, vol. 59(C), pages 52-70.
    10. Marcin Hitczenko, 2021. "Sample Bias Related to Household Role," FRB Atlanta Working Paper 2021-9, Federal Reserve Bank of Atlanta.
    11. Bruch, Christian & Felderer, Barbara, 2024. "An Approximation of Joint Distributions of Weighting Variables Using a Pseudo Population Approach," OSF Preprints pg2wt, Center for Open Science.
    12. José Garcia Montalvo & Omiros Papaspiliopoulos & Timothée Stumpf-Fétizon, 2018. "Bayesian forecasting of electoral outcomes with new parties' competition," Economics Working Papers 1624, Department of Economics and Business, Universitat Pompeu Fabra.
    13. Timothée Stumpf-Fétizon & Omiros Papaspiliopoulos & José García-Montalvo, 2018. "Bayesian Forecasting of Electoral Outcomes with new Parties' Competition," Working Papers 1065, Barcelona School of Economics.
    14. Yanhua Chen & Zhi-Ri Tang, 2025. "Assessing Urban Safety Perception Through Street View Imagery and Transfer Learning: A Case Study of Wuhan, China," Sustainability, MDPI, vol. 17(17), pages 1-18, August.
    15. repec:osf:socarx:gydve_v1 is not listed on IDEAS
    16. Wang, Wei & Rothschild, David & Goel, Sharad & Gelman, Andrew, 2015. "Forecasting elections with non-representative polls," International Journal of Forecasting, Elsevier, vol. 31(3), pages 980-991.
    17. Mark Richard & Jan Vecer, 2021. "Efficiency Testing of Prediction Markets: Martingale Approach, Likelihood Ratio and Bayes Factor Analysis," Risks, MDPI, vol. 9(2), pages 1-20, February.
    18. Bergey, Paul K. & Ragsdale, Cliff, 2005. "Modified differential evolution: a greedy random strategy for genetic recombination," Omega, Elsevier, vol. 33(3), pages 255-265, June.
    19. Moshe Ben-Akiva & Michel Bierlaire & Khan Doyme & Shari Gershenfeld & Nathalie Picard & Andreas W. Schäfer & Ravi Seshadri & Aruna Sivakumar & Linda Steg, 2025. "The Behavioral Dimension of Transport Decarbonization," Working Papers of BETA 2025-31, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
    20. Moriguchi, Kai & Ueki, Tatsuhito & Saito, Masashi, 2020. "Establishing optimal forest harvesting regulation with continuous approximation," Operations Research Perspectives, Elsevier, vol. 7(C).
    21. Dimiter Toshkov & Elitsa Kortenska, 2015. "Does Immigration Undermine Public Support for Integration in the European Union?," Journal of Common Market Studies, Wiley Blackwell, vol. 53(4), pages 910-925, July.
    22. Sakshaug Joseph W. & Wiśniowski Arkadiusz & Ruiz Diego Andres Perez & Blom Annelies G., 2019. "Supplementing Small Probability Samples with Nonprobability Samples: A Bayesian Approach," Journal of Official Statistics, Sciendo, vol. 35(3), pages 653-681, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:erhak_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.