IDEAS home Printed from https://ideas.repec.org/a/eee/transb/v90y2016icp1-21.html
   My bibliography  Save this article

Hidden Markov Model-based population synthesis

Author

Listed:
  • Saadi, Ismaïl
  • Mustafa, Ahmed
  • Teller, Jacques
  • Farooq, Bilal
  • Cools, Mario

Abstract

Micro-simulation travel demand and land use models require a synthetic population, which consists of a set of agents characterized by demographic and socio-economic attributes. Two main families of population synthesis techniques can be distinguished: (a) fitting methods (iterative proportional fitting, updating) and (b) combinatorial optimization methods. During the last few years, a third outperforming family of population synthesis procedures has emerged, i.e., Markov process-based methods such as Monte Carlo Markov Chain (MCMC) simulations. In this paper, an extended Hidden Markov Model (HMM)-based approach is presented, which can serve as a better alternative than the existing methods. The approach is characterized by a great flexibility and efficiency in terms of data preparation and model training. The HMM is able to reproduce the structural configuration of a given population from an unlimited number of micro-samples and a marginal distribution. Only one marginal distribution of the considered population can be used as a boundary condition to “guide” the synthesis of the whole population. Model training and testing are performed using the Survey on the Workforce of 2013 and the Belgian National Household Travel Survey of 2010. Results indicate that the HMM method captures the complete heterogeneity of the micro-data contrary to standard fitting approaches. The method provides accurate results as it is able to reproduce the marginal distributions and their corresponding multivariate joint distributions with an acceptable error rate (i.e., SRSME=0.54 for 6 synthesized attributes). Furthermore, the HMM outperforms IPF for small sample sizes, even though the amount of input data is less than that for IPF. Finally, simulations show that the HMM can merge information provided by multiple data sources to allow good population estimates.

Suggested Citation

  • Saadi, Ismaïl & Mustafa, Ahmed & Teller, Jacques & Farooq, Bilal & Cools, Mario, 2016. "Hidden Markov Model-based population synthesis," Transportation Research Part B: Methodological, Elsevier, vol. 90(C), pages 1-21.
  • Handle: RePEc:eee:transb:v:90:y:2016:i:c:p:1-21
    DOI: 10.1016/j.trb.2016.04.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0191261515300904
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.trb.2016.04.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Denteneer, Dee & Verbeek, Albert, 1985. "A fast algorithm for iterative proportional fitting in log-linear models," Computational Statistics & Data Analysis, Elsevier, vol. 3(1), pages 251-264, May.
    2. David Pritchard & Eric Miller, 2012. "Advances in population synthesis: fitting many attributes per agent and fitting to household and person margins simultaneously," Transportation, Springer, vol. 39(3), pages 685-704, May.
    3. Mohammad-Reza Namazi-Rad & Payam Mokhtarian & Pascal Perez, 2014. "Generating a Dynamic Synthetic Population – Using an Age-Structured Two-Sex Model for Household Dynamics," PLOS ONE, Public Library of Science, vol. 9(4), pages 1-16, April.
    4. Tirumalachetty, Sumala & Kockelman, Kara M. & Nichols, Brice G., 2013. "Forecasting greenhouse gas emissions from urban regions: microsimulation of land use and transport patterns in Austin, Texas," Journal of Transport Geography, Elsevier, vol. 33(C), pages 220-229.
    5. Beckman, Richard J. & Baggerly, Keith A. & McKay, Michael D., 1996. "Creating synthetic baseline populations," Transportation Research Part A: Policy and Practice, Elsevier, vol. 30(6), pages 415-429, November.
    6. P Williamson & M Birkin & P H Rees, 1998. "The Estimation of Population Microdata by Using Data from Small Area Statistics and Samples of Anonymised Records," Environment and Planning A, , vol. 30(5), pages 785-816, May.
    7. Endo, Yushi & Takemura, Akimichi, 2009. "Iterative proportional scaling via decomposable submodels for contingency tables," Computational Statistics & Data Analysis, Elsevier, vol. 53(4), pages 966-978, February.
    8. Badsberg, J. H. & Malvestuto, F. M., 2001. "An implementation of the iterative proportional fitting procedure by propagation trees," Computational Statistics & Data Analysis, Elsevier, vol. 37(3), pages 297-322, September.
    9. Yasmin, Farhana & Morency, Catherine & Roorda, Matthew J., 2015. "Assessment of spatial transferability of an activity-based model, TASHA," Transportation Research Part A: Policy and Practice, Elsevier, vol. 78(C), pages 200-213.
    10. Daniel C. Knudsen & A. Stewart Fotheringham, 1986. "Matrix Comparison, Goodness-of-Fit, and Spatial Interaction Modeling," International Regional Science Review, , vol. 10(2), pages 127-147, August.
    11. Floriana Gargiulo & Sônia Ternes & Sylvie Huet & Guillaume Deffuant, 2010. "An Iterative Approach for Generating Statistically Realistic Populations of Households," PLOS ONE, Public Library of Science, vol. 5(1), pages 1-9, January.
    12. Rich, Jeppe & Mulalic, Ismir, 2012. "Generating synthetic baseline populations from register data," Transportation Research Part A: Policy and Practice, Elsevier, vol. 46(3), pages 467-479.
    13. Nicholas Geard & James M McCaw & Alan Dorin & Kevin B Korb & Jodie McVernon, 2013. "Synthetic Population Dynamics: A Model of Household Demography," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 16(1), pages 1-8.
    14. Johan Barthelemy & Philippe Toint, 2015. "A Stochastic and Flexible Activity Based Model for Large Population. Application to Belgium," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 18(3), pages 1-15.
    15. Visser, Ingmar & Speekenbrink, Maarten, 2010. "depmixS4: An R Package for Hidden Markov Models," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 36(i07).
    16. Farooq, Bilal & Bierlaire, Michel & Hurtubia, Ricardo & Flötteröd, Gunnar, 2013. "Simulation based population synthesis," Transportation Research Part B: Methodological, Elsevier, vol. 58(C), pages 243-263.
    17. Johan Barthelemy & Philippe L. Toint, 2013. "Synthetic Population Generation Without a Sample," Transportation Science, INFORMS, vol. 47(2), pages 266-279, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nicholas Fournier & Eleni Christofa & Arun Prakash Akkinepally & Carlos Lima Azevedo, 2021. "Integrated population synthesis and workplace assignment using an efficient optimization-based person-household matching method," Transportation, Springer, vol. 48(2), pages 1061-1087, April.
    2. Jason Hawkins & Khandker Nurul Habib, 2023. "A multi-source data fusion framework for joint population, expenditure, and time use synthesis," Transportation, Springer, vol. 50(4), pages 1323-1346, August.
    3. Saadi, Ismaïl & Mustafa, Ahmed & Teller, Jacques & Cools, Mario, 2018. "Investigating the impact of river floods on travel demand based on an agent-based modeling approach: The case of Liège, Belgium," Transport Policy, Elsevier, vol. 67(C), pages 102-110.
    4. Martin Johnsen & Oliver Brandt & Sergio Garrido & Francisco C. Pereira, 2020. "Population synthesis for urban resident modeling using deep generative models," Papers 2011.06851, arXiv.org.
    5. Jian Liu & Xiaosu Ma & Yi Zhu & Jing Li & Zong He & Sheng Ye, 2021. "Generating and Visualizing Spatially Disaggregated Synthetic Population Using a Web-Based Geospatial Service," Sustainability, MDPI, vol. 13(3), pages 1-16, February.
    6. Stanislav S. Borysov & Jeppe Rich, 2021. "Introducing synthetic pseudo panels: application to transport behaviour dynamics," Transportation, Springer, vol. 48(5), pages 2493-2520, October.
    7. Yu Han & Changjie Chen & Zhong-Ren Peng & Pallab Mozumder, 2022. "Evaluating impacts of coastal flooding on the transportation system using an activity-based travel demand model: a case study in Miami-Dade County, FL," Transportation, Springer, vol. 49(1), pages 163-184, February.
    8. Sun, Lijun & Erath, Alexander & Cai, Ming, 2018. "A hierarchical mixture modeling framework for population synthesis," Transportation Research Part B: Methodological, Elsevier, vol. 114(C), pages 199-212.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ma, Lu & Srinivasan, Sivaramakrishnan, 2016. "An empirical assessment of factors affecting the accuracy of target-year synthetic populations," Transportation Research Part A: Policy and Practice, Elsevier, vol. 85(C), pages 247-264.
    2. Sun, Lijun & Erath, Alexander & Cai, Ming, 2018. "A hierarchical mixture modeling framework for population synthesis," Transportation Research Part B: Methodological, Elsevier, vol. 114(C), pages 199-212.
    3. Nicholas Fournier & Eleni Christofa & Arun Prakash Akkinepally & Carlos Lima Azevedo, 2021. "Integrated population synthesis and workplace assignment using an efficient optimization-based person-household matching method," Transportation, Springer, vol. 48(2), pages 1061-1087, April.
    4. Andrew Bwambale & Charisma F. Choudhury & Stephane Hess & Md. Shahadat Iqbal, 2021. "Getting the best of both worlds: a framework for combining disaggregate travel survey data and aggregate mobile phone data for trip generation modelling," Transportation, Springer, vol. 48(5), pages 2287-2314, October.
    5. Farooq, Bilal & Bierlaire, Michel & Hurtubia, Ricardo & Flötteröd, Gunnar, 2013. "Simulation based population synthesis," Transportation Research Part B: Methodological, Elsevier, vol. 58(C), pages 243-263.
    6. Suesse Thomas & Namazi-Rad Mohammad-Reza & Mokhtarian Payam & Barthélemy Johan, 2017. "Estimating Cross-Classified Population Counts of Multidimensional Tables: An Application to Regional Australia to Obtain Pseudo-Census Counts," Journal of Official Statistics, Sciendo, vol. 33(4), pages 1021-1050, December.
    7. Yu Han & Changjie Chen & Zhong-Ren Peng & Pallab Mozumder, 2022. "Evaluating impacts of coastal flooding on the transportation system using an activity-based travel demand model: a case study in Miami-Dade County, FL," Transportation, Springer, vol. 49(1), pages 163-184, February.
    8. Trond Husby & Olga Ivanova & Mark Thissen, 2018. "Simulating the Joint Distribution of Individuals, Households and Dwellings in Small Areas," International Journal of Microsimulation, International Microsimulation Association, vol. 11(2), pages 169-190.
    9. Jian Liu & Xiaosu Ma & Yi Zhu & Jing Li & Zong He & Sheng Ye, 2021. "Generating and Visualizing Spatially Disaggregated Synthetic Population Using a Web-Based Geospatial Service," Sustainability, MDPI, vol. 13(3), pages 1-16, February.
    10. He, Brian Y. & Zhou, Jinkai & Ma, Ziyi & Chow, Joseph Y.J. & Ozbay, Kaan, 2020. "Evaluation of city-scale built environment policies in New York City with an emerging-mobility-accessible synthetic population," Transportation Research Part A: Policy and Practice, Elsevier, vol. 141(C), pages 444-467.
    11. Lovelace, Robin & Ballas, Dimitris & Watson, Matt, 2014. "A spatial microsimulation approach for the analysis of commuter patterns: from individual to regional levels," Journal of Transport Geography, Elsevier, vol. 34(C), pages 282-296.
    12. Nejad, Mohammad Motalleb & Erdogan, Sevgi & Cirillo, Cinzia, 2021. "A statistical approach to small area synthetic population generation as a basis for carless evacuation planning," Journal of Transport Geography, Elsevier, vol. 90(C).
    13. ANTONI Jean-Philippe & VUIDEL Gilles & KLEIN Olivier, 2017. "Generating a located synthetic population of individuals, households, and dwellings," LISER Working Paper Series 2017-07, Luxembourg Institute of Socio-Economic Research (LISER).
    14. Xu, Ping-Feng & Sun, Jubo & Shan, Na, 2016. "Local computations of the iterative proportional scaling procedure for hierarchical models," Computational Statistics & Data Analysis, Elsevier, vol. 95(C), pages 17-23.
    15. Stefano Guarino & Enrico Mastrostefano & Massimo Bernaschi & Alessandro Celestini & Marco Cianfriglia & Davide Torre & Lena Rebecca Zastrow, 2021. "Inferring Urban Social Networks from Publicly Available Data," Future Internet, MDPI, vol. 13(5), pages 1-45, April.
    16. Boakye, Jessica & Guidotti, Roberto & Gardoni, Paolo & Murphy, Colleen, 2022. "The role of transportation infrastructure on the impact of natural hazards on communities," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    17. Lopes, Mafalda Mendes & Moura, Filipe & Martinez, Luis M., 2014. "A rule-based approach for determining the plausible universe of electric vehicle buyers in the Lisbon Metropolitan Area," Transportation Research Part A: Policy and Practice, Elsevier, vol. 59(C), pages 22-36.
    18. Claudio Nägeli & Liane Thuvander & Holger Wallbaum & Rebecca Cachia & Sebastian Stortecky & Ali Hainoun, 2022. "Methodologies for Synthetic Spatial Building Stock Modelling: Data-Availability-Adapted Approaches for the Spatial Analysis of Building Stock Energy Demand," Energies, MDPI, vol. 15(18), pages 1-18, September.
    19. David Pritchard & Eric Miller, 2012. "Advances in population synthesis: fitting many attributes per agent and fitting to household and person margins simultaneously," Transportation, Springer, vol. 39(3), pages 685-704, May.
    20. Jason Hawkins & Khandker Nurul Habib, 2023. "A multi-source data fusion framework for joint population, expenditure, and time use synthesis," Transportation, Springer, vol. 50(4), pages 1323-1346, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:transb:v:90:y:2016:i:c:p:1-21. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/548/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.