IDEAS home Printed from https://ideas.repec.org/a/eee/enepol/v38y2010i5p2216-2224.html
   My bibliography  Save this article

How to do structural validity of a system dynamics type simulation model: The case of an energy policy model

Author

Listed:
  • Qudrat-Ullah, Hassan
  • Seong, Baek Seo

Abstract

System dynamics based simulation models are becoming increasingly popular in the analysis of important energy policy issues including global warming, deregulation, conservation and efficiency. The usefulness of these models is predicated on their ability to link observable patterns of behavior of a system to micro-level structures. This paper argues that the structural validity of the simulation model--right behavior for the right reasons--is a stringent measure to build confidence in a simulation model regardless of how well the model passes behavior validity tests. That leads to an outline of formal structural validity procedures available but less explored in system dynamics modeling 'repertoire'. An illustration of a set of six tests for structural validity of a system dynamics model for energy policy analysis follows. Then using Theil inequality statistics, the behavior validity of the model is also tested. Finally, some conclusions on the increased appeal for simulation models for energy policy analysis and design are presented.

Suggested Citation

  • Qudrat-Ullah, Hassan & Seong, Baek Seo, 2010. "How to do structural validity of a system dynamics type simulation model: The case of an energy policy model," Energy Policy, Elsevier, vol. 38(5), pages 2216-2224, May.
    • Handle: RePEc:eee:enepol:v:38:y:2010:i:5:p:2216-2224
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0301-4215(09)00946-X
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Barlas, Yaman, 1989. "Multiple tests for validation of system dynamics type of simulation models," European Journal of Operational Research, Elsevier, vol. 42(1), pages 59-87, September.
    2. Qudrat-Ullah, H & Davidsen, Pal I, 2001. "Understanding the dynamics of electricity supply, resources and pollution: Pakistan's case," Energy, Elsevier, vol. 26(6), pages 595-606.
    3. Bunn, Derek W. & Larsen, Erik R., 1992. "Sensitivity of reserve margin to factors influencing investment behaviour in the electricity market of England and Wales," Energy Policy, Elsevier, vol. 20(5), pages 420-429, May.
    4. Richard L. Van Horn, 1971. "Validation of Simulation Results," Management Science, INFORMS, vol. 17(5), pages 247-258, January.
    5. Oliva, Rogelio, 2003. "Model calibration as a testing strategy for system dynamics models," European Journal of Operational Research, Elsevier, vol. 151(3), pages 552-568, December.
    6. George B. Kleindorfer & Liam O'Neill & Ram Ganeshan, 1998. "Validation in Simulation: Various Positions in the Philosophy of Science," Management Science, INFORMS, vol. 44(8), pages 1087-1099, August.
    7. Hassan Qudrat-Ullah, 2005. "MDESRAP: a model for understanding the dynamics of electricity supply, resources and pollution," International Journal of Global Energy Issues, Inderscience Enterprises Ltd, vol. 23(1), pages 1-14.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qudrat-Ullah, Hassan, 2015. "Independent power (or pollution) producers? Electricity reforms and IPPs in Pakistan," Energy, Elsevier, vol. 83(C), pages 240-251.
    2. Qudrat-Ullah, Hassan, 2014. "Green power in Ontario: A dynamic model-based analysis," Energy, Elsevier, vol. 77(C), pages 859-870.
    3. Abada, Ibrahim & Briat, Vincent & Massol, Olivier, 2013. "Construction of a fuel demand function portraying interfuel substitution, a system dynamics approach," Energy, Elsevier, vol. 49(C), pages 240-251.
    4. Qudrat-Ullah, Hassan, 2017. "How to enhance the future use of energy policy simulation models through ex post validation," Energy, Elsevier, vol. 120(C), pages 58-66.
    5. Qudrat-Ullah, Hassan, 2022. "A review and analysis of renewable energy policies and CO2 emissions of Pakistan," Energy, Elsevier, vol. 238(PB).
    6. Teufel, Felix & Miller, Michael & Genoese, Massimo & Fichtner, Wolf, 2013. "Review of System Dynamics models for electricity market simulations," Working Paper Series in Production and Energy 2, Karlsruhe Institute of Technology (KIT), Institute for Industrial Production (IIP).
    7. Qudrat-Ullah, Hassan, 2013. "Understanding the dynamics of electricity generation capacity in Canada: A system dynamics approach," Energy, Elsevier, vol. 59(C), pages 285-294.
    8. Saleh, Mohamed & Oliva, Rogelio & Kampmann, Christian Erik & Davidsen, Pål I., 2010. "A comprehensive analytical approach for policy analysis of system dynamics models," European Journal of Operational Research, Elsevier, vol. 203(3), pages 673-683, June.
    9. van Ruijven, Bas & de Vries, Bert & van Vuuren, Detlef P. & van der Sluijs, Jeroen P., 2010. "A global model for residential energy use: Uncertainty in calibration to regional data," Energy, Elsevier, vol. 35(1), pages 269-282.
    10. Oliva, Rogelio, 2003. "Model calibration as a testing strategy for system dynamics models," European Journal of Operational Research, Elsevier, vol. 151(3), pages 552-568, December.
    11. Feng, Y.Y. & Chen, S.Q. & Zhang, L.X., 2013. "System dynamics modeling for urban energy consumption and CO2 emissions: A case study of Beijing, China," Ecological Modelling, Elsevier, vol. 252(C), pages 44-52.
    12. Hasani, Masoud & Hosseini, Seyed Hamid, 2011. "Dynamic assessment of capacity investment in electricity market considering complementary capacity mechanisms," Energy, Elsevier, vol. 36(1), pages 277-293.
    13. Baur, Ivo & Binder, Claudia R., 2015. "Modeling and assessing scenarios of common property pastures management in Switzerland," Ecological Economics, Elsevier, vol. 119(C), pages 292-305.
    14. Turner, Benjamin L., 2020. "Model laboratories: A quick-start guide for design of simulation experiments for dynamic systems models," Ecological Modelling, Elsevier, vol. 434(C).
    15. Benjamin L. Turner & Vincent Tidwell & Alexander Fernald & José A. Rivera & Sylvia Rodriguez & Steven Guldan & Carlos Ochoa & Brian Hurd & Kenneth Boykin & Andres Cibils, 2016. "Modeling Acequia Irrigation Systems Using System Dynamics: Model Development, Evaluation, and Sensitivity Analyses to Investigate Effects of Socio-Economic and Biophysical Feedbacks," Sustainability, MDPI, vol. 8(10), pages 1-30, October.
    16. David C. Lane & Özge Pala & Yaman Barlas & David C. Lane, 2015. "Validity is a Matter of Confidence—But Not Just in System Dynamics," Systems Research and Behavioral Science, Wiley Blackwell, vol. 32(4), pages 450-458, July.
    17. Arnold Reisman & Muhittin Oral, 2005. "Soft Systems Methodology: A Context Within a 50-Year Retrospective of OR/MS," Interfaces, INFORMS, vol. 35(2), pages 164-178, April.
    18. Rogelio Oliva & John D. Sterman, 2001. "Cutting Corners and Working Overtime: Quality Erosion in the Service Industry," Management Science, INFORMS, vol. 47(7), pages 894-914, July.
    19. Ibanez-Lopez, A.S. & Martinez-Val, J.M. & Moratilla-Soria, B.Y., 2017. "A dynamic simulation model for assessing the overall impact of incentive policies on power system reliability, costs and environment," Energy Policy, Elsevier, vol. 102(C), pages 170-188.
    20. Shin, Juneseuk & Shin, Wan-Seon & Lee, Changyong, 2013. "An energy security management model using quality function deployment and system dynamics," Energy Policy, Elsevier, vol. 54(C), pages 72-86.

    More about this item

    Keywords

    Energy Pakistan Structural validity;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:enepol:v:38:y:2010:i:5:p:2216-2224. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/enpol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.