Comprehensive Review of Various Verification and Validation Techniques for Business Simulation Models
Author
Abstract
Suggested Citation
Download full text from publisher
References listed on IDEAS
- Jack P. C. Kleijnen & Russell C. H. Cheng & Bert Bettonvil, 2001. "Validation of Trace-Driven Simulation Models: Bootstrap Tests," Management Science, INFORMS, vol. 47(11), pages 1533-1538, November.
- Kleijnen, Jack P.C. & Deflandre, David, 2006. "Validation of regression metamodels in simulation: Bootstrap approach," European Journal of Operational Research, Elsevier, vol. 170(1), pages 120-131, April.
- Aria, Massimo & Cuccurullo, Corrado, 2017. "bibliometrix: An R-tool for comprehensive science mapping analysis," Journal of Informetrics, Elsevier, vol. 11(4), pages 959-975.
- Jack P. C. Kleijnen & Wim C. M. van Beers, 2022.
"Statistical Tests for Cross-Validation of Kriging Models,"
INFORMS Journal on Computing, INFORMS, vol. 34(1), pages 607-621, January.
- Kleijnen, Jack & van Beers, W.C.M., 2019. "Statistical Tests for Cross-Validation of Kriging Models," Other publications TiSEM 35fba511-2931-47d5-a9ba-3, Tilburg University, School of Economics and Management.
- Kleijnen, Jack & van Beers, W.C.M., 2019. "Statistical Tests for Cross-Validation of Kriging Models," Discussion Paper 2019-022, Tilburg University, Center for Economic Research.
- Barlas, Yaman, 1989. "Multiple tests for validation of system dynamics type of simulation models," European Journal of Operational Research, Elsevier, vol. 42(1), pages 59-87, September.
- Kleijnen, Jack P. C., 1995.
"Verification and validation of simulation models,"
European Journal of Operational Research, Elsevier, vol. 82(1), pages 145-162, April.
- Kleijnen, J.P.C., 1992. "Verification and validation of simulation models," Other publications TiSEM cb477373-4711-405d-b712-3, Tilburg University, School of Economics and Management.
- Kleijnen, J.P.C., 1992. "Verification and validation of simulation models," Research Memorandum FEW 542, Tilburg University, School of Economics and Management.
- Harper, Alison & Mustafee, Navonil & Yearworth, Mike, 2021. "Facets of trust in simulation studies," European Journal of Operational Research, Elsevier, vol. 289(1), pages 197-213.
- Dery, Richard & Landry, Maurice & Banville, Claude, 1993. "Revisiting the issue of model validation in OR: An epistemological view," European Journal of Operational Research, Elsevier, vol. 66(2), pages 168-183, April.
- Yongxin Liao & Fernando Deschamps & Eduardo de Freitas Rocha Loures & Luiz Felipe Pierin Ramos, 2017. "Past, present and future of Industry 4.0 - a systematic literature review and research agenda proposal," International Journal of Production Research, Taylor & Francis Journals, vol. 55(12), pages 3609-3629, June.
- Kleijnen, Jack P.C., 2009.
"Kriging metamodeling in simulation: A review,"
European Journal of Operational Research, Elsevier, vol. 192(3), pages 707-716, February.
- Kleijnen, J.P.C., 2007. "Kriging Metamodeling in Simulation : A Review," Discussion Paper 2007-13, Tilburg University, Center for Economic Research.
- Kleijnen, J.P.C., 2007. "Kriging Metamodeling in Simulation : A Review," Other publications TiSEM 29d6926e-c381-4b58-ae58-8, Tilburg University, School of Economics and Management.
- Kleijnen, Jack P. C., 1983.
"Cross-validation using the t statistic,"
European Journal of Operational Research, Elsevier, vol. 13(2), pages 133-141, June.
- Kleijnen, J.P.C., 1981. "Cross-validation using the t statistic," Research Memorandum FEW 100, Tilburg University, School of Economics and Management.
- Kleijnen, J.P.C., 1981. "Cross-validation using the t statistic," Other publications TiSEM a0f1d641-dfb5-4b46-b739-9, Tilburg University, School of Economics and Management.
- Onggo, Bhakti Stephan & Karatas, Mumtaz, 2016. "Test-driven simulation modelling: A case study using agent-based maritime search-operation simulation," European Journal of Operational Research, Elsevier, vol. 254(2), pages 517-531.
- Ö Gürcan & O Dikenelli & C Bernon, 2013. "A generic testing framework for agent-based simulation models," Journal of Simulation, Taylor & Francis Journals, vol. 7(3), pages 183-201, August.
- Mustafa Hekimoğlu & Yaman Barlas & Luis Luna-Reyes, 2016. "Sensitivity analysis for models with multiple behavior modes: a method based on behavior pattern measures," System Dynamics Review, System Dynamics Society, vol. 32(3-4), pages 332-362, July.
- Tako, Antuela A. & Robinson, Stewart, 2010. "Model development in discrete-event simulation and system dynamics: An empirical study of expert modellers," European Journal of Operational Research, Elsevier, vol. 207(2), pages 784-794, December.
- Mekhail Mustak & Joni Salminen & Loïc Plé & Jochen Wirtz, 2021. "Artificial intelligence in marketing: Topic modeling, scientometric analysis, and research agenda," Post-Print hal-03269994, HAL.
- Nees Jan Eck & Ludo Waltman, 2010. "Software survey: VOSviewer, a computer program for bibliometric mapping," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(2), pages 523-538, August.
- Dimitris Mourtzis, 2020. "Simulation in the design and operation of manufacturing systems: state of the art and new trends," International Journal of Production Research, Taylor & Francis Journals, vol. 58(7), pages 1927-1949, April.
- Vishwas Dohale & Angappa Gunasekaran & Milind Madhukarro Akarte & Priyanka Verma, 2022. "52 Years of manufacturing strategy: an evolutionary review of literature (1969–2021)," International Journal of Production Research, Taylor & Francis Journals, vol. 60(2), pages 569-594, January.
- Kleijnen, J.P.C., 1995.
"Statistical validation of simulation models : A case study,"
Discussion Paper
1995-42, Tilburg University, Center for Economic Research.
- Kleijnen, J.P.C., 1995. "Statistical validation of simulation models : A case study," Other publications TiSEM 4da192cf-c3f4-40a4-aea4-5, Tilburg University, School of Economics and Management.
- Landry, Maurice & Malouin, Jean-Louis & Oral, Muhittin, 1983. "Model validation in operations research," European Journal of Operational Research, Elsevier, vol. 14(3), pages 207-220, November.
- Foivos Psarommatis & Gokan May, 2023. "A literature review and design methodology for digital twins in the era of zero defect manufacturing," International Journal of Production Research, Taylor & Francis Journals, vol. 61(16), pages 5723-5743, August.
- Stewart Robinson, 2020. "Conceptual modelling for simulation: Progress and grand challenges," Journal of Simulation, Taylor & Francis Journals, vol. 14(1), pages 1-20, January.
- Farheen Naz & Rohit Agrawal & Anil Kumar & Angappa Gunasekaran & Abhijit Majumdar & Sunil Luthra, 2022. "Reviewing the applications of artificial intelligence in sustainable supply chains: Exploring research propositions for future directions," Business Strategy and the Environment, Wiley Blackwell, vol. 31(5), pages 2400-2423, July.
- Jack P. C. Kleijnen & Bert Bettonvil & Willem Van Groenendaal, 1998. "Validation of Trace-Driven Simulation Models: A Novel Regression Test," Management Science, INFORMS, vol. 44(6), pages 812-819, June.
- Pau Fonseca i Casas, 2023. "A Continuous Process for Validation, Verification, and Accreditation of Simulation Models," Mathematics, MDPI, vol. 11(4), pages 1-25, February.
- Brailsford, Sally C. & Eldabi, Tillal & Kunc, Martin & Mustafee, Navonil & Osorio, Andres F., 2019. "Hybrid simulation modelling in operational research: A state-of-the-art review," European Journal of Operational Research, Elsevier, vol. 278(3), pages 721-737.
- Mustak, Mekhail & Salminen, Joni & Plé, Loïc & Wirtz, Jochen, 2021. "Artificial intelligence in marketing: Topic modeling, scientometric analysis, and research agenda," Journal of Business Research, Elsevier, vol. 124(C), pages 389-404.
- Mert Edali, 2022. "Pattern‐oriented analysis of system dynamics models via random forests," System Dynamics Review, System Dynamics Society, vol. 38(2), pages 135-166, April.
- Kleijnen, Jack P. C., 1995. "Statistical validation of simulation models," European Journal of Operational Research, Elsevier, vol. 87(1), pages 21-34, November.
- Yu Han & Woon Kian Chong & Dong Li, 2020. "A systematic literature review of the capabilities and performance metrics of supply chain resilience," International Journal of Production Research, Taylor & Francis Journals, vol. 58(15), pages 4541-4566, July.
- Robinson, Stewart, 2002. "General concepts of quality for discrete-event simulation," European Journal of Operational Research, Elsevier, vol. 138(1), pages 103-117, April.
- Thomas H. Naylor & J. M. Finger, 1967. "Verification of Computer Simulation Models," Management Science, INFORMS, vol. 14(2), pages 92-101, October.
- Troost, Christian & Huber, Robert & Bell, Andrew R. & van Delden, Hedwig & Filatova, Tatiana & Le, Quang Bao & Lippe, Melvin & Niamir, Leila & Polhill, J. Gareth & Sun, Zhanli & Berger, Thomas, 2023. "How to keep it adequate: A protocol for ensuring validity in agent-based simulation," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 159, pages 1-21.
- J Pousi & J Poropudas & K Virtanen, 2013. "Simulation metamodelling with Bayesian networks," Journal of Simulation, Taylor & Francis Journals, vol. 7(4), pages 297-311, November.
- R G Sargent, 2015. "An interval statistical procedure for use in validation of simulation models," Journal of Simulation, Taylor & Francis Journals, vol. 9(3), pages 232-237, August.
- Kamil Erkan Kabak & Johannes Hinckeldeyn & Rob Dekkers, 2024. "A systematic literature review into simulation for building operations management theory: reaching beyond positivism?," Journal of Simulation, Taylor & Francis Journals, vol. 18(5), pages 687-715, September.
- R G Sargent, 2013. "Verification and validation of simulation models," Journal of Simulation, Taylor & Francis Journals, vol. 7(1), pages 12-24, February.
- Oral, Muhittin & Kettani, Ossama, 1993. "The facets of the modeling and validation process in operations research," European Journal of Operational Research, Elsevier, vol. 66(2), pages 216-234, April.
- W C M van Beers & J P C Kleijnen, 2003.
"Kriging for interpolation in random simulation,"
Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(3), pages 255-262, March.
- van Beers, W.C.M. & Kleijnen, J.P.C., 2001. "Kriging for Interpolation in Random Simulation," Other publications TiSEM e007110c-e224-484d-92f0-c, Tilburg University, School of Economics and Management.
- van Beers, W.C.M. & Kleijnen, J.P.C., 2001. "Kriging for Interpolation in Random Simulation," Discussion Paper 2001-74, Tilburg University, Center for Economic Research.
- Sheldon H. Jacobson & Enver Yücesan, 1999. "On the Complexity of Verifying Structural Properties of Discrete Event Simulation Models," Operations Research, INFORMS, vol. 47(3), pages 476-481, June.
- Kleijnen, Jack P. C. & Sargent, Robert G., 2000.
"A methodology for fitting and validating metamodels in simulation,"
European Journal of Operational Research, Elsevier, vol. 120(1), pages 14-29, January.
- Kleijnen, J.P.C. & Sargent, R., 1997. "A Methodology for Fitting and Validating Metamodels in Simulation," Other publications TiSEM b8c2217c-f02c-4786-b704-7, Tilburg University, School of Economics and Management.
- Kleijnen, J.P.C. & Sargent, R., 1997. "A Methodology for Fitting and Validating Metamodels in Simulation," Discussion Paper 1997-116, Tilburg University, Center for Economic Research.
- Landry, Maurice & Oral, Muhittin, 1993. "In search of a valid view of model validation for operations research," European Journal of Operational Research, Elsevier, vol. 66(2), pages 161-167, April.
- Strang, Kenneth David, 2012. "Importance of verifying queue model assumptions before planning with simulation software," European Journal of Operational Research, Elsevier, vol. 218(2), pages 493-504.
- Jahangirian, Mohsen & Eldabi, Tillal & Naseer, Aisha & Stergioulas, Lampros K. & Young, Terry, 2010. "Simulation in manufacturing and business: A review," European Journal of Operational Research, Elsevier, vol. 203(1), pages 1-13, May.
- Kleijnen, Jack P.C., 2017.
"Regression and Kriging metamodels with their experimental designs in simulation: A review,"
European Journal of Operational Research, Elsevier, vol. 256(1), pages 1-16.
- Kleijnen, J.P.C., 2015. "Regression and Kriging Metamodels with Their Experimental Designs in Simulation : Review," Other publications TiSEM c592e895-1656-43c3-8c7e-f, Tilburg University, School of Economics and Management.
- Kleijnen, J.P.C., 2015. "Regression and Kriging Metamodels with Their Experimental Designs in Simulation : Review," Discussion Paper 2015-035, Tilburg University, Center for Economic Research.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Arnold Reisman & Muhittin Oral, 2005. "Soft Systems Methodology: A Context Within a 50-Year Retrospective of OR/MS," Interfaces, INFORMS, vol. 35(2), pages 164-178, April.
- Kleijnen, J.P.C., 2006.
"Regression Models and Experimental Designs : A Tutorial for Simulation Analaysts,"
Other publications TiSEM
7b8ecddb-f49e-4b80-865b-a, Tilburg University, School of Economics and Management.
- Kleijnen, J.P.C., 2006. "Regression Models and Experimental Designs : A Tutorial for Simulation Analaysts," Discussion Paper 2006-10, Tilburg University, Center for Economic Research.
- Janová, Jitka & Hampel, David & Nerudová, Danuše, 2019. "Design and validation of a tax sustainability index," European Journal of Operational Research, Elsevier, vol. 278(3), pages 916-926.
- Jack P. C. Kleijnen & Susan M. Sanchez & Thomas W. Lucas & Thomas M. Cioppa, 2005. "State-of-the-Art Review: A User’s Guide to the Brave New World of Designing Simulation Experiments," INFORMS Journal on Computing, INFORMS, vol. 17(3), pages 263-289, August.
- Zhao Zhi-hong & Wei Zi-yi & Yao Shan-ji, 2025. "How Entrepreneurship University Enhances Digital Opportunities? Evidences from Bibliometric and Topic Modeling," SAGE Open, , vol. 15(3), pages 21582440251, August.
- Strang, Kenneth David, 2012. "Importance of verifying queue model assumptions before planning with simulation software," European Journal of Operational Research, Elsevier, vol. 218(2), pages 493-504.
- Ilan Halachmi & Yitzhak Simon & Noam Mozes, 2014. "Simulation of the shift from marine netcages to inland recirculating aquaculture systems," Annals of Operations Research, Springer, vol. 219(1), pages 85-99, August.
- Kleijnen, Jack P. C. & Sargent, Robert G., 2000.
"A methodology for fitting and validating metamodels in simulation,"
European Journal of Operational Research, Elsevier, vol. 120(1), pages 14-29, January.
- Kleijnen, J.P.C. & Sargent, R., 1997. "A Methodology for Fitting and Validating Metamodels in Simulation," Other publications TiSEM b8c2217c-f02c-4786-b704-7, Tilburg University, School of Economics and Management.
- Kleijnen, J.P.C. & Sargent, R., 1997. "A Methodology for Fitting and Validating Metamodels in Simulation," Discussion Paper 1997-116, Tilburg University, Center for Economic Research.
- Halachmi, I. & Dzidic, A. & Metz, J. H. M. & Speelman, L. & Dijkhuizen, A. A. & Kleijnen, J. P. C., 2001. "Validation of simulation model for robotic milking barn design," European Journal of Operational Research, Elsevier, vol. 134(3), pages 677-688, November.
- Robinson, Stewart, 2002. "General concepts of quality for discrete-event simulation," European Journal of Operational Research, Elsevier, vol. 138(1), pages 103-117, April.
- Donthu, Naveen & Kumar, Satish & Mukherjee, Debmalya & Pandey, Nitesh & Lim, Weng Marc, 2021. "How to conduct a bibliometric analysis: An overview and guidelines," Journal of Business Research, Elsevier, vol. 133(C), pages 285-296.
- Mariani, Marcello M. & Hashemi, Novin & Wirtz, Jochen, 2023. "Artificial intelligence empowered conversational agents: A systematic literature review and research agenda," Journal of Business Research, Elsevier, vol. 161(C).
- Manuel Muth & Michael Lingenfelder & Gerd Nufer, 2025. "The application of machine learning for demand prediction under macroeconomic volatility: a systematic literature review," Management Review Quarterly, Springer, vol. 75(3), pages 2759-2802, September.
- Giacomo Zatini, 2025. "Conditions of use and impacts of artificial intelligence in marketing practices: a mixed-method literature review," Italian Journal of Marketing, Springer, vol. 2025(3), pages 293-329, September.
- Kleijnen, J.P.C. & Sanchez, S.M. & Lucas, T.W. & Cioppa, T.M., 2003.
"A User's Guide to the Brave New World of Designing Simulation Experiments,"
Discussion Paper
2003-1, Tilburg University, Center for Economic Research.
- Kleijnen, J.P.C. & Sanchez, S.M. & Lucas, T.W. & Cioppa, T.M., 2003. "A User's Guide to the Brave New World of Designing Simulation Experiments," Other publications TiSEM a6910d11-f9bc-4246-b1a7-2, Tilburg University, School of Economics and Management.
- Mert Edali & Gönenç Yücel, 2020. "Analysis of an individual‐based influenza epidemic model using random forest metamodels and adaptive sequential sampling," Systems Research and Behavioral Science, Wiley Blackwell, vol. 37(6), pages 936-958, November.
- Kleijnen, Jack P. C., 1995.
"Verification and validation of simulation models,"
European Journal of Operational Research, Elsevier, vol. 82(1), pages 145-162, April.
- Kleijnen, J.P.C., 1992. "Verification and validation of simulation models," Other publications TiSEM cb477373-4711-405d-b712-3, Tilburg University, School of Economics and Management.
- Kleijnen, J.P.C., 1992. "Verification and validation of simulation models," Research Memorandum FEW 542, Tilburg University, School of Economics and Management.
- C W Olphert & J M Wilson, 2004. "Validation of decision-aiding spreadsheets: the influence of contingency factors," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(1), pages 12-22, January.
- Harper, Alison & Mustafee, Navonil & Yearworth, Mike, 2021. "Facets of trust in simulation studies," European Journal of Operational Research, Elsevier, vol. 289(1), pages 197-213.
- Tobias Reisberger & Philip Reisberger & Lukáš Copuš & Peter Madzík & Lukáš Falát, 2025. "The Linkage Between Digital Transformation and Organizational Culture: Novel Machine Learning Literature Review Based on Latent Dirichlet Allocation," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 16(1), pages 2082-2118, March.
More about this item
Keywords
; ; ; ;NEP fields
This paper has been announced in the following NEP Reports:- NEP-CMP-2026-04-20 (Computational Economics)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:esprep:339750. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/zbwkide.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.
Printed from https://ideas.repec.org/p/zbw/esprep/339750.html