Validation of simulation models : regression analysis revisited

This file is part of IDEAS, which uses RePEc data

Validation of simulation models : regression analysis revisited

Author Info

Kleijnen, J.
Bettonville, B.
Groenendaal, W. van (Tilburg University, Center for Economic Research)

Additional information is available for the following registered author(s):

Abstract

This paper proves that it is wrong to require that regressing a model's outputs on the observed real outcomes gives a 45 degrees line through the origin (unit slope, zero intercept). Therefore this paper proposes an alternative requirement: the responses of the model and the real system should have the same means and the same variances. To test whether this requirement is satisfied, a novel statisti-cal procedure is derived. This procedure regresses the differences of simulated and real responses on their sums. The old and the new procedures are investigated in an extensive Monte Carlo experiment that simulates queueing systems. The conclusions of this experiment are that (i) the old test rejects a valid simulation model substantially more often than the new test does; (ii) the intuitive test shows 'perverse' behavior in a certain domain: the worse the simulation model, the higher its probability of acceptance; and (iii) the novel test does not reject a valid simulation model too often (its type I error probability is correct), provided the queueing response is transformed logarithmically.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

Publisher Info
Paper provided by Tilburg University, Center for Economic Research in its series Discussion Paper with number 7.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length:
Date of creation: 1996
Date of revision:
Handle: RePEc:dgr:kubcen:19967

Contact details of provider:
Web page: http://center.uvt.nl

For technical questions regarding this item, or to correct its listing, contact: (Corry Stuyts).

Other versions of this item:

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

Kleijnen, Jack P. C., 1995. "Verification and validation of simulation models," European Journal of Operational Research, Elsevier, vol. 82(1), pages 145-162, April. [Downloadable!] (restricted)
Harrison, S. R., 1990. "Regression of a model on real-system output: An invalid test of model validity," Agricultural Systems, Elsevier, vol. 34(3), pages 183-190. [Downloadable!] (restricted)

Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)

Kleijnen, J.P.C., 1995. "Statistical validation of simulation models : a case study," Discussion Paper 42, Tilburg University, Center for Economic Research. [Downloadable!]

Statistics

Access and download statistics

Did you know? IDEAS also computes impact factors for journals and working paper series.

This page was last updated on 2009-11-25.

This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.