The Devil is in the Detail: Hints for Practical Optimisation
AbstractFinding the minimum of an objective function, such as a least squares or negative log-likelihood function, with respect to the unknown model parameters is a problem often encountered in econometrics. Consequently, students of econometrics and applied econometricians are usually well-grounded in the broad differences between the numerical procedures employed to solve these problems. Often, however, relatively little time is given to understanding the practical subtleties of implementing these schemes when faced with illbehaved problems. This paper addresses some of the details involved in practical optimisation, such as dealing with constraints on the parameters, specifying starting values, termination criteria and analytical gradients, and illustrates some of the general ideas with several instructive examples.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by National Centre for Econometric Research in its series NCER Working Paper Series with number 32.
Length: 26 pages
Date of creation: 18 Aug 2008
Date of revision:
gradient algorithms; unconstrained optimisation; generalised method of moments.;
Other versions of this item:
- Christensen, T.M. & Hurn, A.S. & Lindsay, K.A., 2008. "The Devil is in the Detail: Hints for Practical Optimisation," Economic Analysis and Policy (EAP), Queensland University of Technology (QUT), School of Economics and Finance, vol. 38(2), pages 345-368, September.
- C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
- C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
This paper has been announced in the following NEP Reports:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Newey, Whitney K & West, Kenneth D, 1987.
"A Simple, Positive Semi-definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix,"
Econometric Society, vol. 55(3), pages 703-08, May.
- Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Publishing House "SINERGIA PRESS", vol. 33(1), pages 125-132.
- Whitney K. Newey & Kenneth D. West, 1986. "A Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix," NBER Technical Working Papers 0055, National Bureau of Economic Research, Inc.
- Chan, K C, et al, 1992.
" An Empirical Comparison of Alternative Models of the Short-Term Interest Rate,"
Journal of Finance,
American Finance Association, vol. 47(3), pages 1209-27, July.
- Tom Doan, . "RATS programs to replicate CKLS(1992) estimation of interest rate models," Statistical Software Components RTZ00035, Boston College Department of Economics.
- Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-54, July.
- E.K. Berndt & B.H. Hall & R.E. Hall, 1974. "Estimation and Inference in Nonlinear Structural Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 3, number 4, pages 103-116 National Bureau of Economic Research, Inc.
- Cox, John C & Ingersoll, Jonathan E, Jr & Ross, Stephen A, 1985. "A Theory of the Term Structure of Interest Rates," Econometrica, Econometric Society, vol. 53(2), pages 385-407, March.
- John Freebairn & Bill Griffiths, 2006. "Introduction," The Economic Record, The Economic Society of Australia, vol. 82(s1), pages S1-S1, 09.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (School of Economics and Finance) The email address of this maintainer does not seem to be valid anymore. Please ask School of Economics and Finance to update the entry or send us the correct address.
If references are entirely missing, you can add them using this form.