The Devil is in the Detail: Hints for Practical Optimisation
Finding the minimum of an objective function, such as a least squares or negative log-likelihood function, with respect to the unknown model parameters is a problem often encountered in econometrics. Consequently, students of econometrics and applied econometricians are usually well-grounded in the broad differences between the numerical procedures employed to solve these problems. Often, however, relatively little time is given to understanding the practical subtleties of implementing these schemes when faced with illbehaved problems. This paper addresses some of the details involved in practical optimisation, such as dealing with constraints on the parameters, specifying starting values, termination criteria and analytical gradients, and illustrates some of the general ideas with several instructive examples.
|Date of creation:||18 Aug 2008|
|Date of revision:|
|Contact details of provider:|| Phone: 07 3138 5066|
Fax: 07 3138 1500
Web page: http://www.ncer.edu.au
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Ernst R. Berndt & Bronwyn H. Hall & Robert E. Hall & Jerry A. Hausman, 1974. "Estimation and Inference in Nonlinear Structural Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 3, number 4, pages 653-665 National Bureau of Economic Research, Inc.
- Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-54, July.
- Newey, Whitney K & West, Kenneth D, 1987.
"A Simple, Positive Semi-definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix,"
Econometric Society, vol. 55(3), pages 703-08, May.
- Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Publishing House "SINERGIA PRESS", vol. 33(1), pages 125-132.
- Whitney K. Newey & Kenneth D. West, 1986. "A Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix," NBER Technical Working Papers 0055, National Bureau of Economic Research, Inc.
- Chan, K C, et al, 1992.
" An Empirical Comparison of Alternative Models of the Short-Term Interest Rate,"
Journal of Finance,
American Finance Association, vol. 47(3), pages 1209-27, July.
- Tom Doan, . "RATS programs to replicate CKLS(1992) estimation of interest rate models," Statistical Software Components RTZ00035, Boston College Department of Economics.
- Cox, John C & Ingersoll, Jonathan E, Jr & Ross, Stephen A, 1985. "A Theory of the Term Structure of Interest Rates," Econometrica, Econometric Society, vol. 53(2), pages 385-407, March.
- John Freebairn & Bill Griffiths, 2006. "Introduction," The Economic Record, The Economic Society of Australia, vol. 82(s1), pages S1-S1, 09.
When requesting a correction, please mention this item's handle: RePEc:qut:auncer:2008-21. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (School of Economics and Finance)
If references are entirely missing, you can add them using this form.