Higher Order Improvements for Approximate Estimators
Abstract
Many modern estimation methods in econometrics approximate an objective function, through simulation or discretization for instance. The resulting "approximate" estimator is often biased; and it always incurs an efficiency loss. We here propose three methods to improve the properties of such approximate estimators at a low computational cost. The first two methods correct the objective function so as to remove the leading term of the bias due to the approximation. One variant provides an analytical bias adjustment, but it only works for estimators based on stochastic approximators, such as simulation-based estimators. Our second bias correction is based on ideas from the resampling literature; it eliminates the leading bias term for non-stochastic as well as stochastic approximators. Finally, we propose an iterative procedure where we use Newton-Raphson (NR) iterations based on a much finer degree of approximation. The NR step removes some or all of the additional bias and variance of the initial approximate estimator. A Monte Carlo simulation on the mixed logit model shows that noticeable improvements can be obtained rather cheaply.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by University of Copenhagen. Department of Economics. Centre for Applied Microeconometrics in its series CAM Working Papers with number 2010-04.Length: 43 pages
Date of creation: Apr 2010
Date of revision:
Handle: RePEc:kud:kuieca:2010_04
Contact details of provider:
Postal: Øster Farimagsgade 5, Building 26, DK-1353 Copenhagen K., Denmark
Phone: (45) 35 32 30 74
Fax: +45 35 32 30 00
Email:
Web page: http://www.econ.ku.dk/CAM/
More information through EDIRC
Related research
Keywords:Other versions of this item:
- Dennis Kristensen & Bernard Salanie, 2010. "Higher Order Improvements for Approximate Estimators," Discussion Papers 0910-15, Columbia University, Department of Economics.
- NEP-ALL-2010-05-02 (All new papers)
- NEP-ECM-2010-05-02 (Econometrics)
- NEP-ORE-2010-05-02 (Operations Research)
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Rilstone, Paul & Srivastava, V. K. & Ullah, Aman, 1996. "The second-order bias and mean squared error of nonlinear estimators," Journal of Econometrics, Elsevier, vol. 75(2), pages 369-395, December.
- Valentina Corradi & Norman R. Swanson, 2003.
"Evaluation of Dynamic Stochastic General Equilibrium Models Based on Distributional Comparison of Simulated and Historical Data,"
Departmental Working Papers
200320, Rutgers University, Department of Economics.
- Corradi, Valentina & Swanson, Norman R., 2007. "Evaluation of dynamic stochastic general equilibrium models based on distributional comparison of simulated and historical data," Journal of Econometrics, Elsevier, vol. 136(2), pages 699-723, February.
- Donald W.K. Andrews, 2000.
"Equivalence of the Higher-order Asymptotic Efficiency of k-step and Extremum Statistics,"
Cowles Foundation Discussion Papers
1269, Cowles Foundation for Research in Economics, Yale University.
- Andrews, Donald W.K., 2002. "EQUIVALENCE OF THE HIGHER ORDER ASYMPTOTIC EFFICIENCY OF k-STEP AND EXTREMUM STATISTICS," Econometric Theory, Cambridge University Press, vol. 18(05), pages 1040-1085, October.
- Kristensen, Dennis & Shin, Yongseok, 2012.
"Estimation of dynamic models with nonparametric simulated maximum likelihood,"
Journal of Econometrics,
Elsevier, vol. 167(1), pages 76-94.
- Dennis Kristensen & Yongseok Shin, 2008. "Estimation of Dynamic Models with Nonparametric Simulated Maximum Likelihood," CREATES Research Papers 2008-58, School of Economics and Management, University of Aarhus.
- Lee, L-F., 1990.
"On Efficiency of Methods of Simulated Moments and Maximum Simulated Likelihood Estimation of Discrete Response Models,"
Papers
260, Minnesota - Center for Economic Research.
- Lee, Lung-Fei, 1992. "On Efficiency of Methods of Simulated Moments and Maximum Simulated Likelihood Estimation of Discrete Response Models," Econometric Theory, Cambridge University Press, vol. 8(04), pages 518-552, December.
- Dennis Kristensen, 2008.
"Uniform Convergence Rates of Kernel Estimators with Heterogenous, Dependent Data,"
CREATES Research Papers
2008-37, School of Economics and Management, University of Aarhus.
- Kristensen, Dennis, 2009. "Uniform Convergence Rates Of Kernel Estimators With Heterogeneous Dependent Data," Econometric Theory, Cambridge University Press, vol. 25(05), pages 1433-1445, October.
- Duffie, Darrell & Singleton, Kenneth J, 1993. "Simulated Moments Estimation of Markov Models of Asset Prices," Econometrica, Econometric Society, vol. 61(4), pages 929-52, July.
- Xiaohong Chen & Oliver Linton & Ingrid Van Keilegom, 2003.
"Estimation of Semiparametric Models when the Criterion Function is not Smooth,"
STICERD - Econometrics Paper Series
/2003/450, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
- Xiaohong Chen & Oliver Linton & Ingrid Van Keilegom, 2003. "Estimation of Semiparametric Models when the Criterion Function Is Not Smooth," Econometrica, Econometric Society, vol. 71(5), pages 1591-1608, 09.
- Xiaohong Chen & Oliver Linton & Ingred Van Keilegom, 2002. "Estimation of semiparametric models when the criterion function is not smooth," CeMMAP working papers CWP02/02, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Andrews, Donald W K, 1994. "Asymptotics for Semiparametric Econometric Models via Stochastic Equicontinuity," Econometrica, Econometric Society, vol. 62(1), pages 43-72, January.
- Fermanian, Jean-David & Salani , Bernard, 2004. "A Nonparametric Simulated Maximum Likelihood Estimation Method," Econometric Theory, Cambridge University Press, vol. 20(04), pages 701-734, August.
- Christian Gourieroux & Peter C. B. Phillips & Jun Yu, 2006.
"Indirect Inference for Dynamic Panel Models,"
Cowles Foundation Discussion Papers
1550, Cowles Foundation for Research in Economics, Yale University.
- Gouriéroux, Christian & Phillips, Peter C.B. & Yu, Jun, 2010. "Indirect inference for dynamic panel models," Journal of Econometrics, Elsevier, vol. 157(1), pages 68-77, July.
- Christian Gouriéroux & Peter C. B. Phillips & Jun Yu, 2006. "Indirect Inference for Dynamic Panel Models," Development Economics Working Papers 22421, East Asian Bureau of Economic Research.
- Jesús Fernández-Villaverde & Juan Francisco Rubio-Ramírez & Manuel Santos, 2004.
"Convergence properties of the likelihood of computed dynamic models,"
Working Paper
2004-27, Federal Reserve Bank of Atlanta.
- Jes�s Fernández-Villaverde & Juan F. Rubio-Ramírez & Manuel S. Santos, 2006. "Convergence Properties of the Likelihood of Computed Dynamic Models," Econometrica, Econometric Society, vol. 74(1), pages 93-119, 01.
- Jesús Fernández-Villaverde & Juan F. Rubio-Ramirez & Manuel Santos, 2005. "Convergence Properties of the Likelihood of Computed Dynamic Models," Levine's Bibliography 122247000000000822, UCLA Department of Economics.
- Jesus Fernandez-Villaverde & Juan Rubio & Manuel Santos, 2005. "Convergence Properties of the Likelihood of Computed Dynamic Models," NBER Technical Working Papers 0315, National Bureau of Economic Research, Inc.
- Jesus Fernandez-Villaverde & Juan F. Rubio-Ramirez & Manuel Santos, 2004. "Convergence Properties of the Likelihood of Computed Dynamic Models," PIER Working Paper Archive 04-034, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
- Bao, Yong & Ullah, Aman, 2007. "The second-order bias and mean squared error of estimators in time-series models," Journal of Econometrics, Elsevier, vol. 140(2), pages 650-669, October.
- Michael Creel, 2008.
"Estimation of Dynamic Latent Variable Models Using Simulated Nonparametric Moments,"
UFAE and IAE Working Papers
725.08, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC), revised 02 Jun 2008.
- Michael Creel & Dennis Kristensen, 2009. "Estimation of Dynamic Latent Variable Models Using Simulated Nonparametric Moments," UFAE and IAE Working Papers 792.09, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
- Juan F. Rubio-Ramirez & Jesus Fernández-Villaverde, 2005.
"Estimating dynamic equilibrium economies: linear versus nonlinear likelihood,"
Journal of Applied Econometrics,
John Wiley & Sons, Ltd., vol. 20(7), pages 891-910.
- Jesús Fernández-Villaverde & Juan Francisco Rubio-Ramírez, 2004. "Estimating dynamic equilibrium economies: linear versus nonlinear likelihood," Working Paper 2004-3, Federal Reserve Bank of Atlanta.
- Jesus Fernandez-Villaverde & Juan F. Rubio-Ramirez, 2004. "Estimating Dynamic Equilibrium Economies: Linear versus Nonlinear Likelihood," PIER Working Paper Archive 04-005, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
- McFadden, Daniel, 1989.
"A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration,"
Econometrica,
Econometric Society, vol. 57(5), pages 995-1026, September.
- Daniel McFadden, 1987. "A Method of Simulated Moments for Estimation of Discrete Response Models Without Numerical Integration," Working papers 464, Massachusetts Institute of Technology (MIT), Department of Economics.
- repec:fth:inseep:9315 is not listed on IDEAS
- Whitney K. Newey & Fushing Hsieh & James M. Robins, 2004. "Twicing Kernels and a Small Bias Property of Semiparametric Estimators," Econometrica, Econometric Society, vol. 72(3), pages 947-962, 05.
- Jinyong Hahn & Whitney Newey, 2004. "Jackknife and Analytical Bias Reduction for Nonlinear Panel Models," Econometrica, Econometric Society, vol. 72(4), pages 1295-1319, 07.
- Linton, Oliver, 1996.
"Edgeworth Approximation for MINPIN Estimators in Semiparametric Regression Models,"
Econometric Theory,
Cambridge University Press, vol. 12(01), pages 30-60, March.
- Oliver Linton, 1994. "Edgeworth Approximation for MINPIN Estimators in Semiparametric Regression Models," Cowles Foundation Discussion Papers 1086, Cowles Foundation for Research in Economics, Yale University.
- Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-57, September.
- Berry, Steven & Levinsohn, James & Pakes, Ariel, 1995. "Automobile Prices in Market Equilibrium," Econometrica, Econometric Society, vol. 63(4), pages 841-90, July.
- Michael Creel & Dennis Kristensen, 2012.
"Estimation of dynamic latent variable models using simulated non‐parametric moments,"
Econometrics Journal,
Royal Economic Society, vol. 15(3), pages 490-515, October.
- Michael Creel & Dennis Kristensen, 2009. "Estimation of Dynamic Latent Variable Models Using Simulated Nonparametric Moments," UFAE and IAE Working Papers 792.09, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
- Robinson, Peter M, 1988. "The Stochastic Difference between Econometric Statistics," Econometrica, Econometric Society, vol. 56(3), pages 531-48, May.
- Lee, Lung-fei, 1999. "Statistical Inference With Simulated Likelihood Functions," Econometric Theory, Cambridge University Press, vol. 15(03), pages 337-360, June.
- Lee, Lung-fei, 2001. "Interpolation, Quadrature, And Stochastic Integration," Econometric Theory, Cambridge University Press, vol. 17(05), pages 933-961, October.
- Newey, Whitney K, 1991. "Uniform Convergence in Probability and Stochastic Equicontinuity," Econometrica, Econometric Society, vol. 59(4), pages 1161-67, July.
- Nze, Patrick Ango & Doukhan, Paul, 2004. "Weak Dependence: Models And Applications To Econometrics," Econometric Theory, Cambridge University Press, vol. 20(06), pages 995-1045, December.
- V A Hajivassiliou, 1997. "Some Practical Issues in Maximum Simulated Likelihood," STICERD - Econometrics Paper Series /1997/340, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
- Lee, Lung-Fei, 1995. "Asymptotic Bias in Simulated Maximum Likelihood Estimation of Discrete Choice Models," Econometric Theory, Cambridge University Press, vol. 11(03), pages 437-483, June.
- Kristensen, Dennis & Rahbek, Anders, 2005. "ASYMPTOTICS OF THE QMLE FOR A CLASS OF ARCH(q) MODELS," Econometric Theory, Cambridge University Press, vol. 21(05), pages 946-961, October.
- Chen, Xiaohong & White, Halbert, 1998. "Nonparametric Adaptive Learning with Feedback," Journal of Economic Theory, Elsevier, vol. 82(1), pages 190-222, September.
- DHAENE, Geert & JOCHMANS, Koen, 2010. "Split-panel jackknife estimation of fixed-effect models," CORE Discussion Papers 2010003, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- repec:bla:restud:v:76:y:2009:i:2:p:413-450 is not listed on IDEAS
- Pollard, David, 1985. "New Ways to Prove Central Limit Theorems," Econometric Theory, Cambridge University Press, vol. 1(03), pages 295-313, December.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Creel, Michael & Kristensen, Dennis, 2011.
"Indirect Likelihood Inference,"
Dynare Working Papers
8, CEPREMAP.
- Michael Creel & Dennis Kristensen, 2011. "Indirect likelihood inference," UFAE and IAE Working Papers 874.11, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
- Michael Creel & Dennis Kristensen, 2011. "Indirect likelihood inference," Working Papers 558, Barcelona Graduate School of Economics.
- Joachim Freyberger, 2012. "Asymptotic theory for differentiated products demand models with many markets," CeMMAP working papers CWP19/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:kud:kuieca:2010_04For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Sabine Fischer).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

