IDEAS home Printed from https://ideas.repec.org/p/kud/kuieca/2010_04.html
   My bibliography  Save this paper

Higher Order Improvements for Approximate Estimators

Author

Listed:
  • Dennis Kristensen

    (Columbia University)

  • Bernard Salanié

    (Columbia University)

Abstract

Many modern estimation methods in econometrics approximate an objective function, through simulation or discretization for instance. The resulting "approximate" estimator is often biased; and it always incurs an efficiency loss. We here propose three methods to improve the properties of such approximate estimators at a low computational cost. The first two methods correct the objective function so as to remove the leading term of the bias due to the approximation. One variant provides an analytical bias adjustment, but it only works for estimators based on stochastic approximators, such as simulation-based estimators. Our second bias correction is based on ideas from the resampling literature; it eliminates the leading bias term for non-stochastic as well as stochastic approximators. Finally, we propose an iterative procedure where we use Newton-Raphson (NR) iterations based on a much finer degree of approximation. The NR step removes some or all of the additional bias and variance of the initial approximate estimator. A Monte Carlo simulation on the mixed logit model shows that noticeable improvements can be obtained rather cheaply.

Suggested Citation

  • Dennis Kristensen & Bernard Salanié, 2010. "Higher Order Improvements for Approximate Estimators," CAM Working Papers 2010-04, University of Copenhagen. Department of Economics. Centre for Applied Microeconometrics.
  • Handle: RePEc:kud:kuieca:2010_04
    as

    Download full text from publisher

    File URL: http://www.econ.ku.dk/cam/wp0910/2010-04.pdf/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Andrews, Donald W.K., 2002. "EQUIVALENCE OF THE HIGHER ORDER ASYMPTOTIC EFFICIENCY OF k-STEP AND EXTREMUM STATISTICS," Econometric Theory, Cambridge University Press, vol. 18(5), pages 1040-1085, October.
    2. Kristensen, Dennis & Shin, Yongseok, 2012. "Estimation of dynamic models with nonparametric simulated maximum likelihood," Journal of Econometrics, Elsevier, vol. 167(1), pages 76-94.
    3. Lee, Lung-Fei, 1992. "On Efficiency of Methods of Simulated Moments and Maximum Simulated Likelihood Estimation of Discrete Response Models," Econometric Theory, Cambridge University Press, vol. 8(4), pages 518-552, December.
    4. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    5. Duffie, Darrell & Singleton, Kenneth J, 1993. "Simulated Moments Estimation of Markov Models of Asset Prices," Econometrica, Econometric Society, vol. 61(4), pages 929-952, July.
    6. Andrews, Donald W K, 1994. "Asymptotics for Semiparametric Econometric Models via Stochastic Equicontinuity," Econometrica, Econometric Society, vol. 62(1), pages 43-72, January.
    7. Geert Dhaene & Koen Jochmans, 2015. "Split-panel Jackknife Estimation of Fixed-effect Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 82(3), pages 991-1030.
    8. Fermanian, Jean-David & Salanié, Bernard, 2004. "A Nonparametric Simulated Maximum Likelihood Estimation Method," Econometric Theory, Cambridge University Press, vol. 20(4), pages 701-734, August.
    9. Newey, Whitney K, 1991. "Uniform Convergence in Probability and Stochastic Equicontinuity," Econometrica, Econometric Society, vol. 59(4), pages 1161-1167, July.
    10. Gouriéroux, Christian & Phillips, Peter C.B. & Yu, Jun, 2010. "Indirect inference for dynamic panel models," Journal of Econometrics, Elsevier, vol. 157(1), pages 68-77, July.
    11. Bao, Yong & Ullah, Aman, 2007. "The second-order bias and mean squared error of estimators in time-series models," Journal of Econometrics, Elsevier, vol. 140(2), pages 650-669, October.
    12. Kristensen, Dennis, 2009. "Uniform Convergence Rates Of Kernel Estimators With Heterogeneous Dependent Data," Econometric Theory, Cambridge University Press, vol. 25(5), pages 1433-1445, October.
    13. Michael Creel, 2008. "Estimation of Dynamic Latent Variable Models Using Simulated Nonparametric Moments," UFAE and IAE Working Papers 725.08, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC), revised 02 Jun 2008.
    14. Xiaohong Chen & Oliver Linton & Ingrid Van Keilegom, 2003. "Estimation of Semiparametric Models when the Criterion Function Is Not Smooth," Econometrica, Econometric Society, vol. 71(5), pages 1591-1608, September.
    15. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    16. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521818728.
    17. Whitney K. Newey & Fushing Hsieh & James M. Robins, 2004. "Twicing Kernels and a Small Bias Property of Semiparametric Estimators," Econometrica, Econometric Society, vol. 72(3), pages 947-962, May.
    18. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez & Manuel S. Santos, 2006. "Convergence Properties of the Likelihood of Computed Dynamic Models," Econometrica, Econometric Society, vol. 74(1), pages 93-119, January.
    19. Andrews,Donald W. K. & Stock,James H. (ed.), 2005. "Identification and Inference for Econometric Models," Cambridge Books, Cambridge University Press, number 9780521844413.
    20. Blundell,Richard & Newey,Whitney K. & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521871532.
    21. Juan F. Rubio-Ramirez & Jesus Fernández-Villaverde, 2005. "Estimating dynamic equilibrium economies: linear versus nonlinear likelihood," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 891-910.
    22. Linton, Oliver, 1996. "Edgeworth Approximation for MINPIN Estimators in Semiparametric Regression Models," Econometric Theory, Cambridge University Press, vol. 12(1), pages 30-60, March.
    23. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-1057, September.
    24. Laroque, Guy & Salanie, B, 1993. "Simulation-Based Estimation of Models with Lagged Latent Variables," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 119-133, Suppl. De.
    25. Michael Creel & Dennis Kristensen, 2012. "Estimation of dynamic latent variable models using simulated non‐parametric moments," Econometrics Journal, Royal Economic Society, vol. 15(3), pages 490-515, October.
    26. Robinson, Peter M, 1988. "The Stochastic Difference between Econometric Statistics," Econometrica, Econometric Society, vol. 56(3), pages 531-548, May.
    27. Chen Xiaohong & White Halbert, 2002. "Asymptotic Properties of Some Projection-based Robbins-Monro Procedures in a Hilbert Space," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 6(1), pages 1-55, April.
    28. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521524131.
    29. Lee, Lung-fei, 1999. "Statistical Inference With Simulated Likelihood Functions," Econometric Theory, Cambridge University Press, vol. 15(3), pages 337-360, June.
    30. Lee, Lung-fei, 2001. "Interpolation, Quadrature, And Stochastic Integration," Econometric Theory, Cambridge University Press, vol. 17(5), pages 933-961, October.
    31. repec:hal:spmain:info:hdl:2441/eu4vqp9ompqllr09ij4j0h0h1 is not listed on IDEAS
    32. Lee, Lung-Fei, 1995. "Asymptotic Bias in Simulated Maximum Likelihood Estimation of Discrete Choice Models," Econometric Theory, Cambridge University Press, vol. 11(3), pages 437-483, June.
    33. Blundell,Richard & Newey,Whitney & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521692106.
    34. Kristensen, Dennis & Rahbek, Anders, 2005. "ASYMPTOTICS OF THE QMLE FOR A CLASS OF ARCH(q) MODELS," Econometric Theory, Cambridge University Press, vol. 21(5), pages 946-961, October.
    35. Chen, Xiaohong & White, Halbert, 1998. "Nonparametric Adaptive Learning with Feedback," Journal of Economic Theory, Elsevier, vol. 82(1), pages 190-222, September.
    36. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521747387.
    37. Pollard, David, 1985. "New Ways to Prove Central Limit Theorems," Econometric Theory, Cambridge University Press, vol. 1(3), pages 295-313, December.
    38. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521818742.
    39. Blundell,Richard & Newey,Whitney K. & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521692090.
    40. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521524117.
    41. Laffont, Jean-Jacques & Ossard, Herve & Vuong, Quang, 1995. "Econometrics of First-Price Auctions," Econometrica, Econometric Society, vol. 63(4), pages 953-980, July.
    42. Rilstone, Paul & Srivastava, V. K. & Ullah, Aman, 1996. "The second-order bias and mean squared error of nonlinear estimators," Journal of Econometrics, Elsevier, vol. 75(2), pages 369-395, December.
    43. Corradi, Valentina & Swanson, Norman R., 2007. "Evaluation of dynamic stochastic general equilibrium models based on distributional comparison of simulated and historical data," Journal of Econometrics, Elsevier, vol. 136(2), pages 699-723, February.
    44. repec:hal:wpspec:info:hdl:2441/eu4vqp9ompqllr09ij4j0h0h1 is not listed on IDEAS
    45. Jinyong Hahn & Whitney Newey, 2004. "Jackknife and Analytical Bias Reduction for Nonlinear Panel Models," Econometrica, Econometric Society, vol. 72(4), pages 1295-1319, July.
    46. Berry, Steven & Levinsohn, James & Pakes, Ariel, 1995. "Automobile Prices in Market Equilibrium," Econometrica, Econometric Society, vol. 63(4), pages 841-890, July.
    47. repec:crs:wpaper:9315 is not listed on IDEAS
    48. Nze, Patrick Ango & Doukhan, Paul, 2004. "Weak Dependence: Models And Applications To Econometrics," Econometric Theory, Cambridge University Press, vol. 20(6), pages 995-1045, December.
    49. Filippo Altissimo & Antonio Mele, 2009. "Simulated Non-Parametric Estimation of Dynamic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(2), pages 413-450.
    50. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521818735.
    51. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521524124.
    52. Blundell,Richard & Newey,Whitney & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521871549.
    53. Bierings, H. & Sneek, K., 1989. "Pseudo maximum likelihood techniques in a simple rationing model of the Dutch labour market," Serie Research Memoranda 0063, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    54. Andriy Norets, 2009. "Inference in Dynamic Discrete Choice Models With Serially orrelated Unobserved State Variables," Econometrica, Econometric Society, vol. 77(5), pages 1665-1682, September.
    55. Mariano,Roberto & Schuermann,Til & Weeks,Melvyn J. (ed.), 2000. "Simulation-based Inference in Econometrics," Cambridge Books, Cambridge University Press, number 9780521591126.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Michael Creel & Dennis Kristensen, "undated". "Indirect Likelihood Inference," Working Papers 558, Barcelona School of Economics.
    2. Kristensen, Dennis & Salanié, Bernard, 2017. "Higher-order properties of approximate estimators," Journal of Econometrics, Elsevier, vol. 198(2), pages 189-208.
    3. Stelios Arvanitis & Antonis Demos, 2015. "A class of indirect inference estimators: higher‐order asymptotics and approximate bias correction," Econometrics Journal, Royal Economic Society, vol. 18(2), pages 200-241, June.
    4. Joachim Freyberger, 2012. "Asymptotic theory for differentiated products demand models with many markets," CeMMAP working papers 19/12, Institute for Fiscal Studies.
    5. Joachim Freyberger, 2012. "Asymptotic theory for differentiated products demand models with many markets," CeMMAP working papers CWP19/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    6. Kristensen, Dennis & Shin, Yongseok, 2012. "Estimation of dynamic models with nonparametric simulated maximum likelihood," Journal of Econometrics, Elsevier, vol. 167(1), pages 76-94.
    7. Delsol , Laurent & Van Keilegom, Ingrid, 2011. "Semiparametric M-Estimation with Non-Smooth Criterion Functions," LIDAM Discussion Papers ISBA 2011041, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    8. Michael Creel & Dennis Kristensen, 2013. "Indirect Likelihood Inference (revised)," UFAE and IAE Working Papers 931.13, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kristensen, Dennis & Salanié, Bernard, 2017. "Higher-order properties of approximate estimators," Journal of Econometrics, Elsevier, vol. 198(2), pages 189-208.
    2. Geert Dhaene & Koen Jochmans, 2015. "Split-panel Jackknife Estimation of Fixed-effect Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 82(3), pages 991-1030.
    3. Kristensen, Dennis & Shin, Yongseok, 2012. "Estimation of dynamic models with nonparametric simulated maximum likelihood," Journal of Econometrics, Elsevier, vol. 167(1), pages 76-94.
    4. repec:hal:spmain:info:hdl:2441/f6h8764enu2lskk9p2m9mgp8l is not listed on IDEAS
    5. Michael Creel & Dennis Kristensen, "undated". "Indirect Likelihood Inference," Working Papers 558, Barcelona School of Economics.
    6. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    7. repec:hal:spmain:info:hdl:2441/eu4vqp9ompqllr09ij4j0h0h1 is not listed on IDEAS
    8. repec:hal:wpspec:info:hdl:2441/f6h8764enu2lskk9p2m9mgp8l is not listed on IDEAS
    9. Shuowen Chen, 2022. "Indirect Inference for Nonlinear Panel Models with Fixed Effects," Papers 2203.10683, arXiv.org, revised Apr 2022.
    10. Kerem Tuzcuoglu, 2019. "Composite Likelihood Estimation of an Autoregressive Panel Probit Model with Random Effects," Staff Working Papers 19-16, Bank of Canada.
    11. Christian Bontemps & Raquel Menezes Bezerra Sampaio, 2020. "Entry games for the airline industry," Post-Print hal-02137358, HAL.
    12. Arthur Lewbel & Krishna Pendakur, 2017. "Unobserved Preference Heterogeneity in Demand Using Generalized Random Coefficients," Journal of Political Economy, University of Chicago Press, vol. 125(4), pages 1100-1148.
    13. Bontemps, Christian & Menezes Bezerra Sampaio, Raquel, 2020. "Entry games for the airline industry," TSE Working Papers 20-1108, Toulouse School of Economics (TSE).
    14. Xiaohong Chen & David Jacho-Chávez & Oliver Linton, 2012. "Averaging of moment condition estimators," CeMMAP working papers 26/12, Institute for Fiscal Studies.
    15. Michael Creel & Dennis Kristensen, 2013. "Indirect Likelihood Inference (revised)," UFAE and IAE Working Papers 931.13, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    16. Andrew Chesher & Adam Rosen, 2018. "Generalized instrumental variable models, methods, and applications," CeMMAP working papers CWP43/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    17. Bryan S. Graham & James Powell, 2008. "Identification and Estimation of 'Irregular' Correlated Random Coefficient Models," NBER Working Papers 14469, National Bureau of Economic Research, Inc.
    18. Vanhems, Anne & Van Keilegom, Ingrid, 2013. "Semiparametric transformation model with endogeneity: a control function approach," LIDAM Discussion Papers ISBA 2013018, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    19. Joachim Freyberger, 2012. "Asymptotic theory for differentiated products demand models with many markets," CeMMAP working papers CWP19/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    20. Ge, Suqin & Macieira, João, 2020. "Unobserved Worker Quality and Inter-Industry Wage Differentials," GLO Discussion Paper Series 491, Global Labor Organization (GLO).
    21. Schumann, Martin & Severini, Thomas A. & Tripathi, Gautam, 2021. "Integrated likelihood based inference for nonlinear panel data models with unobserved effects," Journal of Econometrics, Elsevier, vol. 223(1), pages 73-95.
    22. Pakel, Cavit, 2019. "Bias reduction in nonlinear and dynamic panels in the presence of cross-section dependence," Journal of Econometrics, Elsevier, vol. 213(2), pages 459-492.
    23. Vanhems, Anne & Van Keilegom, Ingrid, 2011. "Semiparametric transformation model with endogeneity: a control function approach," LIDAM Discussion Papers ISBA 2011011, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kud:kuieca:2010_04. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thomas Hoffmann (email available below). General contact details of provider: https://edirc.repec.org/data/camkudk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.