IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v55y2011i6p2172-2182.html
   My bibliography  Save this article

On the performance of the flexible maximum entropy distributions within partially adaptive estimation

Author

Listed:
  • Usta, Ilhan
  • Kantar, Yeliz Mert

Abstract

The partially adaptive estimation based on the assumed error distribution has emerged as a popular approach for estimating a regression model with non-normal errors. In this approach, if the assumed distribution is flexible enough to accommodate the shape of the true underlying error distribution, the efficiency of the partially adaptive estimator is expected to be close to the efficiency of the maximum likelihood estimator based on knowledge of the true error distribution. In this context, the maximum entropy distributions have attracted interest since such distributions have a very flexible functional form and nest most of the statistical distributions. Therefore, several flexible MaxEnt distributions under certain moment constraints are determined to use within the partially adaptive estimation procedure and their performances are evaluated relative to well-known estimators. The simulation results indicate that the determined partially adaptive estimators perform well for non-normal error distributions. In particular, some can be useful in dealing with small sample sizes. In addition, various linear regression applications with non-normal errors are provided.

Suggested Citation

  • Usta, Ilhan & Kantar, Yeliz Mert, 2011. "On the performance of the flexible maximum entropy distributions within partially adaptive estimation," Computational Statistics & Data Analysis, Elsevier, vol. 55(6), pages 2172-2182, June.
    • Handle: RePEc:eee:csdana:v:55:y:2011:i:6:p:2172-2182
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-9473(11)00026-0
    Download Restriction: Full text for ScienceDirect subscribers only.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Park, Sung Y. & Bera, Anil K., 2009. "Maximum entropy autoregressive conditional heteroskedasticity model," Journal of Econometrics, Elsevier, vol. 150(2), pages 219-230, June.
    2. Shamilov, Aladdin, 2007. "Generalized entropy optimization problems and the existence of their solutions," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 382(2), pages 465-472.
    3. Butler, Richard J, et al, 1990. "Robust and Partially Adaptive Estimation of Regression Models," The Review of Economics and Statistics, MIT Press, vol. 72(2), pages 321-327, May.
    4. M. C. Jones & M. J. Faddy, 2003. "A skew extension of the t‐distribution, with applications," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(1), pages 159-174, February.
    5. Borra, Simone & Di Ciaccio, Agostino, 2010. "Measuring the prediction error. A comparison of cross-validation, bootstrap and covariance penalty methods," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 2976-2989, December.
    6. Bartolucci, F. & Scaccia, L., 2005. "The use of mixtures for dealing with non-normal regression errors," Computational Statistics & Data Analysis, Elsevier, vol. 48(4), pages 821-834, April.
    7. Lu Tian & Tianxi Cai & Els Goetghebeur & L. J. Wei, 2007. "Model evaluation based on the sampling distribution of estimated absolute prediction error," Biometrika, Biometrika Trust, vol. 94(2), pages 297-311.
    8. Wu, Ximing, 2003. "Calculation of maximum entropy densities with application to income distribution," Journal of Econometrics, Elsevier, vol. 115(2), pages 347-354, August.
    9. D. Ormoneit & H. White, 1999. "An efficient algorithm to compute maximum entropy densities," Econometric Reviews, Taylor & Francis Journals, vol. 18(2), pages 127-140.
    10. Vicente Cancho & Víctor Lachos & Edwin Ortega, 2010. "A nonlinear regression model with skew-normal errors," Statistical Papers, Springer, vol. 51(3), pages 547-558, September.
    11. Ximing Wu & Thanasis Stengos, 2005. "Partially adaptive estimation via the maximum entropy densities," Econometrics Journal, Royal Economic Society, vol. 8(3), pages 352-366, December.
    12. Brian Boyer & James McDonald & Whitney Newey, 2003. "A Comparison of Partially Adaptive and Reweighted Least Squares Estimation," Econometric Reviews, Taylor & Francis Journals, vol. 22(2), pages 115-134.
    13. McDonald, James B., 1989. "Partially adaptive estimation of ARMA time series models," International Journal of Forecasting, Elsevier, vol. 5(2), pages 217-230.
    14. McDonald, James B., 1991. "Parametric models for partially adaptive estimation with skewed and leptokurtic residuals," Economics Letters, Elsevier, vol. 37(3), pages 273-278, November.
    15. Sukant K. Misra & Jeannie Nelson, 2003. "Efficient Estimation of Agricultural Time Series Models with Nonnormal Dependent Variables," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 85(4), pages 1029-1040.
    16. McDonald, James B. & Newey, Whitney K., 1988. "Partially Adaptive Estimation of Regression Models via the Generalized T Distribution," Econometric Theory, Cambridge University Press, vol. 4(3), pages 428-457, December.
    17. Kim, Ji-Hyun, 2009. "Estimating classification error rate: Repeated cross-validation, repeated hold-out and bootstrap," Computational Statistics & Data Analysis, Elsevier, vol. 53(11), pages 3735-3745, September.
    18. Hansen, James V. & McDonald, James B. & Turley, Robert S., 2006. "Partially adaptive robust estimation of regression models and applications," European Journal of Operational Research, Elsevier, vol. 170(1), pages 132-143, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Domenico Di Gangi & Fabrizio Lillo & Davide Pirino, 2015. "Assessing systemic risk due to fire sales spillover through maximum entropy network reconstruction," Papers 1509.00607, arXiv.org, revised Jul 2018.
    2. Rodríguez, Yeny E. & Gómez, Juan M. & Contreras, Javier, 2021. "Diversified behavioral portfolio as an alternative to Modern Portfolio Theory," The North American Journal of Economics and Finance, Elsevier, vol. 58(C).
    3. Chee, Chew-Seng & Seo, Byungtae, 2020. "Semiparametric estimation for linear regression with symmetric errors," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    4. Ba Chu & Stephen Satchell, 2016. "Recovering the Most Entropic Copulas from Preliminary Knowledge of Dependence," Econometrics, MDPI, vol. 4(2), pages 1-21, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Steven Caudill & James Long, 2010. "Do former athletes make better managers? Evidence from a partially adaptive grouped-data regression model," Empirical Economics, Springer, vol. 39(1), pages 275-290, August.
    2. Steven Caudill, 2012. "A partially adaptive estimator for the censored regression model based on a mixture of normal distributions," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 21(2), pages 121-137, June.
    3. Katherine G. Yewell & Steven B. Caudill & Franklin G. Mixon, Jr., 2014. "Referee Bias and Stoppage Time in Major League Soccer: A Partially Adaptive Approach," Econometrics, MDPI, vol. 2(1), pages 1-19, February.
    4. James Mcdonald & Richard Michelfelder & Panayiotis Theodossiou, 2010. "Robust estimation with flexible parametric distributions: estimation of utility stock betas," Quantitative Finance, Taylor & Francis Journals, vol. 10(4), pages 375-387.
    5. James B. McDonald & Richard A. Michelfelder & Panayiotis Theodossiou, 2009. "Robust Regression Estimation Methods and Intercept Bias: A Capital Asset Pricing Model Application," Multinational Finance Journal, Multinational Finance Journal, vol. 13(3-4), pages 293-321, September.
    6. Fong, Wai Mun, 1997. "Robust beta estimation: Some empirical evidence," Review of Financial Economics, Elsevier, vol. 6(2), pages 167-186.
    7. Yiguo Sun & Thanasis Stengos, 2008. "The absolute health income hypothesis revisited: a semiparametric quantile regression approach," Empirical Economics, Springer, vol. 35(2), pages 395-412, September.
    8. Ximing Wu & Thanasis Stengos, 2005. "Partially adaptive estimation via the maximum entropy densities," Econometrics Journal, Royal Economic Society, vol. 8(3), pages 352-366, December.
    9. Stefan Mittnik & Marc Paolella & Svetlozar Rachev, 1998. "Unconditional and Conditional Distributional Models for the Nikkei Index," Asia-Pacific Financial Markets, Springer;Japanese Association of Financial Economics and Engineering, vol. 5(2), pages 99-128, May.
    10. Thanasis Stengos & Ximing Wu, 2010. "Information-Theoretic Distribution Test with Application to Normality," Econometric Reviews, Taylor & Francis Journals, vol. 29(3), pages 307-329.
    11. Sukru Acitas & Pelin Kasap & Birdal Senoglu & Olcay Arslan, 2013. "One-step M -estimators: Jones and Faddy's skewed t -distribution," Journal of Applied Statistics, Taylor & Francis Journals, vol. 40(7), pages 1545-1560, July.
    12. Hansen, James V. & McDonald, James B. & Turley, Robert S., 2006. "Partially adaptive robust estimation of regression models and applications," European Journal of Operational Research, Elsevier, vol. 170(1), pages 132-143, April.
    13. James B. McDonald & Hieu Nguyen, 2012. "Heteroskedasticity and Distributional Assumptions in the Censored Regression Model," BYU Macroeconomics and Computational Laboratory Working Paper Series 2012-09, Brigham Young University, Department of Economics, BYU Macroeconomics and Computational Laboratory.
    14. Victor Korolev, 2023. "Analytic and Asymptotic Properties of the Generalized Student and Generalized Lomax Distributions," Mathematics, MDPI, vol. 11(13), pages 1-27, June.
    15. Bönte, G., 1995. "Evaluierung adaptiver Hochrechnungsverfahren," Discussion Papers 05/1995, Friedrich-Alexander University Erlangen-Nuremberg, Chair of Statistics and Econometrics.
    16. Grottke, Martin, 1999. "Generierung schiefer Verteilungen mittels Skalenparametersplittung," Discussion Papers 30/1999, Friedrich-Alexander University Erlangen-Nuremberg, Chair of Statistics and Econometrics.
    17. Carol Alexander & José María Sarabia, 2012. "Quantile Uncertainty and Value‐at‐Risk Model Risk," Risk Analysis, John Wiley & Sons, vol. 32(8), pages 1293-1308, August.
    18. Wu, Ximing & Perloff, Jeffrey M., 2004. "China's Income Distribution Over Time: Reasons for Rising Inequality," Institute for Research on Labor and Employment, Working Paper Series qt9jw2v939, Institute of Industrial Relations, UC Berkeley.
    19. James Hansen & James McDonald & Panayiotis Theodossiou & Brad Larsen, 2010. "Partially Adaptive Econometric Methods For Regression and Classification," Computational Economics, Springer;Society for Computational Economics, vol. 36(2), pages 153-169, August.
    20. Luca Bagnato & Valerio Potì & Maria Zoia, 2015. "The role of orthogonal polynomials in adjusting hyperpolic secant and logistic distributions to analyse financial asset returns," Statistical Papers, Springer, vol. 56(4), pages 1205-1234, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:55:y:2011:i:6:p:2172-2182. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.