IDEAS home Printed from https://ideas.repec.org/p/zbw/iwqwdp/072015.html
   My bibliography  Save this paper

Cumulative Paired ๐œ™-Entropy

Author

Listed:
  • Klein, Ingo
  • Mangold, Benedikt

Abstract

A new kind of entropy will be introduced generalizing both the differential entropy and the cumulative (residual) entropy. The generalization is twofold. Firstly, we define the entropy for cumulative distribution functions (cdf) and survivor functions (sf) simultaneously instead of densities, cdf or sf alone. Secondly, we consider a general 'entropy generating function' ๐œ™ like Burbea & Rao (1982) or Liese & Vajda (1987) in the context of ๐œ™-divergences. Combining the ideas of a ๐œ™-entropy and a cumulative entropy gives the new 'cumulative paired ๐œ™-entropy' (CPE๐œ™). With some modifications or simplifications this new entropy has already been discussed in at least four scientific disciplines. In the fuzzy set theory cumulative paired ๐œ™- entropies were defined for membership functions. A discrete version serves as a measure of dispersion for ordered categorial variables. More recently, uncertainty and reliability theory considered some variants as a measure of information. With only one exception the discussions seem to happen independently of each other. We consider CPE๐œ™ only for continuous cdf and show that CPE ๐œ™ is rather a measure of dispersion than a measure of information. At first, this will be demonstrated by deriving an upper bound which is determined by the standard deviation and by solving the maximum entropy problem under the restriction that the variance is fixed. We cannot only reproduce the central role of the logistic distribution in entropy maximization. We derive Tukey's Lambda distribution as the solution of an entropy maximization problem as well. Secondly, it will be shown explicitly that CPE๐œ™ fulfills the axioms of a dispersion measure. The corresponding dispersion functional can easily be estimated by an L-estimator with all its known asymptotical properties. CPE๐œ™ are the starting point for several related concepts like mutual ๐œ™-information, ๐œ™-correlation and ๐œ™-regression which generalize Gini correlation and Gini regression. We give a short introduction into all of these related concepts. Also linear rank tests for scale can be developed based on the new entropy. We show that almost all known tests are special cases and introduce some new tests. In the literature Shannon's differential entropy has been calculated for a lot of distributions. The formulas were presented explicitly. We have done the same for CPE๐œ™ if the cdf is available in a closed form.

Suggested Citation

  • Klein, Ingo & Mangold, Benedikt, 2015. "Cumulative Paired ๐œ™-Entropy," FAU Discussion Papers in Economics 07/2015, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
  • Handle: RePEc:zbw:iwqwdp:072015
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    References listed on IDEAS

    as
    1. Bรฉnรฉdicte Apouey & Jacques Silber, 2013. "Inequality and Bi-Polarization in Socioeconomic Status and Health: Ordinal Approaches," Research on Economic Inequality, in: Health and Inequality, volume 21, pages 77-109, Emerald Group Publishing Limited.
    2. V. Zardasht & S. Parsi & M. Mousazadeh, 2015. "On empirical cumulative residual entropy and a goodness-of-fit test for exponentiality," Statistical Papers, Springer, vol. 56(3), pages 677-688, August.
    3. Abul Naga, Ramses H. & Yalcin, Tarik, 2008. "Inequality measurement for ordered response health data," Journal of Health Economics, Elsevier, vol. 27(6), pages 1614-1625, December.
    4. Lerman, Robert I. & Yitzhaki, Shlomo, 1984. "A note on the calculation and interpretation of the Gini index," Economics Letters, Elsevier, vol. 15(3-4), pages 363-368.
    5. Buhong Zheng, 2011. "A new approach to measure socioeconomic inequality in health," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 9(4), pages 555-577, December.
    6. Tamar Gadrich & Emil Bashkansky & Riฤardas Zitikis, 2015. "Assessing variation: a unifying approach for all scales of measurement," Quality & Quantity: International Journal of Methodology, Springer, vol. 49(3), pages 1145-1167, May.
    7. Ebrahimi, Nader & Maasoumi, Esfandiar & Soofi, Ehsan S., 1999. "Ordering univariate distributions by entropy and variance," Journal of Econometrics, Elsevier, vol. 90(2), pages 317-336, June.
    8. E. Schechtman & S. Yitzhaki, 2003. "A Family of Correlation Coefficients Based on the Extended Gini Index," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 1(2), pages 129-146, August.
    9. Schechtman, E. & Yitzhaki, S., 1999. "On the proper bounds of the Gini correlation," Economics Letters, Elsevier, vol. 63(2), pages 133-138, May.
    10. Shlomo Yitzhaki, 2003. "Giniโ€™s Mean difference: a superior measure of variability for non-normal distributions," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilitร  e Statistiche Applicate - University of Rome, vol. 0(2), pages 285-316.
    11. Shlomo Yitzhaki & Edna Schechtman, 2005. "The properties of the extended Gini measures of variability and inequality," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilitร  e Statistiche Applicate - University of Rome, vol. 0(3), pages 401-433.
    12. Sunoj, S.M. & Sankaran, P.G., 2012. "Quantile based entropy function," Statistics & Probability Letters, Elsevier, vol. 82(6), pages 1049-1053.
    13. Burger, H. U., 1993. "Dispersion orderings with applications to nonparametric tests," Statistics & Probability Letters, Elsevier, vol. 16(1), pages 1-9, January.
    14. Hall, Peter & Wolff, Rodney C. L. & Yao, Qiwei, 1999. "Methods for estimating a conditional distribution function," LSE Research Online Documents on Economics 6631, London School of Economics and Political Science, LSE Library.
    15. Allison, R. Andrew & Foster, James E., 2004. "Measuring health inequality using qualitative data," Journal of Health Economics, Elsevier, vol. 23(3), pages 505-524, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. SILBER, Jacques & XU, Yongsheng, 2016. "The Health Equivalent Adjusted Level (HEAL): Taking an Ordinal Approach to the Measurement of a Society's Health Achievements," Discussion paper series HIAS-E-31, Hitotsubashi Institute for Advanced Study, Hitotsubashi University.
    2. Frank A Cowell & Martyna Kobus & Radoslaw Kurek, 2017. "Welfare and Inequality Comparisons for Uni- and Multi-dimensional Distributions of Ordinal Data," STICERD - Public Economics Programme Discussion Papers 31, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    3. Valรฉrie Bรฉrenger & Jacques Silber, 2022. "On the Measurement of Happiness and of its Inequality," Journal of Happiness Studies, Springer, vol. 23(3), pages 861-902, March.
    4. Hongliang Wang & Yiwen Yu, 2016. "Increasing health inequality in China: An empirical study with ordinal data," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 14(1), pages 41-61, March.
    5. Yoel Finkel & Yevgeny Artsev & Shlomo Yitzhaki, 2006. "Inequality measurement and the time structure of household income in Israel," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 4(2), pages 153-179, August.
    6. Maria Livia ลžTEFฤ‚NESCU, 2015. "Analyzing the health status of the population using ordinal data," Computational Methods in Social Sciences (CMSS), "Nicolae Titulescu" University of Bucharest, Faculty of Economic Sciences, vol. 3(1), pages 18-24, June.
    7. Nicolas Gravel & Brice Magdalou & Patrick Moyes, 2021. "Ranking distributions of an ordinal variable," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 71(1), pages 33-80, February.
    8. Suman Seth and Gaston Yalonetzky, 2018. "Assessing Deprivation with Ordinal Variables: Depth Sensitivity and Poverty Aversion," OPHI Working Papers ophiwp123.pdf, Queen Elizabeth House, University of Oxford.
    9. Joan Costa Font & Frank Cowell, 2013. "Measuring Health Inequality with Categorical Data: Some Regional Patterns," Research on Economic Inequality, in: Health and Inequality, volume 21, pages 53-76, Emerald Group Publishing Limited.
    10. Carmen Herrero & Antonio Villar, 2013. "On the Comparison of Group Performance with Categorical Data," PLOS ONE, Public Library of Science, vol. 8(12), pages 1-7, December.
    11. Joan Costa-Font & Frank A. Cowell, 2022. "The measurement of health inequalities: does status matter?," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 20(2), pages 299-325, June.
    12. Martyna Kobus & Olga Pรณล‚chล‚opek & Gaston Yalonetzky, 2019. "Inequality and Welfare in Quality of Life Among OECD Countries: Non-parametric Treatment of Ordinal Data," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 143(1), pages 201-232, May.
    13. Kobus, Martyna & Kurek, Radosล‚aw, 2023. "Measuring inequality in the joint distribution of socioeconomic status and health," Economics Letters, Elsevier, vol. 226(C).
    14. Deutsch, Joseph & Silber, Jacques & Wan, Guanghua & Zhao, Mengxue, 2020. "Asset indexes and the measurement of poverty, inequality and welfare in Southeast Asia," Journal of Asian Economics, Elsevier, vol. 70(C).
    15. Ramses H. Abul Naga, 2018. "Measurement of inequality with a finite number of pay states: the majorization set and its applications," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 65(1), pages 99-123, January.
    16. Suman Seth & Gaston Yalonetzky, 2021. "Assessing Deprivation with an Ordinal Variable: Theory and Application to Sanitation Deprivation in Bangladesh," The World Bank Economic Review, World Bank Group, vol. 35(3), pages 793-811.
    17. Amit Shelef & Edna Schechtman, 2019. "A Gini-based time series analysis and test for reversibility," Statistical Papers, Springer, vol. 60(3), pages 687-716, June.
    18. Fatiha Bennia & Nicolas Gravel & Brice Magdalou & Patrick Moyes, 2022. "Is body weight better distributed among men than among women? A robust normative analysis for France, the UK, and the US," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(1), pages 69-103, January.
    19. Hongliang Wang & Yiwen Yu, 2016. "Increasing health inequality in China: An empirical study with ordinal data," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 14(1), pages 41-61, March.
    20. Paul Makdissi & Myra Yazbeck, 2017. "Robust rankings of socioeconomic health inequality using a categorical variable," Health Economics, John Wiley & Sons, Ltd., vol. 26(9), pages 1132-1145, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:iwqwdp:072015. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/vierlde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.