IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v171y2012i1p1-23.html
   My bibliography  Save this article

Nonparametric estimation and inference about the overlap of two distributions

Author

Listed:
  • Anderson, Gordon
  • Linton, Oliver
  • Whang, Yoon-Jae

Abstract

This paper develops methodology for nonparametric estimation of a measure of the overlap of two distributions based on kernel estimation techniques. This quantity has been proposed as a measure of economic polarization between two groups, Anderson (2004) and Anderson et al. (2010). In ecology it has been used to measure the overlap of species. We give the asymptotic distribution theory of our estimator, which in some cases of practical relevance is nonstandard due to a boundary value problem. We also propose a method for conducting inference based on estimation of unknown quantities in the limiting distribution and show that our method yields consistent inference in all cases we consider. We investigate the finite sample properties of our methods by simulation methods. We give an application to the study of polarization within China in recent years using household survey data from two provinces taken in 1987 and 2001. We find a big increase in polarization between 1987 and 2001 according to monetary outcomes but less change in terms of living space.

Suggested Citation

  • Anderson, Gordon & Linton, Oliver & Whang, Yoon-Jae, 2012. "Nonparametric estimation and inference about the overlap of two distributions," Journal of Econometrics, Elsevier, vol. 171(1), pages 1-23.
  • Handle: RePEc:eee:econom:v:171:y:2012:i:1:p:1-23
    DOI: 10.1016/j.jeconom.2012.05.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407612001108
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2012.05.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Oliver Linton & Esfandiar Maasoumi & Yoon-Jae Whang, 2005. "Consistent Testing for Stochastic Dominance under General Sampling Schemes," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(3), pages 735-765.
    2. Esteban, Joan & Ray, Debraj, 1994. "On the Measurement of Polarization," Econometrica, Econometric Society, vol. 62(4), pages 819-851, July.
    3. Gordon Anderson, 2010. "Polarization Of The Poor: Multivariate Relative Poverty Measurement Sans Frontiers," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 56(1), pages 84-101, March.
    4. Victor Chernozhukov & Han Hong & Elie Tamer, 2007. "Estimation and Confidence Regions for Parameter Sets in Econometric Models," Econometrica, Econometric Society, vol. 75(5), pages 1243-1284, September.
    5. Gordon Anderson & Ying Ge & Teng Wah Leo, 2010. "Distributional Overlap: Simple, Multivariate, Parametric, and Nonparametric Tests for Alienation, Convergence, and General Distributional Difference Issues," Econometric Reviews, Taylor & Francis Journals, vol. 29(3), pages 247-275.
    6. Jean-Yves Duclos & Joan Esteban & Debraj Ray, 2004. "Polarization: Concepts, Measurement, Estimation," Econometrica, Econometric Society, vol. 72(6), pages 1737-1772, November.
    7. Clemons, Traci E. & Jr., Edwin L. Bradley, 2000. "A nonparametric measure of the overlapping coefficient," Computational Statistics & Data Analysis, Elsevier, vol. 34(1), pages 51-61, July.
    8. You‐Qiang Wang & Kai‐Yuen Tsui, 2000. "Polarization Orderings and New Classes of Polarization Indices," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 2(3), pages 349-363, July.
    9. Chen, Song Xi, 1999. "Beta kernel estimators for density functions," Computational Statistics & Data Analysis, Elsevier, vol. 31(2), pages 131-145, August.
    10. Wang, You-Qiang & Tsui, Kai-Yuen, 2000. "Polarization Orderings and New Classes of Polarization Indices," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 2(3), pages 349-363.
    11. Donald W. K. Andrews, 1999. "Estimation When a Parameter Is on a Boundary," Econometrica, Econometric Society, vol. 67(6), pages 1341-1384, November.
    12. Anderson, Gordon & Ge, Ying, 2005. "The size distribution of Chinese cities," Regional Science and Urban Economics, Elsevier, vol. 35(6), pages 756-776, November.
    13. Hardle, W. & Park, B. U. & Tsybakov, A. B., 1995. "Estimation of Non-sharp Support Boundaries," Journal of Multivariate Analysis, Elsevier, vol. 55(2), pages 205-218, November.
    14. Anderson, Gordon, 2004. "Toward an empirical analysis of polarization," Journal of Econometrics, Elsevier, vol. 122(1), pages 1-26, September.
    15. Guido W. Imbens & Donald B. Rubin, 1997. "Estimating Outcome Distributions for Compliers in Instrumental Variables Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 555-574.
    16. Schmid, Friedrich & Schmidt, Axel, 2006. "Nonparametric estimation of the coefficient of overlapping--theory and empirical application," Computational Statistics & Data Analysis, Elsevier, vol. 50(6), pages 1583-1596, March.
    17. Gordon Anderson & Ying Ge, 2009. "Intercity Income Inequality Growth and Convergence in China," Journal of Income Distribution, Ad libros publications inc., vol. 18(1), pages 70-89, March.
    18. Holmström, Lasse & Klemelä, Jussi, 1992. "Asymptotic bounds for the expected L1 error of a multivariate kernel density estimator," Journal of Multivariate Analysis, Elsevier, vol. 42(2), pages 245-266, August.
    19. Donald W. K. Andrews & Patrik Guggenberger, 2009. "Hybrid and Size-Corrected Subsampling Methods," Econometrica, Econometric Society, vol. 77(3), pages 721-762, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gordon Anderson & Oliver Linton & Maria Grazia Pittau & Yoon-Jae Whang & Roberto Zelli, 2021. "On unit free assessment of the extent of multilateral distributional variation," The Econometrics Journal, Royal Economic Society, vol. 24(3), pages 502-518.
    2. Lee, Sokbae & Song, Kyungchul & Whang, Yoon-Jae, 2018. "Testing For A General Class Of Functional Inequalities," Econometric Theory, Cambridge University Press, vol. 34(5), pages 1018-1064, October.
    3. Anderson, Gordon & Leo, Teng Wah, 2013. "An empirical examination of matching theories: The one child policy, partner choice and matching intensity in urban China," Journal of Comparative Economics, Elsevier, vol. 41(2), pages 468-489.
    4. Liu, Shen & Maharaj, Elizabeth Ann & Inder, Brett, 2014. "Polarization of forecast densities: A new approach to time series classification," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 345-361.
    5. Toru Kitagawa, 2013. "A bootstrap test for instrument validity in heterogeneous treatment effect models," CeMMAP working papers CWP53/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    6. Toru Kitagawa, 2013. "A bootstrap test for instrument validity in heterogeneous treatment effect models," CeMMAP working papers 53/13, Institute for Fiscal Studies.
    7. Beare, Brendan K. & Shi, Xiaoxia, 2019. "An improved bootstrap test of density ratio ordering," Econometrics and Statistics, Elsevier, vol. 10(C), pages 9-26.
    8. Maria Grazia Pittau & Roberto Zelli, 2017. "At the roots of Gini’s transvariation: extracts from “Il concetto di transvariazione e le sue prime applicazioni”," METRON, Springer;Sapienza Università di Roma, vol. 75(2), pages 127-140, August.
    9. Lee, Sokbae & Song, Kyungchul & Whang, Yoon-Jae, 2013. "Testing functional inequalities," Journal of Econometrics, Elsevier, vol. 172(1), pages 14-32.
    10. Christian M Dahl & Martin Huber & Giovanni Mellace, 2023. "It is never too LATE: a new look at local average treatment effects with or without defiers," The Econometrics Journal, Royal Economic Society, vol. 26(3), pages 378-404.
    11. Gordon Anderson & Oliver Linton & Jasmin Thomas, 2017. "Similarity, dissimilarity and exceptionality: generalizing Gini’s transvariation to measure “differentness” in many distributions," METRON, Springer;Sapienza Università di Roma, vol. 75(2), pages 161-180, August.
    12. Chemeris, Anna & Liu, Yong & Ker, Alan P., 2022. "Insurance subsidies, climate change, and innovation: Implications for crop yield resiliency," Food Policy, Elsevier, vol. 108(C).
    13. Maribel Jiménez & Mónica Jiménez, 2019. "Intergenerational educational mobility in Latin America. An analysis from the equal opportunity approach," Revista Cuadernos de Economia, Universidad Nacional de Colombia, FCE, CID, vol. 38(76), pages 289-330, January.
    14. Gordon Anderson & Alessio Farcomeni & Grazia Pittau & Roberto Zelli, 2014. "A new approach to measuring and studying the characteristics of class membership: The progress of poverty, inequality and polarization of income classes in urban China," Working Papers tecipa-521, University of Toronto, Department of Economics.
    15. François Gerard & Miikka Rokkanen & Christoph Rothe, 2020. "Bounds on treatment effects in regression discontinuity designs with a manipulated running variable," Quantitative Economics, Econometric Society, vol. 11(3), pages 839-870, July.
    16. Gordon Anderson & Teng Leo & Robert Muelhaupt, 2014. "Measuring Advances in Equality of Opportunity: The Changing Gender Gap in Educational Attainment in Canada in the Last Half Century," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 119(1), pages 73-99, October.
    17. Wang, Dan & Tian, Lili, 2017. "Parametric methods for confidence interval estimation of overlap coefficients," Computational Statistics & Data Analysis, Elsevier, vol. 106(C), pages 12-26.
    18. Gerard, François & Rothe, Christoph & Rokkanen, Miikka, 2016. "Bounds on Treatment Effects in Regression Discontinuity Designs under Manipulation of the Running Variable, with an Application," CEPR Discussion Papers 11668, C.E.P.R. Discussion Papers.
    19. Gordon Anderson & Maria Pittau & Roberto Zelli, 2014. "Poverty status probability: a new approach to measuring poverty and the progress of the poor," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 12(4), pages 469-488, December.
    20. Anderson, Gordon & Farcomeni, Alessio & Pittau, Maria Grazia & Zelli, Roberto, 2016. "A new approach to measuring and studying the characteristics of class membership: Examining poverty, inequality and polarization in urban China," Journal of Econometrics, Elsevier, vol. 191(2), pages 348-359.
    21. Gordon Anderson & Maria Grazia Pittau & Roberto Zelli, 2020. "Measuring the progress of equality of educational opportunity in absence of cardinal comparability," METRON, Springer;Sapienza Università di Roma, vol. 78(2), pages 155-174, August.
    22. Anderson, Gordon & Fu, Rui & Leo, Teng Wah, 2022. "Health, loneliness and the ageing process in the absence of cardinal measure: Rendering intangibles tangible," The Journal of the Economics of Ageing, Elsevier, vol. 22(C).
    23. Sokbae (Simon) Lee & Kyungchui (Kevin) Song & Yoon-Jae Whang, 2014. "Testing for a general class of functional inequalities," CeMMAP working papers 09/14, Institute for Fiscal Studies.
    24. Seo, Juwon, 2018. "Tests of stochastic monotonicity with improved power," Journal of Econometrics, Elsevier, vol. 207(1), pages 53-70.
    25. Claudia Noack, 2021. "Sensitivity of LATE Estimates to Violations of the Monotonicity Assumption," Papers 2106.06421, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gordon Anderson & Oliver Linton & Yoon-Jae Whang, 2009. "Nonparametric Estimation of a Polarization Measure," Cowles Foundation Discussion Papers 1714, Cowles Foundation for Research in Economics, Yale University.
    2. Michal Brzezinski, 2013. "Income Polarization and Economic Growth," LIS Working papers 587, LIS Cross-National Data Center in Luxembourg.
    3. Mariateresa Ciommi & Chiara Gigliarano & Giovanni Maria Giorgi, 2019. "Bonferroni And De Vergottini Are Back: New Subgroup Decompositions And Bipolarization Measures," Working Papers 439, Universita' Politecnica delle Marche (I), Dipartimento di Scienze Economiche e Sociali.
    4. Chiara Gigliarano & Daniel Nowak & Karl Mosler, 2019. "A Polarization Index for Overlapping Groups," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 65(4), pages 712-735, December.
    5. Azomahou, Théophile T. & Diene, Mbaye, 2012. "Polarization patterns in economic development and innovation," Structural Change and Economic Dynamics, Elsevier, vol. 23(4), pages 421-436.
    6. Azomahou, Theophile & Diene, Mbaye, 2012. "Income polarization and innovation: Evidence from African economies," MERIT Working Papers 2012-048, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    7. Fabio Clementi & Francesco Schettino, 2013. "Income polarization in Brazil, 2001-2011: A distributional analysis using PNAD data," Economics Bulletin, AccessEcon, vol. 33(3), pages 1796-1815.
    8. Ori Haimanko & Michel Breton & Shlomo Weber, 2007. "The stability threshold and two facets of polarization," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 30(3), pages 415-430, March.
    9. Chiara Assunta Ricci & Sergio Scicchitano, 2021. "Decomposing changes in income polarization by population group: what happened during the crisis?," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 38(1), pages 235-259, April.
    10. Joan Esteban & Debraj Ray, 2005. "A Comparison of Polarization Measures," Working Papers 310, Barcelona School of Economics.
    11. Maria Livia ŞTEFĂNESCU, 2015. "Analyzing the health status of the population using ordinal data," Computational Methods in Social Sciences (CMSS), "Nicolae Titulescu" University of Bucharest, Faculty of Economic Sciences, vol. 3(1), pages 18-24, June.
    12. Walter Bossert & William Schworm, 2008. "A Class of Two‐Group Polarization Measures," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 10(6), pages 1169-1187, December.
    13. Tomasz Panek & Jan Zwierzchowski, 2020. "Median Relative Partial Income Polarization Indices: Investigating Economic Polarization in Poland During the Years 2005–2015," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 149(3), pages 1025-1044, June.
    14. Masato Okamoto, 2022. "Lorenz and Polarization Orderings of the Double-Pareto Lognormal Distribution and Other Size Distributions," Sankhya B: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 84(2), pages 548-574, November.
    15. Ma Casilda Lasso de la Vega & Ana Urrutia & Henar Díez, 2010. "Unit Consistency And Bipolarization Of Income Distributions," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 56(1), pages 65-83, March.
    16. Duclos, Jean-Yves & Echevin, Damien, 2005. "Bi-polarization comparisons," Economics Letters, Elsevier, vol. 87(2), pages 249-258, May.
    17. Li, Jing & Wan, Guanghua & Wang, Chen & Zhang, Xueliang, 2019. "Which indicator of income distribution explains crime better? Evidence from China," China Economic Review, Elsevier, vol. 54(C), pages 51-72.
    18. Joachim Merz & Bettina Scherg, 2013. "Polarization of Time and Income: A Multidimensional Approach with Well-Being Gap and Minimum 2DGAP ; German Evidence," SOEPpapers on Multidisciplinary Panel Data Research 574, DIW Berlin, The German Socio-Economic Panel (SOEP).
    19. Mohammad Hussain, 2009. "The sensitivity of income polarization," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 7(3), pages 207-223, September.
    20. Joan Esteban & Carlos Gradín & Debraj Ray, 2007. "An Extension of a Measure of Polarization, with an application to the income distribution of five OECD countries," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 5(1), pages 1-19, April.

    More about this item

    Keywords

    Kernel estimation; Inequality; Overlap coefficient; Poissonization; Total variation;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • D63 - Microeconomics - - Welfare Economics - - - Equity, Justice, Inequality, and Other Normative Criteria and Measurement

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:171:y:2012:i:1:p:1-23. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.