IDEAS home Printed from https://ideas.repec.org/a/bla/scjsta/v41y2014i3p656-671.html
   My bibliography  Save this article

A New Regression Model: Modal Linear Regression

Author

Listed:
  • Weixin Yao
  • Longhai Li

Abstract

type="main" xml:id="sjos12054-abs-0001"> The mode of a distribution provides an important summary of data and is often estimated on the basis of some non-parametric kernel density estimator. This article develops a new data analysis tool called modal linear regression in order to explore high-dimensional data. Modal linear regression models the conditional mode of a response Y given a set of predictors x as a linear function of x . Modal linear regression differs from standard linear regression in that standard linear regression models the conditional mean (as opposed to mode) of Y as a linear function of x . We propose an expectation–maximization algorithm in order to estimate the regression coefficients of modal linear regression. We also provide asymptotic properties for the proposed estimator without the symmetric assumption of the error density. Our empirical studies with simulated data and real data demonstrate that the proposed modal regression gives shorter predictive intervals than mean linear regression, median linear regression and MM-estimators.

Suggested Citation

  • Weixin Yao & Longhai Li, 2014. "A New Regression Model: Modal Linear Regression," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 41(3), pages 656-671, September.
    • Handle: RePEc:bla:scjsta:v:41:y:2014:i:3:p:656-671
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/sjos.12054
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yao, Weixin, 2013. "A note on EM algorithm for mixture models," Statistics & Probability Letters, Elsevier, vol. 83(2), pages 519-526.
    2. Yao, Weixin & Lindsay, Bruce G., 2009. "Bayesian Mixture Labeling by Highest Posterior Density," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 758-767.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wang, Kangning & Li, Shaomin & Sun, Xiaofei & Lin, Lu, 2019. "Modal regression statistical inference for longitudinal data semivarying coefficient models: Generalized estimating equations, empirical likelihood and variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 133(C), pages 257-276.
    2. Wang, Kangning & Li, Shaomin, 2021. "Robust distributed modal regression for massive data," Computational Statistics & Data Analysis, Elsevier, vol. 160(C).
    3. Gordon C. R. Kemp & Paulo M. D. C. Parente & J. M. C. Santos Silva, 2020. "Dynamic Vector Mode Regression," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(3), pages 647-661, July.
    4. Neng-Chieh Chang, 2020. "The Mode Treatment Effect," Papers 2007.11606, arXiv.org.
    5. Xin Jing & Jin Seo Cho, 2023. "Forecasting the Confirmed COVID-19 Cases Using Modal Regression," Working papers 2023rwp-217, Yonsei University, Yonsei Economics Research Institute.
    6. Jales, Hugo & Jiang, Boqian & Rosenthal, Stuart S., 2023. "JUE Insight: Using the mode to test for selection in city size wage premia," Journal of Urban Economics, Elsevier, vol. 133(C).
    7. Yang, Jing & Tian, Guoliang & Lu, Fang & Lu, Xuewen, 2020. "Single-index modal regression via outer product gradients," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    8. Katarzyna Lukiewska, 2022. "Impact of Labor Productivity on the Export Performance of the Food Industry in EU Member States," European Research Studies Journal, European Research Studies Journal, vol. 0(3), pages 74-83.
    9. Aman Ullah & Tao Wang & Weixin Yao, 2022. "Nonlinear modal regression for dependent data with application for predicting COVID‐19," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 1424-1453, July.
    10. Aman Ullah & Tao Wang & Weixin Yao, 2021. "Modal regression for fixed effects panel data," Empirical Economics, Springer, vol. 60(1), pages 261-308, January.
    11. Yen-Chi Chen, 2017. "Modal Regression using Kernel Density Estimation: a Review," Papers 1710.07004, arXiv.org, revised Dec 2017.
    12. Francesco Dotto & Alessio Farcomeni & Luis Angel García-Escudero & Agustín Mayo-Iscar, 2017. "A fuzzy approach to robust regression clustering," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 11(4), pages 691-710, December.
    13. repec:esx:essedp:761 is not listed on IDEAS
    14. Shi, Jianhong & Zhang, Yujing & Yu, Ping & Song, Weixing, 2021. "SIMEX estimation in parametric modal regression with measurement error," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).
    15. Evon M. Abu-Taieh & Issam AlHadid & Ra’ed Masa’deh & Rami S. Alkhawaldeh & Sufian Khwaldeh & Ala’aldin Alrowwad, 2022. "Factors Affecting the Use of Social Networks and Its Effect on Anxiety and Depression among Parents and Their Children: Predictors Using ML, SEM and Extended TAM," IJERPH, MDPI, vol. 19(21), pages 1-27, October.
    16. Ullah, Aman & Wang, Tao & Yao, Weixin, 2023. "Semiparametric partially linear varying coefficient modal regression," Journal of Econometrics, Elsevier, vol. 235(2), pages 1001-1026.
    17. Shaomin Li & Kangning Wang & Yong Xu, 2023. "Robust estimation for nonrandomly distributed data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(3), pages 493-509, June.
    18. Hu Yang & Ning Li & Jing Yang, 2020. "A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates," Statistical Papers, Springer, vol. 61(5), pages 1911-1937, October.
    19. Yunlu Jiang & Guo-Liang Tian & Yu Fei, 2019. "A robust and efficient estimation method for partially nonlinear models via a new MM algorithm," Statistical Papers, Springer, vol. 60(6), pages 2063-2085, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daeyoung Kim & Bruce Lindsay, 2015. "Empirical identifiability in finite mixture models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 67(4), pages 745-772, August.
    2. Yao, Weixin & Wei, Yan & Yu, Chun, 2014. "Robust mixture regression using the t-distribution," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 116-127.
    3. Linton, Oliver & Xiao, Zhijie, 2019. "Efficient estimation of nonparametric regression in the presence of dynamic heteroskedasticity," Journal of Econometrics, Elsevier, vol. 213(2), pages 608-631.
    4. Xue, Jiacheng & Yao, Weixin, 2022. "Machine Learning Embedded Semiparametric Mixtures of Regressions with Covariate-Varying Mixing Proportions," Econometrics and Statistics, Elsevier, vol. 22(C), pages 159-171.
    5. Kai Deng & Xin Zhang, 2022. "Tensor envelope mixture model for simultaneous clustering and multiway dimension reduction," Biometrics, The International Biometric Society, vol. 78(3), pages 1067-1079, September.
    6. Lu, Xiaosun & Huang, Yangxin & Zhu, Yiliang, 2016. "Finite mixture of nonlinear mixed-effects joint models in the presence of missing and mismeasured covariate, with application to AIDS studies," Computational Statistics & Data Analysis, Elsevier, vol. 93(C), pages 119-130.
    7. Seo, Byungtae & Kim, Daeyoung, 2012. "Root selection in normal mixture models," Computational Statistics & Data Analysis, Elsevier, vol. 56(8), pages 2454-2470.
    8. Murray, Paula M. & Browne, Ryan P. & McNicholas, Paul D., 2017. "Hidden truncation hyperbolic distributions, finite mixtures thereof, and their application for clustering," Journal of Multivariate Analysis, Elsevier, vol. 161(C), pages 141-156.
    9. Bai, Xiuqin & Yao, Weixin & Boyer, John E., 2012. "Robust fitting of mixture regression models," Computational Statistics & Data Analysis, Elsevier, vol. 56(7), pages 2347-2359.
    10. Jia-Chiun Pan & Guan-Hua Huang, 2014. "Bayesian Inferences of Latent Class Models with an Unknown Number of Classes," Psychometrika, Springer;The Psychometric Society, vol. 79(4), pages 621-646, October.
    11. Xu, Lin & Xiang, Sijia & Yao, Weixin, 2019. "Robust maximum Lq-likelihood estimation of joint mean–covariance models for longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 397-411.
    12. Hu, Hao & Yao, Weixin & Wu, Yichao, 2017. "The robust EM-type algorithms for log-concave mixtures of regression models," Computational Statistics & Data Analysis, Elsevier, vol. 111(C), pages 14-26.
    13. Sijia Xiang & Weixin Yao, 2020. "Semiparametric mixtures of regressions with single-index for model based clustering," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 14(2), pages 261-292, June.
    14. Zhang, Yifan & Fong, Duncan K.H. & DeSarbo, Wayne S., 2021. "A generalized ordinal finite mixture regression model for market segmentation," International Journal of Research in Marketing, Elsevier, vol. 38(4), pages 1055-1072.
    15. Sijia Xiang & Weixin Yao, 2018. "Semiparametric mixtures of nonparametric regressions," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 70(1), pages 131-154, February.
    16. Aßmann, Christian & Boysen-Hogrefe, Jens, 2011. "A Bayesian approach to model-based clustering for binary panel probit models," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 261-279, January.
    17. Gutiérrez, Luis & Gutiérrez-Peña, Eduardo & Mena, Ramsés H., 2014. "Bayesian nonparametric classification for spectroscopy data," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 56-68.
    18. Antonio Punzo & Paul. D. McNicholas, 2017. "Robust Clustering in Regression Analysis via the Contaminated Gaussian Cluster-Weighted Model," Journal of Classification, Springer;The Classification Society, vol. 34(2), pages 249-293, July.
    19. Xiang, Sijia & Yao, Weixin & Seo, Byungtae, 2016. "Semiparametric mixture: Continuous scale mixture approach," Computational Statistics & Data Analysis, Elsevier, vol. 103(C), pages 413-425.
    20. Aman Ullah & Tao Wang & Weixin Yao, 2021. "Modal regression for fixed effects panel data," Empirical Economics, Springer, vol. 60(1), pages 261-308, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:scjsta:v:41:y:2014:i:3:p:656-671. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0303-6898 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.