IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2006.07074.html
   My bibliography  Save this paper

Seemingly Unrelated Regression with Measurement Error: Estimation via Markov chain Monte Carlo and Mean Field Variational Bayes Approximation

Author

Listed:
  • Georges Bresson
  • Anoop Chaturvedi
  • Mohammad Arshad Rahman
  • Shalabh

Abstract

Linear regression with measurement error in the covariates is a heavily studied topic, however, the statistics/econometrics literature is almost silent to estimating a multi-equation model with measurement error. This paper considers a seemingly unrelated regression model with measurement error in the covariates and introduces two novel estimation methods: a pure Bayesian algorithm (based on Markov chain Monte Carlo techniques) and its mean field variational Bayes (MFVB) approximation. The MFVB method has the added advantage of being computationally fast and can handle big data. An issue pertinent to measurement error models is parameter identification, and this is resolved by employing a prior distribution on the measurement error variance. The methods are shown to perform well in multiple simulation studies, where we analyze the impact on posterior estimates arising due to different values of reliability ratio or variance of the true unobserved quantity used in the data generating process. The paper further implements the proposed algorithms in an application drawn from the health literature and shows that modeling measurement error in the data can improve model fitting.

Suggested Citation

  • Georges Bresson & Anoop Chaturvedi & Mohammad Arshad Rahman & Shalabh, 2020. "Seemingly Unrelated Regression with Measurement Error: Estimation via Markov chain Monte Carlo and Mean Field Variational Bayes Approximation," Papers 2006.07074, arXiv.org.
    • Handle: RePEc:arx:papers:2006.07074
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2006.07074
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. W.E. Griffiths & Ma. Rebecca Valenzuela, 2004. "Gibbs Samplers for a Set of Seemingly Unrelated Regressions," Department of Economics - Working Papers Series 912, The University of Melbourne.
    2. Chib, Siddhartha & Greenberg, Edward, 1995. "Hierarchical analysis of SUR models with extensions to correlated serial errors and time-varying parameter models," Journal of Econometrics, Elsevier, vol. 68(2), pages 339-360, August.
    3. Cheng, C.-L. & Shalabh, & Garg, G., 2014. "Coefficient of determination for multiple measurement error models," Journal of Multivariate Analysis, Elsevier, vol. 126(C), pages 137-152.
    4. Raymond J. Carroll & Douglas Midthune & Laurence S. Freedman & Victor Kipnis, 2006. "Seemingly Unrelated Measurement Error Models, with Application to Nutritional Epidemiology," Biometrics, The International Biometric Society, vol. 62(1), pages 75-84, March.
    5. Ormerod, J. T. & Wand, M. P., 2010. "Explaining Variational Approximations," The American Statistician, American Statistical Association, vol. 64(2), pages 140-153.
    6. Chan, Joshua C.C. & Grant, Angelia L., 2016. "Fast computation of the deviance information criterion for latent variable models," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 847-859.
    7. Griffiths, William E & Chotikapanich, Duangkamon, 1997. "Bayesian Methodology for Imposing Inequality Constraints on a Linear Expenditure System with Demographic Factors," Australian Economic Papers, Wiley Blackwell, vol. 36(69), pages 321-341, December.
    8. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Linde, 2014. "The deviance information criterion: 12 years on," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(3), pages 485-493, June.
    9. Faes, C. & Ormerod, J. T. & Wand, M. P., 2011. "Variational Bayesian Inference for Parametric and Nonparametric Regression With Missing Data," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 959-971.
    10. Shalabh, 2003. "Consistent estimation of coefficients in measurement error models with replicated observations," Journal of Multivariate Analysis, Elsevier, vol. 86(2), pages 227-241, August.
    11. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    12. Dale J. Poirier & Gary Koop & Justin Tobias, 2005. "Semiparametric Bayesian inference in multiple equation models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(6), pages 723-747.
    13. Zellner, Arnold & Ando, Tomohiro, 2010. "A direct Monte Carlo approach for Bayesian analysis of the seemingly unrelated regression model," Journal of Econometrics, Elsevier, vol. 159(1), pages 33-45, November.
    14. van Dyk, David A. & Park, Taeyoung, 2008. "Partially Collapsed Gibbs Samplers: Theory and Methods," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 790-796, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chan, Joshua C.C. & Eisenstat, Eric & Koop, Gary, 2016. "Large Bayesian VARMAs," Journal of Econometrics, Elsevier, vol. 192(2), pages 374-390.
    2. Zellner, Arnold & Ando, Tomohiro, 2010. "A direct Monte Carlo approach for Bayesian analysis of the seemingly unrelated regression model," Journal of Econometrics, Elsevier, vol. 159(1), pages 33-45, November.
    3. Li, Yong & Yu, Jun & Zeng, Tao, 2018. "Integrated Deviance Information Criterion for Latent Variable Models," Economics and Statistics Working Papers 6-2018, Singapore Management University, School of Economics.
    4. Dimitris Korobilis & Kenichi Shimizu, 2022. "Bayesian Approaches to Shrinkage and Sparse Estimation," Foundations and Trends(R) in Econometrics, now publishers, vol. 11(4), pages 230-354, June.
    5. Oludare Ariyo & Emmanuel Lesaffre & Geert Verbeke & Adrian Quintero, 2022. "Bayesian Model Selection for Longitudinal Count Data," Sankhya B: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 84(2), pages 516-547, November.
    6. Arnab Kumar Maity & Sanjib Basu & Santu Ghosh, 2021. "Bayesian criterion‐based variable selection," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(4), pages 835-857, August.
    7. Zellner, Arnold & Ando, Tomohiro, 2010. "Bayesian and non-Bayesian analysis of the seemingly unrelated regression model with Student-t errors, and its application for forecasting," International Journal of Forecasting, Elsevier, vol. 26(2), pages 413-434, April.
    8. Li, Yong & Yu, Jun & Zeng, Tao, 2020. "Deviance information criterion for latent variable models and misspecified models," Journal of Econometrics, Elsevier, vol. 216(2), pages 450-493.
    9. Kai Yang & Qingqing Zhang & Xinyang Yu & Xiaogang Dong, 2023. "Bayesian inference for a mixture double autoregressive model," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 77(2), pages 188-207, May.
    10. Kelvyn Jones & David Manley & Ron Johnston & Dewi Owen, 2018. "Modelling residential segregation as unevenness and clustering: A multilevel modelling approach incorporating spatial dependence and tackling the MAUP," Environment and Planning B, , vol. 45(6), pages 1122-1141, November.
    11. Youngseon Lee & Seongil Jo & Jaeyong Lee, 2022. "A variational inference for the Lévy adaptive regression with multiple kernels," Computational Statistics, Springer, vol. 37(5), pages 2493-2515, November.
    12. Papastamoulis, Panagiotis, 2018. "Overfitting Bayesian mixtures of factor analyzers with an unknown number of components," Computational Statistics & Data Analysis, Elsevier, vol. 124(C), pages 220-234.
    13. Joshua C. C. Chan, 2018. "Specification tests for time-varying parameter models with stochastic volatility," Econometric Reviews, Taylor & Francis Journals, vol. 37(8), pages 807-823, September.
    14. Wang, Hao, 2010. "Sparse seemingly unrelated regression modelling: Applications in finance and econometrics," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2866-2877, November.
    15. Hanneke Geerlings & Cees Glas & Wim Linden, 2011. "Modeling Rule-Based Item Generation," Psychometrika, Springer;The Psychometric Society, vol. 76(2), pages 337-359, April.
    16. Shuhui Guo & Lihua Xiong & Jie Chen & Shenglian Guo & Jun Xia & Ling Zeng & Chong-Yu Xu, 2023. "Nonstationary Regional Flood Frequency Analysis Based on the Bayesian Method," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 37(2), pages 659-681, January.
    17. Simon Beyeler & Sylvia Kaufmann, 2021. "Reduced‐form factor augmented VAR—Exploiting sparsity to include meaningful factors," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(7), pages 989-1012, November.
    18. Gabriel Rodriguez & Paul Castillo B. & Junior A. Ojeda Cunya, 2024. "Time-Varying Effects of External Shocks on Macroeconomic Fluctuations in Peru: An Empirical Application using TVP-VAR-SV Models," Open Economies Review, Springer, vol. 35(5), pages 1015-1050, November.
    19. Luts, Jan & Ormerod, John T., 2014. "Mean field variational Bayesian inference for support vector machine classification," Computational Statistics & Data Analysis, Elsevier, vol. 73(C), pages 163-176.
    20. Yang Yang & Lichun Wang, 2024. "A non-iteration Bayesian sampling algorithm for robust seemingly unrelated regression models $$^*$$ ∗," Computational Statistics, Springer, vol. 39(3), pages 1281-1300, May.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2006.07074. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.