IDEAS home Printed from
   My bibliography  Save this paper

Bayesian Variants of Some classical Semiparametric Regression Techniques




This paper develops new Bayesian methods for semiparametric inference in the partial linear Normal regression model: y = z*beta + f(x) + epsilon, where f(.) is an unknown function. These methods draw solely on the Normal linear regression model with natural conjugate prior. Hence, analytical finite sample results are available which do not suffer from problems of theoretical and computational complexity which plague the existing literature. Constrained and unconstrained estimation are considered as is testing of parametric regression models against semiparametric alternatives and prediction. We discuss how these methods can, at some cost in terms of computational complexity, be extended to other models (e.g. qualitative choice models or those involving censoring or truncation) and provide precise details for semiparametric probit and tobit models. We show how the assumption of Normal errors can easily be relaxed. Our methods are illustrated using artificial and real data sets.

Suggested Citation

  • Gary Koop & Dale J Poirer, 2001. "Bayesian Variants of Some classical Semiparametric Regression Techniques," Edinburgh School of Economics Discussion Paper Series 73, Edinburgh School of Economics, University of Edinburgh.
  • Handle: RePEc:edn:esedps:73

    Download full text from publisher

    File URL:
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    1. Matzkin, Rosa L., 1986. "Restrictions of economic theory in nonparametric methods," Handbook of Econometrics, in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 42, pages 2523-2558, Elsevier.
    2. Geweke, John, 1986. "Exact Inference in the Inequality Constrained Normal Linear Regression Model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 1(2), pages 127-141, April.
    3. Hardle, Wolfgang & Linton, Oliver, 1986. "Applied nonparametric methods," Handbook of Econometrics, in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 38, pages 2295-2339, Elsevier.
    4. Pagan,Adrian & Ullah,Aman, 1999. "Nonparametric Econometrics," Cambridge Books, Cambridge University Press, number 9780521355643, June.
    5. Fernandez, Carmen & Osiewalski, Jacek & Steel, Mark F. J., 1997. "On the use of panel data in stochastic frontier models with improper priors," Journal of Econometrics, Elsevier, vol. 79(1), pages 169-193, July.
    6. McCulloch, Robert & Rossi, Peter E., 1994. "An exact likelihood analysis of the multinomial probit model," Journal of Econometrics, Elsevier, vol. 64(1-2), pages 207-240.
    7. Shiller, Robert J, 1973. "A Distributed Lag Estimator Derived from Smoothness Priors," Econometrica, Econometric Society, vol. 41(4), pages 775-788, July.
    8. Kajal Lahiri, 2005. "Analysis of Panel Data," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(4), pages 1093-1095.
    9. Poirier, Dale J., 1998. "Revising Beliefs In Nonidentified Models," Econometric Theory, Cambridge University Press, vol. 14(4), pages 483-509, August.
    10. Leamer, Edward E, 1982. "Sets of Posterior Means with Bounded Variance Priors," Econometrica, Econometric Society, vol. 50(3), pages 725-736, May.
    11. John F. Geweke & Michael P. Keane, 1997. "Mixture of normals probit models," Staff Report 237, Federal Reserve Bank of Minneapolis.
    12. Adonis Yatchew, 1998. "Nonparametric Regression Techniques in Economics," Journal of Economic Literature, American Economic Association, vol. 36(2), pages 669-721, June.
    13. John Xu Zheng, 1996. "A consistent test of functional form via nonparametric estimation techniques," Journal of Econometrics, Elsevier, vol. 75(2), pages 263-289, December.
    14. Dale J. Poirier, 1995. "Intermediate Statistics and Econometrics: A Comparative Approach," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262161494, September.
    15. Iwata, Shigeru, 1996. "Bounding posterior means by model criticism," Journal of Econometrics, Elsevier, vol. 75(2), pages 239-261, December.
    16. Hong, Yongmiao & White, Halbert, 1995. "Consistent Specification Testing via Nonparametric Series Regression," Econometrica, Econometric Society, vol. 63(5), pages 1133-1159, September.
    17. Chib, Siddhartha, 1992. "Bayes inference in the Tobit censored regression model," Journal of Econometrics, Elsevier, vol. 51(1-2), pages 79-99.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Geweke, J. & Joel Horowitz & Pesaran, M.H., 2006. "Econometrics: A Bird’s Eye View," Cambridge Working Papers in Economics 0655, Faculty of Economics, University of Cambridge.
    2. Gary Koop, 2004. "Modelling the evolution of distributions: an application to Major League baseball," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 167(4), pages 639-655, November.
    3. Hall, Peter & Yatchew, Adonis, 2005. "Unified approach to testing functional hypotheses in semiparametric contexts," Journal of Econometrics, Elsevier, vol. 127(2), pages 225-252, August.
    4. Dale J. Poirier & Gary Koop & Justin Tobias, 2005. "Semiparametric Bayesian inference in multiple equation models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(6), pages 723-747.
    5. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, number 8355, October.
    6. Ichimura, Hidehiko & Todd, Petra E., 2007. "Implementing Nonparametric and Semiparametric Estimators," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 74, Elsevier.
    7. Fousekis, Panos & Lazaridis, Panagiotis, 2001. "Food Expenditure Patterns of the Urban and the Rural Households in Greece. A Kernel Regression Analysis," Agricultural Economics Review, Greek Association of Agricultural Economists, vol. 2(1), pages 1-16, January.
    8. Gao, Jiti & King, Maxwell, 2003. "Estimation and model specification testing in nonparametric and semiparametric econometric models," MPRA Paper 11989, University Library of Munich, Germany, revised Feb 2006.
    9. Palmquist, Raymond B., 2006. "Property Value Models," Handbook of Environmental Economics, in: K. G. Mäler & J. R. Vincent (ed.), Handbook of Environmental Economics, edition 1, volume 2, chapter 16, pages 763-819, Elsevier.
    10. O'Donnell, Christopher J. & Coelli, Timothy J., 2005. "A Bayesian approach to imposing curvature on distance functions," Journal of Econometrics, Elsevier, vol. 126(2), pages 493-523, June.
    11. Koop, Gary & Tobias, Justin L., 2006. "Semiparametric Bayesian inference in smooth coefficient models," Journal of Econometrics, Elsevier, vol. 134(1), pages 283-315, September.
    12. Gao, Jiti, 2007. "Nonlinear time series: semiparametric and nonparametric methods," MPRA Paper 39563, University Library of Munich, Germany, revised 01 Sep 2007.
    13. Arana, Jorge E. & Leon, Carmelo J., 2005. "Flexible mixture distribution modeling of dichotomous choice contingent valuation with heterogenity," Journal of Environmental Economics and Management, Elsevier, vol. 50(1), pages 170-188, July.
    14. Lin, Zhongjian & Li, Qi & Sun, Yiguo, 2014. "A consistent nonparametric test of parametric regression functional form in fixed effects panel data models," Journal of Econometrics, Elsevier, vol. 178(P1), pages 167-179.
    15. Livanis, Grigorios T. & Salois, Matthew J. & Moss, Charles B., 2009. "A Nonparametric Kernel Representation of the Agricultural Production Function: Implications for Economic Measures of Technology," 83rd Annual Conference, March 30 - April 1, 2009, Dublin, Ireland 51063, Agricultural Economics Society.
    16. Horowitz, Joel L. & Spokoiny, Vladimir G., 1999. "An Adaptive, Rate-Optimal Test of a Parametric Model Against a Nonparametric Alternative," Working Papers 99-02, University of Iowa, Department of Economics.
    17. Jorge E. Arana & Carmelo J. Leon, 2004. "Baysian Flexible Mixture Distribution Modelling of Dichotomous Choice Contingent Valuation with Heterogeneity," Econometric Society 2004 North American Summer Meetings 568, Econometric Society.
    18. Fang, Hao Audrey, 2008. "A discrete-continuous model of households' vehicle choice and usage, with an application to the effects of residential density," Transportation Research Part B: Methodological, Elsevier, vol. 42(9), pages 736-758, November.
    19. El Ghouch, Anouar & Genton, Marc G. & Bouezmarni , Taoufik, 2012. "Measuring the Discrepancy of a Parametric Model via Local Polynomial Smoothing," LIDAM Discussion Papers ISBA 2012001, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    20. Bouezmarni, Taoufik & Rombouts, Jeroen V.K., 2010. "Nonparametric density estimation for positive time series," Computational Statistics & Data Analysis, Elsevier, vol. 54(2), pages 245-261, February.

    More about this item

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General

    NEP fields

    This paper has been announced in the following NEP Reports:


    Access and download statistics


    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:edn:esedps:73. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Research Office). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.