IDEAS home Printed from https://ideas.repec.org/a/bla/jorssb/v71y2009i1p159-175.html

A Bayesian approach to non‐parametric monotone function estimation

Author

Listed:
  • Thomas S. Shively
  • Thomas W. Sager
  • Stephen G. Walker

Abstract

Summary. The paper proposes two Bayesian approaches to non‐parametric monotone function estimation. The first approach uses a hierarchical Bayes framework and a characterization of smooth monotone functions given by Ramsay that allows unconstrained estimation. The second approach uses a Bayesian regression spline model of Smith and Kohn with a mixture distribution of constrained normal distributions as the prior for the regression coefficients to ensure the monotonicity of the resulting function estimate. The small sample properties of the two function estimators across a range of functions are provided via simulation and compared with existing methods. Asymptotic results are also given that show that Bayesian methods provide consistent function estimators for a large class of smooth functions. An example is provided involving economic demand functions that illustrates the application of the constrained regression spline estimator in the context of a multiple‐regression model where two functions are constrained to be monotone.

Suggested Citation

  • Thomas S. Shively & Thomas W. Sager & Stephen G. Walker, 2009. "A Bayesian approach to non‐parametric monotone function estimation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(1), pages 159-175, January.
  • Handle: RePEc:bla:jorssb:v:71:y:2009:i:1:p:159-175
    DOI: 10.1111/j.1467-9868.2008.00677.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1467-9868.2008.00677.x
    Download Restriction: no

    File URL: https://libkey.io/10.1111/j.1467-9868.2008.00677.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. J. O. Ramsay, 1998. "Estimating smooth monotone functions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(2), pages 365-375.
    2. Smith, Michael & Kohn, Robert, 1996. "Nonparametric regression using Bayesian variable selection," Journal of Econometrics, Elsevier, vol. 75(2), pages 317-343, December.
    3. Stephen Walker & Nils Lid Hjort, 2001. "On Bayesian consistency," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(4), pages 811-821.
    4. Brian Neelon & David B. Dunson, 2004. "Bayesian Isotonic Regression and Trend Analysis," Biometrics, The International Biometric Society, vol. 60(2), pages 398-406, June.
    5. Wong, Chi-ming & Kohn, Robert, 1996. "A Bayesian approach to additive semiparametric regression," Journal of Econometrics, Elsevier, vol. 74(2), pages 209-235, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wu, Ximing & Sickles, Robin, 2018. "Semiparametric estimation under shape constraints," Econometrics and Statistics, Elsevier, vol. 6(C), pages 74-89.
    2. Shively, Thomas S. & Walker, Stephen G. & Damien, Paul, 2011. "Nonparametric function estimation subject to monotonicity, convexity and other shape constraints," Journal of Econometrics, Elsevier, vol. 161(2), pages 166-181, April.
    3. Christophe Abraham & Khader Khadraoui, 2015. "Bayesian regression with B-splines under combinations of shape constraints and smoothness properties," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 69(2), pages 150-170, May.
    4. Taeryon Choi & Hea-Jung Kim & Seongil Jo, 2016. "Bayesian variable selection approach to a Bernstein polynomial regression model with stochastic constraints," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(15), pages 2751-2771, November.
    5. Hazelton, Martin L. & Turlach, Berwin A., 2011. "Semiparametric regression with shape-constrained penalized splines," Computational Statistics & Data Analysis, Elsevier, vol. 55(10), pages 2871-2879, October.
    6. Xingdong Feng & Nell Sedransk & Jessie Q. Xia, 2014. "Calibration using constrained smoothing with applications to mass spectrometry data," Biometrics, The International Biometric Society, vol. 70(2), pages 398-408, June.
    7. Shively, Thomas S. & Kockelman, Kara & Damien, Paul, 2010. "A Bayesian semi-parametric model to estimate relationships between crash counts and roadway characteristics," Transportation Research Part B: Methodological, Elsevier, vol. 44(5), pages 699-715, June.
    8. Yang Liu & Xiaojing Wang, 2020. "Bayesian Nonparametric Monotone Regression of Dynamic Latent Traits in Item Response Theory Models," Journal of Educational and Behavioral Statistics, , vol. 45(3), pages 274-296, June.
    9. Lenk, Peter & Lee, Jangwon & Han, Dongu & Park, Jichan & Choi, Taeryon, 2024. "Hierarchical Bayesian spectral regression with shape constraints for multi-group data," Computational Statistics & Data Analysis, Elsevier, vol. 200(C).
    10. C Rohrbeck & D A Costain & A Frigessi, 2018. "Bayesian spatial monotonic multiple regression," Biometrika, Biometrika Trust, vol. 105(3), pages 691-707.
    11. Ander Wilson & David M. Reif & Brian J. Reich, 2014. "Hierarchical dose–response modeling for high-throughput toxicity screening of environmental chemicals," Biometrics, The International Biometric Society, vol. 70(1), pages 237-246, March.
    12. Alexander Henzi & Johanna F. Ziegel & Tilmann Gneiting, 2021. "Isotonic distributional regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(5), pages 963-993, November.
    13. Drew Fudenberg & Wayne Yuan Gao & Zhiheng You, 2026. "Model Restrictiveness in Functional and Structural Settings," Papers 2602.07688, arXiv.org, revised Mar 2026.
    14. Gabriel Riutort-Mayol & Virgilio Gómez-Rubio & José Luis Lerma & Julio M. del Hoyo-Meléndez, 2020. "Correlated Functional Models with Derivative Information for Modeling Microfading Spectrometry Data on Rock Art Paintings," Mathematics, MDPI, vol. 8(12), pages 1-25, December.
    15. Smith, Michael Stanley & Shively, Thomas S., 2018. "Econometric modeling of regional electricity spot prices in the Australian market," Energy Economics, Elsevier, vol. 74(C), pages 886-903.
    16. Andrew G. Atkeson & Karen A. Kopecky & Tao Zha, 2024. "Four Stylized Facts About Covid‐19," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 65(1), pages 3-42, February.
    17. Mary Meyer & Amber Hackstadt & Jennifer Hoeting, 2011. "Bayesian estimation and inference for generalised partial linear models using shape-restricted splines," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 23(4), pages 867-884.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shively, Thomas S. & Kockelman, Kara & Damien, Paul, 2010. "A Bayesian semi-parametric model to estimate relationships between crash counts and roadway characteristics," Transportation Research Part B: Methodological, Elsevier, vol. 44(5), pages 699-715, June.
    2. Shively, Thomas S. & Walker, Stephen G. & Damien, Paul, 2011. "Nonparametric function estimation subject to monotonicity, convexity and other shape constraints," Journal of Econometrics, Elsevier, vol. 161(2), pages 166-181, April.
    3. Cai, Bo & Dunson, David B., 2007. "Bayesian Multivariate Isotonic Regression Splines: Applications to Carcinogenicity Studies," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1158-1171, December.
    4. C Rohrbeck & D A Costain & A Frigessi, 2018. "Bayesian spatial monotonic multiple regression," Biometrika, Biometrika Trust, vol. 105(3), pages 691-707.
    5. Björn Bornkamp & Katja Ickstadt, 2009. "Bayesian Nonparametric Estimation of Continuous Monotone Functions with Applications to Dose–Response Analysis," Biometrics, The International Biometric Society, vol. 65(1), pages 198-205, March.
    6. John Haslett & Andrew Parnell, 2008. "A simple monotone process with application to radiocarbon‐dated depth chronologies," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 57(4), pages 399-418, September.
    7. Christophe Abraham & Khader Khadraoui, 2015. "Bayesian regression with B-splines under combinations of shape constraints and smoothness properties," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 69(2), pages 150-170, May.
    8. Hazelton, Martin L. & Turlach, Berwin A., 2011. "Semiparametric regression with shape-constrained penalized splines," Computational Statistics & Data Analysis, Elsevier, vol. 55(10), pages 2871-2879, October.
    9. Geweke, John & Keane, Michael, 2005. "Bayesian Cross-Sectional Analysis of the Conditional Distribution of Earnings of Men in the United States, 1967-1996: Appendices," MPRA Paper 54286, University Library of Munich, Germany.
    10. Geweke, John & Keane, Michael, 2005. "Bayesian Cross-Sectional Analysis of the Conditional Distribution of Earnings of Men in the United States, 1967-1996," MPRA Paper 54281, University Library of Munich, Germany.
    11. Panagiotelis, Anastasios & Smith, Michael, 2008. "Bayesian identification, selection and estimation of semiparametric functions in high-dimensional additive models," Journal of Econometrics, Elsevier, vol. 143(2), pages 291-316, April.
    12. Chu, Chi-Hsiang & Lee, Kuo-Jung & Hsu, Chien-Chin & Chen, Ray-Bing, 2025. "Bayesian selection approach for categorical responses via multinomial probit models," Computational Statistics & Data Analysis, Elsevier, vol. 212(C).
    13. Kuhlenkasper, Torben & Kauermann, Göran, 2010. "Female wage profiles: An additive mixed model approach to employment breaks due to childcare," HWWI Research Papers 2-18, Hamburg Institute of International Economics (HWWI).
    14. Hoeting, Jennifer A. & Ibrahim, Joseph G., 1998. "Bayesian predictive simultaneous variable and transformation selection in the linear model," Computational Statistics & Data Analysis, Elsevier, vol. 28(1), pages 87-103, July.
    15. Bin Jiang & Anastasios Panagiotelis & George Athanasopoulos & Rob Hyndman & Farshid Vahid, 2016. "Bayesian Rank Selection in Multivariate Regression," Monash Econometrics and Business Statistics Working Papers 6/16, Monash University, Department of Econometrics and Business Statistics.
    16. Fernandez, Carmen & Ley, Eduardo & Steel, Mark F. J., 2001. "Benchmark priors for Bayesian model averaging," Journal of Econometrics, Elsevier, vol. 100(2), pages 381-427, February.
    17. Ji, Yonggang & Lin, Nan & Zhang, Baoxue, 2012. "Model selection in binary and tobit quantile regression using the Gibbs sampler," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 827-839.
    18. Dimitris Korobilis, 2008. "Forecasting in vector autoregressions with many predictors," Advances in Econometrics, in: Bayesian Econometrics, pages 403-431, Emerald Group Publishing Limited.
    19. Charu Sharma & Amber Habib & Sunil Bowry, 2018. "Cluster analysis of stocks using price movements of high frequency data from National Stock Exchange," Papers 1803.09514, arXiv.org.
    20. Bruno Scarpa & David B. Dunson, 2014. "Enriched Stick-Breaking Processes for Functional Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 647-660, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssb:v:71:y:2009:i:1:p:159-175. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.