IDEAS home Printed from https://ideas.repec.org/a/wly/envmet/v36y2025i2ne70002.html
   My bibliography  Save this article

Stacking Weights and Model Space Selection in Frequentist Model Averaging for Benchmark Dose Estimation

Author

Listed:
  • Jens Riis Baalkilde
  • Niels Richard Hansen
  • Signe Marie Jensen

Abstract

In dose‐response modeling, several models can often yield satisfactory fits to the observed data. The current practice in risk assessment is to use model averaging, which is a way to combine multiple models in a weighted average. A key parameter in risk assessment is the benchmark dose, the dose resulting in a predefined abnormal change in response. Current practice when applying frequentist model averaging is to use weights based on the Akaike Information Criterion (AIC). This paper introduces stacking weights as an alternative for dose‐response modeling and generalizes a Diversity Index from dichotomous to continuous responses for model space selection. Three simulation studies were conducted to evaluate the new methods. They showed that, in three realistic scenarios, recommended strategies generally performed well, with stacking weights outperforming AIC weights in several cases. Strategies involving model selection were less effective. However, in a challenging scenario, none of the methods performed well. Due to the promising results of stacking weights, they have been added to the R package “bmd.”

Suggested Citation

  • Jens Riis Baalkilde & Niels Richard Hansen & Signe Marie Jensen, 2025. "Stacking Weights and Model Space Selection in Frequentist Model Averaging for Benchmark Dose Estimation," Environmetrics, John Wiley & Sons, Ltd., vol. 36(2), March.
  • Handle: RePEc:wly:envmet:v:36:y:2025:i:2:n:e70002
    DOI: 10.1002/env.70002
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/env.70002
    Download Restriction: no

    File URL: https://libkey.io/10.1002/env.70002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Harriet Namata & Marc Aerts & Christel Faes & Peter Teunis, 2008. "Model Averaging in Microbial Risk Assessment Using Fractional Polynomials," Risk Analysis, John Wiley & Sons, vol. 28(4), pages 891-905, August.
    2. Joakim Ringblom & Fereshteh Kalantari & Gunnar Johanson & Mattias Öberg, 2018. "Influence of Distribution of Animals between Dose Groups on Estimated Benchmark Dose and Animal Welfare for Continuous Effects," Risk Analysis, John Wiley & Sons, vol. 38(6), pages 1143-1153, June.
    3. Walter W. Piegorsch & Hui Xiong & Rabi N. Bhattacharya & Lizhen Lin, 2014. "Benchmark Dose Analysis via Nonparametric Regression Modeling," Risk Analysis, John Wiley & Sons, vol. 34(1), pages 135-151, January.
    4. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258, December.
    5. Matthew W. Wheeler & Todd Blessinger & Kan Shao & Bruce C. Allen & Louis Olszyk & J. Allen Davis & Jeffrey S Gift, 2020. "Quantitative Risk Assessment: Developing a Bayesian Approach to Dichotomous Dose–Response Uncertainty," Risk Analysis, John Wiley & Sons, vol. 40(9), pages 1706-1722, September.
    6. Matthew W. Wheeler & Jose Cortiñas Abrahantes & Marc Aerts & Jeffery S. Gift & Jerry Allen Davis, 2022. "Continuous model averaging for benchmark dose analysis: Averaging over distributional forms," Environmetrics, John Wiley & Sons, Ltd., vol. 33(5), August.
    7. Steven B. Kim & Ralph L. Kodell & Hojin Moon, 2014. "A Diversity Index for Model Space Selection in the Estimation of Benchmark and Infectious Doses via Model Averaging," Risk Analysis, John Wiley & Sons, vol. 34(3), pages 453-464, March.
    8. Marc Aerts & Matthew W. Wheeler & José Cortiñas Abrahantes, 2020. "An extended and unified modeling framework for benchmark dose estimation for both continuous and binary data," Environmetrics, John Wiley & Sons, Ltd., vol. 31(7), November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Signe M. Jensen & Felix M. Kluxen & Christian Ritz, 2019. "A Review of Recent Advances in Benchmark Dose Methodology," Risk Analysis, John Wiley & Sons, vol. 39(10), pages 2295-2315, October.
    2. Matthew W. Wheeler & Jose Cortiñas Abrahantes & Marc Aerts & Jeffery S. Gift & Jerry Allen Davis, 2022. "Continuous model averaging for benchmark dose analysis: Averaging over distributional forms," Environmetrics, John Wiley & Sons, Ltd., vol. 33(5), August.
    3. Kitagawa, Toru & Muris, Chris, 2016. "Model averaging in semiparametric estimation of treatment effects," Journal of Econometrics, Elsevier, vol. 193(1), pages 271-289.
    4. Jeffrey S. Racine & Qi Li & Dalei Yu & Li Zheng, 2023. "Optimal Model Averaging of Mixed-Data Kernel-Weighted Spline Regressions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(4), pages 1251-1261, October.
    5. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    6. Davide Fiaschi & Andrea Mario Lavezzi & Angela Parenti, 2020. "Deep and Proximate Determinants of the World Income Distribution," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 66(3), pages 677-710, September.
    7. Fabio Canova & Christian Matthes, 2021. "Dealing with misspecification in structural macroeconometric models," Quantitative Economics, Econometric Society, vol. 12(2), pages 313-350, May.
    8. Yu, Jun & Meng, Xiran & Wang, Yaping, 2023. "Optimal designs for semi-parametric dose-response models under random contamination," Computational Statistics & Data Analysis, Elsevier, vol. 178(C).
    9. Zhongqi Liang & Qihua Wang & Yuting Wei, 2022. "Robust model selection with covariables missing at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 74(3), pages 539-557, June.
    10. HAEDO, Christian & MOUCHART , Michel & ,, 2013. "Specialized agglomerations with areal data: model and detection," LIDAM Discussion Papers CORE 2013060, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    11. Kurisu, Daisuke & Otsu, Taisuke, 2025. "Model averaging for global Fréchet regression," LSE Research Online Documents on Economics 126533, London School of Economics and Political Science, LSE Library.
    12. Bhattacharya, Debopam & Dupas, Pascaline, 2012. "Inferring welfare maximizing treatment assignment under budget constraints," Journal of Econometrics, Elsevier, vol. 167(1), pages 168-196.
    13. Schomaker Michael & Heumann Christian, 2011. "Model Averaging in Factor Analysis: An Analysis of Olympic Decathlon Data," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 7(1), pages 1-15, January.
    14. Dirick, Lore & Claeskens, Gerda & Vasnev, Andrey & Baesens, Bart, 2022. "A hierarchical mixture cure model with unobserved heterogeneity for credit risk," Econometrics and Statistics, Elsevier, vol. 22(C), pages 39-55.
    15. Tumala, Mohammed M & Olubusoye, Olusanya E & Yaaba, Baba N & Yaya, OlaOluwa S & Akanbi, Olawale B, 2017. "Forecasting Nigerian Inflation using Model Averaging methods: Modelling Frameworks to Central Banks," MPRA Paper 88754, University Library of Munich, Germany, revised Feb 2018.
    16. José Manuel Cordero Ferrera & Manuel Muñiz Pérez & Rosa Simancas Rodríguez, 2015. "The influence of socioeconomic factors on cognitive and non-cognitive educational outcomes," Investigaciones de Economía de la Educación volume 10, in: Marta Rahona López & Jennifer Graves (ed.), Investigaciones de Economía de la Educación 10, edition 1, volume 10, chapter 21, pages 413-438, Asociación de Economía de la Educación.
    17. Satoshi Hattori & Masayuki Henmi, 2014. "Stratified doubly robust estimators for the average causal effect," Biometrics, The International Biometric Society, vol. 70(2), pages 270-277, June.
    18. Naoya Sueishi & Arihiro Yoshimura, 2017. "Focused Information Criterion for Series Estimation in Partially Linear Models," The Japanese Economic Review, Japanese Economic Association, vol. 68(3), pages 352-363, September.
    19. Liao, Jun & Zou, Guohua, 2020. "Corrected Mallows criterion for model averaging," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    20. Tune H Pers & Anders Albrechtsen & Claus Holst & Thorkild I A Sørensen & Thomas A Gerds, 2009. "The Validation and Assessment of Machine Learning: A Game of Prediction from High-Dimensional Data," PLOS ONE, Public Library of Science, vol. 4(8), pages 1-8, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:envmet:v:36:y:2025:i:2:n:e70002. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/1180-4009/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.