IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v113y2017icp207-225.html

Developments of the total entropy utility function for the dual purpose of model discrimination and parameter estimation in Bayesian design

Author

Listed:
  • McGree, J.M.

Abstract

The total entropy utility function is considered for the dual purpose of model discrimination and parameter estimation in Bayesian design. A sequential design setting is considered where it is shown how to efficiently estimate the total entropy utility function in discrete data settings. Utility estimation relies on forming particle approximations to a number of intractable integrals which is afforded by the use of the sequential Monte Carlo algorithm for Bayesian inference. A number of motivating examples are considered for demonstrating the performance of total entropy in comparison to utilities for model discrimination and parameter estimation. The results suggest that the total entropy utility selects designs which are efficient under both experimental goals with little compromise in achieving either goal. As such, for the type of problems considered in this paper, the total entropy utility is advocated as a general utility for Bayesian design in the presence of model uncertainty.

Suggested Citation

  • McGree, J.M., 2017. "Developments of the total entropy utility function for the dual purpose of model discrimination and parameter estimation in Bayesian design," Computational Statistics & Data Analysis, Elsevier, vol. 113(C), pages 207-225.
    • Handle: RePEc:eee:csdana:v:113:y:2017:i:c:p:207-225
    DOI: 10.1016/j.csda.2016.05.020
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947316301323
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2016.05.020?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Pierre Del Moral & Arnaud Doucet & Ajay Jasra, 2006. "Sequential Monte Carlo samplers," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 411-436, June.
    2. Elizabeth G. Ryan & Christopher C. Drovandi & James M. McGree & Anthony N. Pettitt, 2016. "A Review of Modern Computational Algorithms for Bayesian Optimal Design," International Statistical Review, International Statistical Institute, vol. 84(1), pages 128-154, April.
    3. Dette, Holger & Bretz, Frank & Pepelyshev, Andrey & Pinheiro, José, 2008. "Optimal Designs for Dose-Finding Studies," Journal of the American Statistical Association, American Statistical Association, vol. 103(483), pages 1225-1237.
    4. Drovandi, Christopher C. & McGree, James M. & Pettitt, Anthony N., 2013. "Sequential Monte Carlo for Bayesian sequentially designed experiments for discrete data," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 320-335.
    5. Dette, Holger & Franke, Tobias, 2000. "Constrained D- and D1-optimal designs for polynomial regression," Technical Reports 2000,37, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    6. Hsin-Ping Wu & John Stufken, 2014. "Locally ϕp-optimal designs for generalized linear models with a single-variable quadratic polynomial predictor," Biometrika, Biometrika Trust, vol. 101(2), pages 365-375.
    7. Unknown, 2001. "Back Matter," SS-AAEA Journal of Agricultural Economics, Agricultural and Applied Economics Association, pages 1-4.
    8. Jonathan R. Stroud & Peter Müller & Gary L. Rosner, 2001. "Optimal sampling times in population pharmacokinetic studies," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 50(3), pages 345-359.
    9. Håvard Rue & Sara Martino & Nicolas Chopin, 2009. "Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(2), pages 319-392, April.
    10. Stefanie Biedermann & Holger Dette & Philipp Hoffmann, 2009. "Constrained optimal discrimination designs for Fourier regression models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 61(1), pages 143-157, March.
    11. Stefanie Biedermann & David C. Woods, 2011. "Optimal designs for generalized non‐linear models with application to second‐harmonic generation experiments," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 60(2), pages 281-299, March.
    12. Nicolas Chopin, 2002. "A sequential particle filter method for static models," Biometrika, Biometrika Trust, vol. 89(3), pages 539-552, August.
    13. Ryan, Elizabeth G. & Drovandi, Christopher C. & Pettitt, Anthony N., 2015. "Simulation-based fully Bayesian experimental design for mixed effects models," Computational Statistics & Data Analysis, Elsevier, vol. 92(C), pages 26-39.
    14. Christopher C. Drovandi & Anthony N. Pettitt, 2013. "Bayesian Experimental Design for Models with Intractable Likelihoods," Biometrics, The International Biometric Society, vol. 69(4), pages 937-948, December.
    15. Dror, Hovav A. & Steinberg, David M., 2008. "Sequential Experimental Designs for Generalized Linear Models," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 288-298, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dehideniya, Mahasen B. & Drovandi, Christopher C. & McGree, James M., 2018. "Optimal Bayesian design for discriminating between models with intractable likelihoods in epidemiology," Computational Statistics & Data Analysis, Elsevier, vol. 124(C), pages 277-297.
    2. S. G. J. Senarathne & C. C. Drovandi & J. M. McGree, 2020. "Bayesian sequential design for Copula models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 29(2), pages 454-478, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Drovandi, Christopher C. & McGree, James M. & Pettitt, Anthony N., 2013. "Sequential Monte Carlo for Bayesian sequentially designed experiments for discrete data," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 320-335.
    2. Dehideniya, Mahasen B. & Drovandi, Christopher C. & McGree, James M., 2018. "Optimal Bayesian design for discriminating between models with intractable likelihoods in epidemiology," Computational Statistics & Data Analysis, Elsevier, vol. 124(C), pages 277-297.
    3. Ryan, Elizabeth G. & Drovandi, Christopher C. & Thompson, M. Helen & Pettitt, Anthony N., 2014. "Towards Bayesian experimental design for nonlinear models that require a large number of sampling times," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 45-60.
    4. Elizabeth G. Ryan & Christopher C. Drovandi & James M. McGree & Anthony N. Pettitt, 2016. "A Review of Modern Computational Algorithms for Bayesian Optimal Design," International Statistical Review, International Statistical Institute, vol. 84(1), pages 128-154, April.
    5. C. C. Drovandi & A. N. Pettitt, 2011. "Estimation of Parameters for Macroparasite Population Evolution Using Approximate Bayesian Computation," Biometrics, The International Biometric Society, vol. 67(1), pages 225-233, March.
    6. S. G. J. Senarathne & C. C. Drovandi & J. M. McGree, 2020. "Bayesian sequential design for Copula models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 29(2), pages 454-478, June.
    7. Arnaud Dufays, 2016. "Evolutionary Sequential Monte Carlo Samplers for Change-Point Models," Econometrics, MDPI, vol. 4(1), pages 1-33, March.
    8. Axel Finke & Adam Johansen & Dario Spanò, 2014. "Static-parameter estimation in piecewise deterministic processes using particle Gibbs samplers," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(3), pages 577-609, June.
    9. James Martin & Ajay Jasra & Emma McCoy, 2013. "Inference for a class of partially observed point process models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 65(3), pages 413-437, June.
    10. Min-Hsiao Tsai, 2012. "Efficient discriminating design for a class of nested polynomial regression models," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 75(6), pages 809-817, August.
    11. Fulop, Andras & Li, Junye, 2013. "Efficient learning via simulation: A marginalized resample-move approach," Journal of Econometrics, Elsevier, vol. 176(2), pages 146-161.
    12. Zhang, Jinyu & Zhang, Qiaosen & Li, Yong & Wang, Qianchao, 2023. "Sequential Bayesian inference for agent-based models with application to the Chinese business cycle," Economic Modelling, Elsevier, vol. 126(C).
    13. Ryan, Elizabeth G. & Drovandi, Christopher C. & Pettitt, Anthony N., 2015. "Simulation-based fully Bayesian experimental design for mixed effects models," Computational Statistics & Data Analysis, Elsevier, vol. 92(C), pages 26-39.
    14. Hai‐Dang Dau & Nicolas Chopin, 2022. "Waste‐free sequential Monte Carlo," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(1), pages 114-148, February.
    15. Edward Herbst & Frank Schorfheide, 2014. "Sequential Monte Carlo Sampling For Dsge Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(7), pages 1073-1098, November.
    16. repec:bla:istatr:v:83:y:2015:i:3:p:405-435 is not listed on IDEAS
    17. Xiaohong Chen & Timothy M. Christensen & Elie Tamer, 2018. "Monte Carlo Confidence Sets for Identified Sets," Econometrica, Econometric Society, vol. 86(6), pages 1965-2018, November.
    18. Arnaud Dufays, 2014. "On the conjugacy of off-line and on-line Sequential Monte Carlo Samplers," Working Paper Research 263, National Bank of Belgium.
    19. Ettmeier, Stephanie & Kriwoluzky, Alexander, 2024. "Active or passive? Revisiting the role of fiscal policy during high inflation," European Economic Review, Elsevier, vol. 170(C).
    20. Ettmeier, Stephanie & Kriwoluzky, Alexander, 2019. "Active, or passive? Revisiting the role of fiscal policy in the Great Inflation," VfS Annual Conference 2019 (Leipzig): 30 Years after the Fall of the Berlin Wall - Democracy and Market Economy 203609, Verein für Socialpolitik / German Economic Association.
    21. Nicolas Chopin & Mathieu Gerber, 2017. "Sequential quasi-Monte Carlo: Introduction for Non-Experts, Dimension Reduction, Application to Partly Observed Diffusion Processes," Working Papers 2017-35, Center for Research in Economics and Statistics.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:113:y:2017:i:c:p:207-225. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.