IDEAS home Printed from https://ideas.repec.org/a/bpj/mcmeap/v26y2020i1p1-16n2.html
   My bibliography  Save this article

Why simple quadrature is just as good as Monte Carlo

Author

Listed:
  • Vanslette Kevin

    (Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA)

  • Al Alsheikh Abdullatif

    (King Abdulaziz City for Science and Technology, Riyadh, Saudi Arabia)

  • Youcef-Toumi Kamal

    (Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA)

Abstract

We motive and calculate Newton–Cotes quadrature integration variance and compare it directly with Monte Carlo (MC) integration variance. We find an equivalence between deterministic quadrature sampling and random MC sampling by noting that MC random sampling is statistically indistinguishable from a method that uses deterministic sampling on a randomly shuffled (permuted) function. We use this statistical equivalence to regularize the form of permissible Bayesian quadrature integration priors such that they are guaranteed to be objectively comparable with MC. This leads to the proof that simple quadrature methods have expected variances that are less than or equal to their corresponding theoretical MC integration variances. Separately, using Bayesian probability theory, we find that the theoretical standard deviations of the unbiased errors of simple Newton–Cotes composite quadrature integrations improve over their worst case errors by an extra dimension independent factor ∝N-12{\propto N^{-\frac{1}{2}}}. This dimension independent factor is validated in our simulations.

Suggested Citation

  • Vanslette Kevin & Al Alsheikh Abdullatif & Youcef-Toumi Kamal, 2020. "Why simple quadrature is just as good as Monte Carlo," Monte Carlo Methods and Applications, De Gruyter, vol. 26(1), pages 1-16, March.
    • Handle: RePEc:bpj:mcmeap:v:26:y:2020:i:1:p:1-16:n:2
    DOI: 10.1515/mcma-2020-2055
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/mcma-2020-2055
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.
    File URL: https://libkey.io/10.1515/mcma-2020-2055?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Carpenter, Bob & Gelman, Andrew & Hoffman, Matthew D. & Lee, Daniel & Goodrich, Ben & Betancourt, Michael & Brubaker, Marcus & Guo, Jiqiang & Li, Peter & Riddell, Allen, 2017. "Stan: A Probabilistic Programming Language," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 76(i01).
    2. W. R. Gilks & P. Wild, 1992. "Adaptive Rejection Sampling for Gibbs Sampling," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 41(2), pages 337-348, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carl P. Schmertmann & Marcos R. Gonzaga, 2018. "Bayesian Estimation of Age-Specific Mortality and Life Expectancy for Small Areas With Defective Vital Records," Demography, Springer;Population Association of America (PAA), vol. 55(4), pages 1363-1388, August.
    2. Tamara Broderick & Robert Gramacy, 2011. "Classification and Categorical Inputs with Treed Gaussian Process Models," Journal of Classification, Springer;The Classification Society, vol. 28(2), pages 244-270, July.
    3. Jose Pina-Sánchez & John Paul Gosling, 2020. "Tackling selection bias in sentencing data analysis: a new approach based on a scale of severity," Quality & Quantity: International Journal of Methodology, Springer, vol. 54(3), pages 1047-1073, June.
    4. Sally Paganin & Christopher J. Paciorek & Claudia Wehrhahn & Abel Rodríguez & Sophia Rabe-Hesketh & Perry de Valpine, 2023. "Computational Strategies and Estimation Performance With Bayesian Semiparametric Item Response Theory Models," Journal of Educational and Behavioral Statistics, , vol. 48(2), pages 147-188, April.
    5. Francis,David C. & Kubinec ,Robert, 2022. "Beyond Political Connections : A Measurement Model Approach to Estimating Firm-levelPolitical Influence in 41 Economies," Policy Research Working Paper Series 10119, The World Bank.
    6. Pang, W. K. & Yang, Z. H. & Hou, S. H. & Leung, P. K., 2002. "Non-uniform random variate generation by the vertical strip method," European Journal of Operational Research, Elsevier, vol. 142(3), pages 595-609, November.
    7. Martinovici, A., 2019. "Revealing attention - how eye movements predict brand choice and moment of choice," Other publications TiSEM 7dca38a5-9f78-4aee-bd81-c, Tilburg University, School of Economics and Management.
    8. Yongping Bao & Ludwig Danwitz & Fabian Dvorak & Sebastian Fehrler & Lars Hornuf & Hsuan Yu Lin & Bettina von Helversen, 2022. "Similarity and Consistency in Algorithm-Guided Exploration," CESifo Working Paper Series 10188, CESifo.
    9. Torsten Heinrich & Jangho Yang & Shuanping Dai, 2020. "Growth, development, and structural change at the firm-level: The example of the PR China," Papers 2012.14503, arXiv.org.
    10. Roy, Vivekananda, 2014. "Efficient estimation of the link function parameter in a robust Bayesian binary regression model," Computational Statistics & Data Analysis, Elsevier, vol. 73(C), pages 87-102.
    11. van Kesteren Erik-Jan & Bergkamp Tom, 2023. "Bayesian analysis of Formula One race results: disentangling driver skill and constructor advantage," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 19(4), pages 273-293, December.
    12. Wu, Lang, 2007. "A computationally efficient method for nonlinear mixed-effects models with nonignorable missing data in time-varying covariates," Computational Statistics & Data Analysis, Elsevier, vol. 51(5), pages 2410-2419, February.
    13. Xin Xu & Yang Lu & Yupeng Zhou & Zhiguo Fu & Yanjie Fu & Minghao Yin, 2021. "An Information-Explainable Random Walk Based Unsupervised Network Representation Learning Framework on Node Classification Tasks," Mathematics, MDPI, vol. 9(15), pages 1-14, July.
    14. Cai, Bo & Lin, Xiaoyan & Wang, Lianming, 2011. "Bayesian proportional hazards model for current status data with monotone splines," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2644-2651, September.
    15. Samantha Leorato & Maura Mezzetti, 2015. "Spatial Panel Data Model with error dependence: a Bayesian Separable Covariance Approach," CEIS Research Paper 338, Tor Vergata University, CEIS, revised 09 Apr 2015.
    16. Matthias Trendtel & Alexander Robitzsch, 2021. "A Bayesian Item Response Model for Examining Item Position Effects in Complex Survey Data," Journal of Educational and Behavioral Statistics, , vol. 46(1), pages 34-57, February.
    17. Griffin, J. E. & Steel, M. F. J., 2004. "Semiparametric Bayesian inference for stochastic frontier models," Journal of Econometrics, Elsevier, vol. 123(1), pages 121-152, November.
    18. Xiaoyue Xi & Simon E. F. Spencer & Matthew Hall & M. Kate Grabowski & Joseph Kagaayi & Oliver Ratmann & Rakai Health Sciences Program and PANGEA‐HIV, 2022. "Inferring the sources of HIV infection in Africa from deep‐sequence data with semi‐parametric Bayesian Poisson flow models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(3), pages 517-540, June.
    19. Kuschnig, Nikolas, 2021. "Bayesian Spatial Econometrics and the Need for Software," Department of Economics Working Paper Series 318, WU Vienna University of Economics and Business.
    20. Jared Coopersmith & Thomas D. Cook & Jelena Zurovac & Duncan Chaplin & Lauren V. Forrow, 2022. "Internal And External Validity Of The Comparative Interrupted Time‐Series Design: A Meta‐Analysis," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 41(1), pages 252-277, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:mcmeap:v:26:y:2020:i:1:p:1-16:n:2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.