IDEAS home Printed from https://ideas.repec.org/a/ebl/ecbull/eb-14-00773.html
   My bibliography  Save this article

Assessing gains from parallel computation on a supercomputer

Author

Listed:
  • Lilia Maliar

    (Stanford University)

Abstract

We assess gains from parallel computation on Backlight supercomputer. The information transfers are expensive. We find that to make parallel computation efficient, a task per core must be sufficiently large, ranging from few seconds to one minute depending on the number of cores employed. For small problems, the shared memory programming (OpenMP) and a hybrid of shared and distributive memory programming (OpenMP&MPI) leads to a higher efficiency of parallelization than the distributive memory programming (MPI) alone.

Suggested Citation

  • Lilia Maliar, 2015. "Assessing gains from parallel computation on a supercomputer," Economics Bulletin, AccessEcon, vol. 35(1), pages 159-167.
    • Handle: RePEc:ebl:ecbull:eb-14-00773
    as

    Download full text from publisher

    File URL: http://www.accessecon.com/Pubs/EB/2015/Volume35/EB-15-V35-I1-P18.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Yongyang Cai & Kenneth Judd & Greg Thain & Stephen Wright, 2015. "Solving Dynamic Programming Problems on a Computational Grid," Computational Economics, Springer;Society for Computational Economics, vol. 45(2), pages 261-284, February.
    2. Aldrich, Eric M. & Fernández-Villaverde, Jesús & Ronald Gallant, A. & Rubio-Ramírez, Juan F., 2011. "Tapping the supercomputer under your desk: Solving dynamic equilibrium models with graphics processors," Journal of Economic Dynamics and Control, Elsevier, vol. 35(3), pages 386-393, March.
    3. Mathur, Sudhanshu & Morozov, Sergei, 2009. "Massively Parallel Computation Using Graphics Processors with Application to Optimal Experimentation in Dynamic Control," MPRA Paper 16721, University Library of Munich, Germany.
    4. Sims, Christopher A. & Waggoner, Daniel F. & Zha, Tao, 2008. "Methods for inference in large multiple-equation Markov-switching models," Journal of Econometrics, Elsevier, vol. 146(2), pages 255-274, October.
    5. Sergei Morozov & Sudhanshu Mathur, 2012. "Massively Parallel Computation Using Graphics Processors with Application to Optimal Experimentation in Dynamic Control," Computational Economics, Springer;Society for Computational Economics, vol. 40(2), pages 151-182, August.
    6. Amman, Hans M., 1986. "Are supercomputers useful for optimal control experiments?," Journal of Economic Dynamics and Control, Elsevier, vol. 10(1-2), pages 127-129, June.
    7. Nagurney, Anna & Zhang, Ding, 1998. "A massively parallel implementation of a discrete-time algorithm for the computation of dynamic elastic demand traffic problems modeled as projected dynamical systems," Journal of Economic Dynamics and Control, Elsevier, vol. 22(8-9), pages 1467-1485, August.
    8. Michael Creel & William Goffe, 2008. "Multi-core CPUs, Clusters, and Grid Computing: A Tutorial," Computational Economics, Springer;Society for Computational Economics, vol. 32(4), pages 353-382, November.
    9. Villemot, Sébastien, 2012. "Accelerating the resolution of sovereign debt models using an endogenous grid method," Dynare Working Papers 17, CEPREMAP.
    10. Anna Nagurney & Ding Zhang, "undated". "Massively Parallel Computation of Dynamic Traffic Problems Modeled as Projected Dynamical Systems," Computing in Economics and Finance 1996 _039, Society for Computational Economics.
    11. Nagurney, Anna, 1996. "Parallel computation," Handbook of Computational Economics, in: H. M. Amman & D. A. Kendrick & J. Rust (ed.), Handbook of Computational Economics, edition 1, volume 1, chapter 7, pages 335-404, Elsevier.
    12. Michael Creel, 2005. "User-Friendly Parallel Computations with Econometric Examples," Computational Economics, Springer;Society for Computational Economics, vol. 26(2), pages 107-128, October.
    13. Amman, Hans M., 1990. "Implementing stochastic control software on supercomputing machines," Journal of Economic Dynamics and Control, Elsevier, vol. 14(2), pages 265-279, May.
    14. Hans M. Amman & David A. Kendrick, . "Computational Economics," Online economics textbooks, SUNY-Oswego, Department of Economics, number comp1.
    15. H. M. Amman & D. A. Kendrick & J. Rust (ed.), 1996. "Handbook of Computational Economics," Handbook of Computational Economics, Elsevier, edition 1, volume 1, number 1.
    16. Michael Creel, 2008. "Using Parallelization to Solve a Macroeconomic Model: A Parallel Parameterized Expectations Algorithm," Computational Economics, Springer;Society for Computational Economics, vol. 32(4), pages 343-352, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Judd, Kenneth L. & Maliar, Lilia & Maliar, Serguei & Valero, Rafael, 2014. "Smolyak method for solving dynamic economic models: Lagrange interpolation, anisotropic grid and adaptive domain," Journal of Economic Dynamics and Control, Elsevier, vol. 44(C), pages 92-123.
    2. John Gibson & James P Henson, 2016. "Getting the most from MATLAB: ditching canned routines and embracing coder," Economics Bulletin, AccessEcon, vol. 36(4), pages 2519-2525.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Morozov, Sergei & Mathur, Sudhanshu, 2009. "Massively parallel computation using graphics processors with application to optimal experimentation in dynamic control," MPRA Paper 30298, University Library of Munich, Germany, revised 04 Apr 2011.
    2. Sergei Morozov & Sudhanshu Mathur, 2012. "Massively Parallel Computation Using Graphics Processors with Application to Optimal Experimentation in Dynamic Control," Computational Economics, Springer;Society for Computational Economics, vol. 40(2), pages 151-182, August.
    3. Casarin, Roberto & Grassi, Stefano & Ravazzolo, Francesco & van Dijk, Herman K., 2015. "Parallel Sequential Monte Carlo for Efficient Density Combination: The DeCo MATLAB Toolbox," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 68(i03).
    4. Matt Dziubinski & Stefano Grassi, 2014. "Heterogeneous Computing in Economics: A Simplified Approach," Computational Economics, Springer;Society for Computational Economics, vol. 43(4), pages 485-495, April.
    5. Yongyang Cai & Kenneth Judd & Greg Thain & Stephen Wright, 2015. "Solving Dynamic Programming Problems on a Computational Grid," Computational Economics, Springer;Society for Computational Economics, vol. 45(2), pages 261-284, February.
    6. Mathur, Sudhanshu & Morozov, Sergei, 2009. "Massively Parallel Computation Using Graphics Processors with Application to Optimal Experimentation in Dynamic Control," MPRA Paper 16721, University Library of Munich, Germany.
    7. Michael C. Hatcher & Eric M. Scheffel, 2016. "Solving the Incomplete Markets Model in Parallel Using GPU Computing and the Krusell–Smith Algorithm," Computational Economics, Springer;Society for Computational Economics, vol. 48(4), pages 569-591, December.
    8. Roberto Casarin & Stefano Grassi & Francesco Ravazzolo & Herman K. van Dijk, 2015. "Dynamic predictive density combinations for large data sets in economics and finance," Working Paper 2015/12, Norges Bank.
    9. Nalan Baştürk & Stefano Grassi & Lennart Hoogerheide & Herman K. Van Dijk, 2016. "Parallelization Experience with Four Canonical Econometric Models Using ParMitISEM," Econometrics, MDPI, vol. 4(1), pages 1-20, March.
    10. Michael Creel & William Goffe, 2008. "Multi-core CPUs, Clusters, and Grid Computing: A Tutorial," Computational Economics, Springer;Society for Computational Economics, vol. 32(4), pages 353-382, November.
    11. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    12. Amman, Hans & Kendrick, David, 1999. "Linear-Quadratic Optimization For Models With Rational Expectations," Macroeconomic Dynamics, Cambridge University Press, vol. 3(4), pages 534-543, December.
    13. John Gibson & James P Henson, 2016. "Getting the most from MATLAB: ditching canned routines and embracing coder," Economics Bulletin, AccessEcon, vol. 36(4), pages 2519-2525.
    14. John Rust, 1996. "Dealing with the Complexity of Economic Calculations," Computational Economics 9610002, University Library of Munich, Germany, revised 21 Oct 1997.
    15. Nagurney, Anna & Zhang, Ding, 1998. "A massively parallel implementation of a discrete-time algorithm for the computation of dynamic elastic demand traffic problems modeled as projected dynamical systems," Journal of Economic Dynamics and Control, Elsevier, vol. 22(8-9), pages 1467-1485, August.
    16. Nalan Baştürk & Roberto Casarin & Francesco Ravazzolo & Herman K. Van Dijk, 2016. "Computational Complexity and Parallelization in Bayesian Econometric Analysis," Econometrics, MDPI, vol. 4(1), pages 1-3, February.
    17. Blueschke-Nikolaeva, V. & Blueschke, D. & Neck, R., 2012. "Optimal control of nonlinear dynamic econometric models: An algorithm and an application," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3230-3240.
    18. Amman, Hans M. & Kendrick, David A., 1998. "Computing the steady state of linear quadratic optimization models with rational expectations," Economics Letters, Elsevier, vol. 58(2), pages 185-191, February.
    19. John Stachurski, 2009. "Economic Dynamics: Theory and Computation," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262012774, December.
    20. Kenneth L. Judd & Lilia Maliar & Serguei Maliar & Inna Tsener, 2017. "How to solve dynamic stochastic models computing expectations just once," Quantitative Economics, Econometric Society, vol. 8(3), pages 851-893, November.

    More about this item

    Keywords

    Parallel Computation; Information transfers; Speedup; Supercomputers; OpenMP; MPI; Blacklight;
    All these keywords.

    JEL classification:

    • C0 - Mathematical and Quantitative Methods - - General
    • C6 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ebl:ecbull:eb-14-00773. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: John P. Conley (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.