IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2403.08362.html

Mean-Field Microcanonical Gradient Descent

Author

Listed:
  • Marcus Haggbom
  • Morten Karlsmark
  • Joakim And'en

Abstract

Microcanonical gradient descent is a sampling procedure for energy-based models allowing for efficient sampling of distributions in high dimension. It works by transporting samples from a high-entropy distribution, such as Gaussian white noise, to a low-energy region using gradient descent. We put this model in the framework of normalizing flows, showing how it can often overfit by losing an unnecessary amount of entropy in the descent. As a remedy, we propose a mean-field microcanonical gradient descent that samples several weakly coupled data points simultaneously, allowing for better control of the entropy loss while paying little in terms of likelihood fit. We study these models in the context of financial time series, illustrating the improvements on both synthetic and real data.

Suggested Citation

  • Marcus Haggbom & Morten Karlsmark & Joakim And'en, 2024. "Mean-Field Microcanonical Gradient Descent," Papers 2403.08362, arXiv.org, revised May 2024.
    • Handle: RePEc:arx:papers:2403.08362
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2403.08362
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rudy Morel & Gaspar Rochette & Roberto Leonarduzzi & Jean-Philippe Bouchaud & St'ephane Mallat, 2022. "Scale Dependencies and Self-Similar Models with Wavelet Scattering Spectra," Papers 2204.10177, arXiv.org, revised Jun 2023.
    2. John C. Cox & Jonathan E. Ingersoll Jr. & Stephen A. Ross, 2005. "A Theory Of The Term Structure Of Interest Rates," World Scientific Book Chapters, in: Sudipto Bhattacharya & George M Constantinides (ed.), Theory Of Valuation, chapter 5, pages 129-164, World Scientific Publishing Co. Pte. Ltd..
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kau, James B. & Keenan, Donald C., 1999. "Patterns of rational default," Regional Science and Urban Economics, Elsevier, vol. 29(6), pages 765-785, November.
    2. Camilla LandÊn, 2000. "Bond pricing in a hidden Markov model of the short rate," Finance and Stochastics, Springer, vol. 4(4), pages 371-389.
    3. Thomas Kokholm & Martin Stisen, 2015. "Joint pricing of VIX and SPX options with stochastic volatility and jump models," Journal of Risk Finance, Emerald Group Publishing Limited, vol. 16(1), pages 27-48, January.
    4. Álvarez Echeverría Francisco & López Sarabia Pablo & Venegas Martínez Francisco, 2012. "Valuación financiera de proyectos de inversión en nuevas tecnologías con opciones reales," Contaduría y Administración, Accounting and Management, vol. 57(3), pages 115-145, julio-sep.
    5. Darren Shannon & Grigorios Fountas, 2021. "Extending the Heston Model to Forecast Motor Vehicle Collision Rates," Papers 2104.11461, arXiv.org, revised May 2021.
    6. Matsumura, Marco & Moreira, Ajax & Vicente, José, 2011. "Forecasting the yield curve with linear factor models," International Review of Financial Analysis, Elsevier, vol. 20(5), pages 237-243.
    7. Ivanova, Vesela & Puigvert Gutiérrez, Josep Maria, 2014. "Interest rate forecasts, state price densities and risk premium from Euribor options," Journal of Banking & Finance, Elsevier, vol. 48(C), pages 210-223.
    8. Lin, Bing-Huei, 1999. "Fitting the term structure of interest rates for Taiwanese government bonds," Journal of Multinational Financial Management, Elsevier, vol. 9(3-4), pages 331-352, November.
    9. Gollier, Christian, 2002. "Time Horizon and the Discount Rate," Journal of Economic Theory, Elsevier, vol. 107(2), pages 463-473, December.
    10. Robert R. Bliss & Ehud I. Ronn, 1997. "Callable U.S. Treasury bonds: optimal calls, anomalies, and implied volatilities," FRB Atlanta Working Paper 97-1, Federal Reserve Bank of Atlanta.
    11. Henry, Olan T. & Olekalns, Nilss & Suardi, Sandy, 2007. "Testing for rate dependence and asymmetry in inflation uncertainty: Evidence from the G7 economies," Economics Letters, Elsevier, vol. 94(3), pages 383-388, March.
    12. Ammann, Manuel & Kind, Axel & Wilde, Christian, 2003. "Are convertible bonds underpriced? An analysis of the French market," Journal of Banking & Finance, Elsevier, vol. 27(4), pages 635-653, April.
    13. Sergio Zúñiga, 1999. "Modelos de Tasas de Interés en Chile: Una Revisión," Latin American Journal of Economics-formerly Cuadernos de Economía, Instituto de Economía. Pontificia Universidad Católica de Chile., vol. 36(108), pages 875-893.
    14. Anna Cieslak & Pavol Povala, 2016. "Information in the Term Structure of Yield Curve Volatility," Journal of Finance, American Finance Association, vol. 71(3), pages 1393-1436, June.
    15. A. Itkin & V. Shcherbakov & A. Veygman, 2019. "New Model For Pricing Quanto Credit Default Swaps," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 22(03), pages 1-37, May.
    16. Sang Byung Seo & Jessica A. Wachter, 2019. "Option Prices in a Model with Stochastic Disaster Risk," Management Science, INFORMS, vol. 65(8), pages 3449-3469, August.
    17. Yang, Nian & Chen, Nan & Wan, Xiangwei, 2019. "A new delta expansion for multivariate diffusions via the Itô-Taylor expansion," Journal of Econometrics, Elsevier, vol. 209(2), pages 256-288.
    18. Kimmel, Robert L., 2004. "Modeling the term structure of interest rates: A new approach," Journal of Financial Economics, Elsevier, vol. 72(1), pages 143-183, April.
    19. Almeida, Thiago Ramos, 2024. "Estimating time-varying factors’ variance in the string-term structure model with stochastic volatility," Research in International Business and Finance, Elsevier, vol. 70(PA).
    20. Frank X. Zhang, 2003. "What did the credit market expect of Argentina default? Evidence from default swap data," Finance and Economics Discussion Series 2003-25, Board of Governors of the Federal Reserve System (U.S.).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2403.08362. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.