IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v13y2022i1d10.1038_s41467-022-32550-3.html
   My bibliography  Save this article

Generalization in quantum machine learning from few training data

Author

Listed:
  • Matthias C. Caro

    (Technical University of Munich
    Munich Center for Quantum Science and Technology (MCQST))

  • Hsin-Yuan Huang

    (Institute for Quantum Information and Matter, Caltech
    Caltech)

  • M. Cerezo

    (Information Sciences, Los Alamos National Laboratory
    Center for Nonlinear Studies, Los Alamos National Laboratory)

  • Kunal Sharma

    (University of Maryland)

  • Andrew Sornborger

    (Information Sciences, Los Alamos National Laboratory
    Quantum Science Center)

  • Lukasz Cincio

    (Theoretical Division, Los Alamos National Laboratory)

  • Patrick J. Coles

    (Theoretical Division, Los Alamos National Laboratory)

Abstract

Modern quantum machine learning (QML) methods involve variationally optimizing a parameterized quantum circuit on a training data set, and subsequently making predictions on a testing data set (i.e., generalizing). In this work, we provide a comprehensive study of generalization performance in QML after training on a limited number N of training data points. We show that the generalization error of a quantum machine learning model with T trainable gates scales at worst as $$\sqrt{T/N}$$ T / N . When only K ≪ T gates have undergone substantial change in the optimization process, we prove that the generalization error improves to $$\sqrt{K/N}$$ K / N . Our results imply that the compiling of unitaries into a polynomial number of native gates, a crucial application for the quantum computing industry that typically uses exponential-size training data, can be sped up significantly. We also show that classification of quantum states across a phase transition with a quantum convolutional neural network requires only a very small training data set. Other potential applications include learning quantum error correcting codes or quantum dynamical simulation. Our work injects new hope into the field of QML, as good generalization is guaranteed from few training data.

Suggested Citation

  • Matthias C. Caro & Hsin-Yuan Huang & M. Cerezo & Kunal Sharma & Andrew Sornborger & Lukasz Cincio & Patrick J. Coles, 2022. "Generalization in quantum machine learning from few training data," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
  • Handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-32550-3
    DOI: 10.1038/s41467-022-32550-3
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-022-32550-3
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-022-32550-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Dorit Aharonov & Jordan Cotler & Xiao-Liang Qi, 2022. "Quantum algorithmic measurement," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    2. Jacob Biamonte & Peter Wittek & Nicola Pancotti & Patrick Rebentrost & Nathan Wiebe & Seth Lloyd, 2017. "Quantum machine learning," Nature, Nature, vol. 549(7671), pages 195-202, September.
    3. M. Cerezo & Akira Sone & Tyler Volkoff & Lukasz Cincio & Patrick J. Coles, 2021. "Cost function dependent barren plateaus in shallow parametrized quantum circuits," Nature Communications, Nature, vol. 12(1), pages 1-12, December.
    4. Samson Wang & Enrico Fontana & M. Cerezo & Kunal Sharma & Akira Sone & Lukasz Cincio & Patrick J. Coles, 2021. "Noise-induced barren plateaus in variational quantum algorithms," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    5. Jarrod R. McClean & Sergio Boixo & Vadim N. Smelyanskiy & Ryan Babbush & Hartmut Neven, 2018. "Barren plateaus in quantum neural network training landscapes," Nature Communications, Nature, vol. 9(1), pages 1-6, December.
    6. Harper R. Grimsley & Sophia E. Economou & Edwin Barnes & Nicholas J. Mayhall, 2019. "An adaptive variational algorithm for exact molecular simulations on a quantum computer," Nature Communications, Nature, vol. 10(1), pages 1-9, December.
    7. Hsin-Yuan Huang & Michael Broughton & Masoud Mohseni & Ryan Babbush & Sergio Boixo & Hartmut Neven & Jarrod R. McClean, 2021. "Power of data in quantum machine learning," Nature Communications, Nature, vol. 12(1), pages 1-9, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Matthias C. Caro & Hsin-Yuan Huang & Nicholas Ezzell & Joe Gibbs & Andrew T. Sornborger & Lukasz Cincio & Patrick J. Coles & Zoë Holmes, 2023. "Out-of-distribution generalization for learning quantum dynamics," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    2. Elies Gil-Fuster & Jens Eisert & Carlos Bravo-Prieto, 2024. "Understanding quantum machine learning also requires rethinking generalization," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    3. Sitan Chen & Jordan Cotler & Hsin-Yuan Huang & Jerry Li, 2023. "The complexity of NISQ," Nature Communications, Nature, vol. 14(1), pages 1-6, December.
    4. Javier Mancilla & Andr'e Sequeira & Tomas Tagliani & Francisco Llaneza & Claudio Beiza, 2024. "Empowering Credit Scoring Systems with Quantum-Enhanced Machine Learning," Papers 2404.00015, arXiv.org, revised Apr 2024.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matthias C. Caro & Hsin-Yuan Huang & Nicholas Ezzell & Joe Gibbs & Andrew T. Sornborger & Lukasz Cincio & Patrick J. Coles & Zoë Holmes, 2023. "Out-of-distribution generalization for learning quantum dynamics," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    2. Sofiene Jerbi & Lukas J. Fiderer & Hendrik Poulsen Nautrup & Jonas M. Kübler & Hans J. Briegel & Vedran Dunjko, 2023. "Quantum machine learning beyond kernel methods," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    3. Eric R. Anschuetz & Bobak T. Kiani, 2022. "Quantum variational algorithms are swamped with traps," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    4. Elies Gil-Fuster & Jens Eisert & Carlos Bravo-Prieto, 2024. "Understanding quantum machine learning also requires rethinking generalization," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    5. He, Zhimin & Deng, Maijie & Zheng, Shenggen & Li, Lvzhou & Situ, Haozhen, 2023. "GSQAS: Graph Self-supervised Quantum Architecture Search," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 630(C).
    6. Manuel S. Rudolph & Jacob Miller & Danial Motlagh & Jing Chen & Atithi Acharya & Alejandro Perdomo-Ortiz, 2023. "Synergistic pretraining of parametrized quantum circuits via tensor networks," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    7. Samson Wang & Enrico Fontana & M. Cerezo & Kunal Sharma & Akira Sone & Lukasz Cincio & Patrick J. Coles, 2021. "Noise-induced barren plateaus in variational quantum algorithms," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    8. Wei-Ming Li & Shi-Ju Ran, 2022. "Non-Parametric Semi-Supervised Learning in Many-Body Hilbert Space with Rescaled Logarithmic Fidelity," Mathematics, MDPI, vol. 10(6), pages 1-15, March.
    9. Junyu Liu & Minzhao Liu & Jin-Peng Liu & Ziyu Ye & Yunfei Wang & Yuri Alexeev & Jens Eisert & Liang Jiang, 2024. "Towards provably efficient quantum algorithms for large-scale machine-learning models," Nature Communications, Nature, vol. 15(1), pages 1-6, December.
    10. Laura Lewis & Hsin-Yuan Huang & Viet T. Tran & Sebastian Lehner & Richard Kueng & John Preskill, 2024. "Improved machine learning algorithm for predicting ground state properties," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    11. Sitan Chen & Jordan Cotler & Hsin-Yuan Huang & Jerry Li, 2023. "The complexity of NISQ," Nature Communications, Nature, vol. 14(1), pages 1-6, December.
    12. Ajagekar, Akshay & You, Fengqi, 2022. "Quantum computing and quantum artificial intelligence for renewable and sustainable energy: A emerging prospect towards climate neutrality," Renewable and Sustainable Energy Reviews, Elsevier, vol. 165(C).
    13. El Amine Cherrat & Snehal Raj & Iordanis Kerenidis & Abhishek Shekhar & Ben Wood & Jon Dee & Shouvanik Chakrabarti & Richard Chen & Dylan Herman & Shaohan Hu & Pierre Minssen & Ruslan Shaydulin & Yue , 2023. "Quantum Deep Hedging," Papers 2303.16585, arXiv.org, revised Nov 2023.
    14. Liu, Ling & Song, Tingting & Sun, Zhiwei & Lei, Jiancheng, 2022. "Quantum generative adversarial networks based on Rényi divergences," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 607(C).
    15. Wu, Jiang & Ou, Guiyan & Liu, Xiaohui & Dong, Ke, 2022. "How does academic education background affect top researchers’ performance? Evidence from the field of artificial intelligence," Journal of Informetrics, Elsevier, vol. 16(2).
    16. Takayuki Sakuma, 2020. "Application of deep quantum neural networks to finance," Papers 2011.07319, arXiv.org, revised May 2022.
    17. Li, Nianqiao & Yan, Fei & Hirota, Kaoru, 2022. "Quantum data visualization: A quantum computing framework for enhancing visual analysis of data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 599(C).
    18. Iris Cong & Nishad Maskara & Minh C. Tran & Hannes Pichler & Giulia Semeghini & Susanne F. Yelin & Soonwon Choi & Mikhail D. Lukin, 2024. "Enhancing detection of topological order by local error correction," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    19. Vicente Moret-Bonillo & Samuel Magaz-Romero & Eduardo Mosqueira-Rey, 2022. "Quantum Computing for Dealing with Inaccurate Knowledge Related to the Certainty Factors Model," Mathematics, MDPI, vol. 10(2), pages 1-21, January.
    20. Gong, Li-Hua & Xiang, Ling-Zhi & Liu, Si-Hang & Zhou, Nan-Run, 2022. "Born machine model based on matrix product state quantum circuit," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 593(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-32550-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.