IDEAS home Printed from https://ideas.repec.org/a/gam/jdataj/v5y2020i3p84-d413006.html
   My bibliography  Save this article

Information Loss Due to the Data Reduction of Sample Data from Discrete Distributions

Author

Listed:
  • Maryam Moghimi

    (Center on Stochastic Modeling, Optimization, and Statistics (COSMOS), the University of Texas at Arlington, Arlington, TX 76013, USA
    This paper was part of the author’s doctoral dissertation of May 2020.
    The two authors contributed equally to this paper.)

  • Herbert W. Corley

    (Center on Stochastic Modeling, Optimization, and Statistics (COSMOS), the University of Texas at Arlington, Arlington, TX 76013, USA
    The two authors contributed equally to this paper.)

Abstract

In this paper, we study the information lost when a real-valued statistic is used to reduce or summarize sample data from a discrete random variable with a one-dimensional parameter. We compare the probability that a random sample gives a particular data set to the probability of the statistic’s value for this data set. We focus on sufficient statistics for the parameter of interest and develop a general formula independent of the parameter for the Shannon information lost when a data sample is reduced to such a summary statistic. We also develop a measure of entropy for this lost information that depends only on the real-valued statistic but neither the parameter nor the data. Our approach would also work for non-sufficient statistics, but the lost information and associated entropy would involve the parameter. The method is applied to three well-known discrete distributions to illustrate its implementation.

Suggested Citation

  • Maryam Moghimi & Herbert W. Corley, 2020. "Information Loss Due to the Data Reduction of Sample Data from Discrete Distributions," Data, MDPI, vol. 5(3), pages 1-18, September.
    • Handle: RePEc:gam:jdataj:v:5:y:2020:i:3:p:84-:d:413006
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2306-5729/5/3/84/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2306-5729/5/3/84/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Frank Arute & Kunal Arya & Ryan Babbush & Dave Bacon & Joseph C. Bardin & Rami Barends & Rupak Biswas & Sergio Boixo & Fernando G. S. L. Brandao & David A. Buell & Brian Burkett & Yu Chen & Zijun Chen, 2019. "Quantum supremacy using a programmable superconducting processor," Nature, Nature, vol. 574(7779), pages 505-510, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tong Liu & Shang Liu & Hekang Li & Hao Li & Kaixuan Huang & Zhongcheng Xiang & Xiaohui Song & Kai Xu & Dongning Zheng & Heng Fan, 2023. "Observation of entanglement transition of pseudo-random mixed states," Nature Communications, Nature, vol. 14(1), pages 1-7, December.
    2. X. L. He & Yong Lu & D. Q. Bao & Hang Xue & W. B. Jiang & Z. Wang & A. F. Roudsari & Per Delsing & J. S. Tsai & Z. R. Lin, 2023. "Fast generation of Schrödinger cat states using a Kerr-tunable superconducting resonator," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    3. Huang, Fangyu & Tan, Xiaoqing & Huang, Rui & Xu, Qingshan, 2022. "Variational convolutional neural networks classifiers," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 605(C).
    4. Jesús Fernández-Villaverde & Isaiah J. Hull, 2023. "Dynamic Programming on a Quantum Annealer: Solving the RBC Model," NBER Working Papers 31326, National Bureau of Economic Research, Inc.
    5. Abha Naik & Esra Yeniaras & Gerhard Hellstern & Grishma Prasad & Sanjay Kumar Lalta Prasad Vishwakarma, 2023. "From Portfolio Optimization to Quantum Blockchain and Security: A Systematic Review of Quantum Computing in Finance," Papers 2307.01155, arXiv.org.
    6. Xianchuang Pan & Yuxuan Zhou & Haolan Yuan & Lifu Nie & Weiwei Wei & Libo Zhang & Jian Li & Song Liu & Zhi Hao Jiang & Gianluigi Catelani & Ling Hu & Fei Yan & Dapeng Yu, 2022. "Engineering superconducting qubits to reduce quasiparticles and charge noise," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    7. Ducuara, Andrés F. & Susa, Cristian E. & Reina, John H., 2022. "Emergence of maximal hidden quantum correlations and its trade-off with the filtering probability in dissipative two-qubit systems," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 594(C).
    8. Jake Rochman & Tian Xie & John G. Bartholomew & K. C. Schwab & Andrei Faraon, 2023. "Microwave-to-optical transduction with erbium ions coupled to planar photonic and superconducting resonators," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    9. Reis, Mauricio & Oliveira, Adelcio C., 2022. "A complementary resource relation of concurrence and roughness for a two-qubit state," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 608(P2).
    10. T. Brown & E. Doucet & D. Ristè & G. Ribeill & K. Cicak & J. Aumentado & R. Simmonds & L. Govia & A. Kamal & L. Ranzani, 2022. "Trade off-free entanglement stabilization in a superconducting qutrit-qubit system," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    11. Yulin Chi & Jieshan Huang & Zhanchuan Zhang & Jun Mao & Zinan Zhou & Xiaojiong Chen & Chonghao Zhai & Jueming Bao & Tianxiang Dai & Huihong Yuan & Ming Zhang & Daoxin Dai & Bo Tang & Yan Yang & Zhihua, 2022. "A programmable qudit-based quantum processor," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    12. Elies Gil-Fuster & Jens Eisert & Carlos Bravo-Prieto, 2024. "Understanding quantum machine learning also requires rethinking generalization," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    13. Fazal Raheman, 2022. "The Future of Cybersecurity in the Age of Quantum Computers," Future Internet, MDPI, vol. 14(11), pages 1-12, November.
    14. Noah Goss & Alexis Morvan & Brian Marinelli & Bradley K. Mitchell & Long B. Nguyen & Ravi K. Naik & Larry Chen & Christian Jünger & John Mark Kreikebaum & David I. Santiago & Joel J. Wallman & Irfan S, 2022. "High-fidelity qutrit entangling gates for superconducting circuits," Nature Communications, Nature, vol. 13(1), pages 1-6, December.
    15. Hajkowicz, Stefan & Naughtin, Claire & Sanderson, Conrad & Schleiger, Emma & Karimi, Sarvnaz & Bratanova, Alexandra & Bednarz, Tomasz, 2022. "Artificial intelligence for science – adoption trends and future development pathways," MPRA Paper 115464, University Library of Munich, Germany.
    16. Piotr Tomasz Makowski & Yuya Kajikawa, 2021. "Automation-driven innovation management? Toward Innovation-Automation-Strategy cycle," Papers 2103.02395, arXiv.org.
    17. Antti Vepsäläinen & Roni Winik & Amir H. Karamlou & Jochen Braumüller & Agustin Di Paolo & Youngkyu Sung & Bharath Kannan & Morten Kjaergaard & David K. Kim & Alexander J. Melville & Bethany M. Niedzi, 2022. "Improving qubit coherence using closed-loop feedback," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    18. Liu Qiu & Rishabh Sahu & William Hease & Georg Arnold & Johannes M. Fink, 2023. "Coherent optical control of a superconducting microwave cavity via electro-optical dynamical back-action," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    19. Francesco Bova & Avi Goldfarb & Roger G. Melko, 2023. "Quantum Economic Advantage," Management Science, INFORMS, vol. 69(2), pages 1116-1126, February.
    20. Mario E Rivero-Angeles, 2021. "Quantum-based wireless sensor networks: A review and open questions," International Journal of Distributed Sensor Networks, , vol. 17(10), pages 15501477211, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jdataj:v:5:y:2020:i:3:p:84-:d:413006. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.