IDEAS home Printed from https://ideas.repec.org/p/cca/wpaper/738.html
   My bibliography  Save this paper

How Small is Big Enough? Open Labeled Datasets and the Development of Deep Learning

Author

Listed:
  • Daniel Souza
  • Aldo Geuna
  • Jeff Rodríguez

Abstract

We investigate the emergence of Deep Learning as a technoscientific field, emphasizing the role of open labeled datasets. Through qualitative and quantitative analyses, we evaluate the role of datasets like CIFAR-10 in advancing computer vision and object recognition, which are central to the Deep Learning revolution. Our findings highlight CIFAR-10’s crucial role and enduring influence on the field, as well as its importance in teaching ML techniques. Results also indicate that dataset characteristics such as size, number of instances, and number of categories, were key factors. Econometric analysis confirms that CIFAR-10, a small-but- sufficiently-large open dataset, played a significant and lasting role in technological advancements and had a major function in the development of the early scientific literature as shown by citation metrics.

Suggested Citation

  • Daniel Souza & Aldo Geuna & Jeff Rodríguez, 2025. "How Small is Big Enough? Open Labeled Datasets and the Development of Deep Learning," Carlo Alberto Notebooks 738 JEL Classification: O, Collegio Carlo Alberto.
    • Handle: RePEc:cca:wpaper:738
    as

    Download full text from publisher

    File URL: https://www.carloalberto.org/wp-content/uploads/2025/05/738.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Nicholas Crafts, 2021. "Artificial intelligence as a general-purpose technology: an historical perspective," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 37(3), pages 521-536.
    2. Bianchini, Stefano & Müller, Moritz & Pelletier, Pierre, 2022. "Artificial intelligence in science: An emerging general method of invention," Research Policy, Elsevier, vol. 51(10).
    3. Chris Stokel-Walker & Richard Van Noorden, 2023. "What ChatGPT and generative AI mean for science," Nature, Nature, vol. 614(7947), pages 214-216, February.
    4. Kathryn Tunyasuvunakool & Jonas Adler & Zachary Wu & Tim Green & Michal Zielinski & Augustin Žídek & Alex Bridgland & Andrew Cowie & Clemens Meyer & Agata Laydon & Sameer Velankar & Gerard J. Kleywegt, 2021. "Highly accurate protein structure prediction for the human proteome," Nature, Nature, vol. 596(7873), pages 590-596, August.
    5. Stefano Bianchini & Moritz Müller & Pierre Pelletier, 2022. "Artificial intelligence in science: An emerging general method of invention," Post-Print hal-03958025, HAL.
    6. Joel Klinger & Juan Mateos-Garcia & Konstantinos Stathoulopoulos, 2021. "Deep learning, deep change? Mapping the evolution and geography of a general purpose technology," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5589-5621, July.
    7. John Jumper & Richard Evans & Alexander Pritzel & Tim Green & Michael Figurnov & Olaf Ronneberger & Kathryn Tunyasuvunakool & Russ Bates & Augustin Žídek & Anna Potapenko & Alex Bridgland & Clemens Me, 2021. "Highly accurate protein structure prediction with AlphaFold," Nature, Nature, vol. 596(7873), pages 583-589, August.
    8. Matt Marx & Aaron Fuegi, 2020. "Reliance on science: Worldwide front‐page patent citations to scientific articles," Strategic Management Journal, Wiley Blackwell, vol. 41(9), pages 1572-1594, September.
    9. Ewen Callaway, 2020. "‘It will change everything’: DeepMind’s AI makes gigantic leap in solving protein structures," Nature, Nature, vol. 588(7837), pages 203-204, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sang Yoon Kim & Won Kyung Lee & Su Jung Jee & So Young Sohn, 2025. "Discovering AI adoption patterns from big academic graph data," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(2), pages 809-831, February.
    2. Agrawal, Ajay & McHale, John & Oettl, Alexander, 2024. "Artificial intelligence and scientific discovery: a model of prioritized search," Research Policy, Elsevier, vol. 53(5).
    3. Xu, Yanan & Sun, Yaowu & Zhou, Yiting, 2024. "Unpacking the intellectual structure and evolution trend of general-purpose technologies development in innovation studies," Technological Forecasting and Social Change, Elsevier, vol. 209(C).
    4. Damioli, Giacomo & Van Roy, Vincent & Vertesy, Daniel & Vivarelli, Marco, 2025. "Is artificial intelligence leading to a new technological paradigm?," Structural Change and Economic Dynamics, Elsevier, vol. 72(C), pages 347-359.
    5. Andrea Borsato & André Lorentz, 2023. "Data production and the coevolving AI trajectories: an attempted evolutionary model," Journal of Evolutionary Economics, Springer, vol. 33(5), pages 1427-1472, November.
    6. Youngsam Chun & Jisoo Hur & Junseok Hwang, 2024. "AI technology specialization and national competitiveness," PLOS ONE, Public Library of Science, vol. 19(4), pages 1-26, April.
    7. Stefano Bianchini & Moritz Muller & Pierre Pelletier, 2023. "Drivers and Barriers of AI Adoption and Use in Scientific Research," Papers 2312.09843, arXiv.org, revised Feb 2024.
    8. Min Yan & Can Huang & Peter Bienstman & Peter Tino & Wei Lin & Jie Sun, 2024. "Emerging opportunities and challenges for the future of reservoir computing," Nature Communications, Nature, vol. 15(1), pages 1-18, December.
    9. Pantelis Livanos & Choy Kriechbaum & Sophia Remers & Arvid Herrmann & Sabine Müller, 2025. "Kinesin-12 POK2 polarization is a prerequisite for a fully functional division site and aids cell plate positioning," Nature Communications, Nature, vol. 16(1), pages 1-17, December.
    10. Surabhi Kokane & Ashutosh Gulati & Pascal F. Meier & Rei Matsuoka & Tanadet Pipatpolkai & Giuseppe Albano & Tin Manh Ho & Lucie Delemotte & Daniel Fuster & David Drew, 2025. "PIP2-mediated oligomerization of the endosomal sodium/proton exchanger NHE9," Nature Communications, Nature, vol. 16(1), pages 1-17, December.
    11. Pierre Azoulay & Joshua Krieger & Abhishek Nagaraj, 2024. "Old Moats for New Models: Openness, Control, and Competition in Generative Artificial Intelligence," NBER Chapters, in: Entrepreneurship and Innovation Policy and the Economy, volume 4, pages 7-46, National Bureau of Economic Research, Inc.
    12. Xin Yong & Guowen Jia & Qin Yang & Chunzhuang Zhou & Sitao Zhang & Huaqing Deng & Daniel D. Billadeau & Zhaoming Su & Da Jia, 2025. "Cryo-EM structure of the BLOC-3 complex provides insights into the pathogenesis of Hermansky-Pudlak syndrome," Nature Communications, Nature, vol. 16(1), pages 1-15, December.
    13. Jun-Yu Si & Yuan-Mei Chen & Ye-Hui Sun & Meng-Xue Gu & Mei-Ling Huang & Lu-Lu Shi & Xiao Yu & Xiao Yang & Qing Xiong & Cheng-Bao Ma & Peng Liu & Zheng-Li Shi & Huan Yan, 2024. "Sarbecovirus RBD indels and specific residues dictating multi-species ACE2 adaptiveness," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    14. Deyun Qiu & Jinxin V. Pei & James E. O. Rosling & Vandana Thathy & Dongdi Li & Yi Xue & John D. Tanner & Jocelyn Sietsma Penington & Yi Tong Vincent Aw & Jessica Yi Han Aw & Guoyue Xu & Abhai K. Tripa, 2022. "A G358S mutation in the Plasmodium falciparum Na+ pump PfATP4 confers clinically-relevant resistance to cipargamin," Nature Communications, Nature, vol. 13(1), pages 1-18, December.
    15. Shuo-Shuo Liu & Tian-Xia Jiang & Fan Bu & Ji-Lan Zhao & Guang-Fei Wang & Guo-Heng Yang & Jie-Yan Kong & Yun-Fan Qie & Pei Wen & Li-Bin Fan & Ning-Ning Li & Ning Gao & Xiao-Bo Qiu, 2024. "Molecular mechanisms underlying the BIRC6-mediated regulation of apoptosis and autophagy," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    16. Zhao-Shan Chen & Hsiang-Chi Huang & Xiangkun Wang & Karin Schön & Yane Jia & Michael Lebens & Danica F. Besavilla & Janarthan R. Murti & Yanhong Ji & Aishe A. Sarshad & Guohua Deng & Qiyun Zhu & David, 2025. "Influenza A Virus H7 nanobody recognizes a conserved immunodominant epitope on hemagglutinin head and confers heterosubtypic protection," Nature Communications, Nature, vol. 16(1), pages 1-17, December.
    17. Sourav Nayak & Thomas J. Peto & Michal Kucharski & Rupam Tripura & James J. Callery & Duong Tien Quang Huy & Mathieu Gendrot & Dysoley Lek & Ho Dang Trung Nghia & Rob W. Pluijm & Nguyen Dong & Le Than, 2024. "Population genomics and transcriptomics of Plasmodium falciparum in Cambodia and Vietnam uncover key components of the artemisinin resistance genetic background," Nature Communications, Nature, vol. 15(1), pages 1-17, December.
    18. Xiaoke Yang & Mingqi Zhu & Xue Lu & Yuxin Wang & Junyu Xiao, 2024. "Architecture and activation of human muscle phosphorylase kinase," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    19. Efren Garcia-Maldonado & Andrew D. Huber & Sergio C. Chai & Stanley Nithianantham & Yongtao Li & Jing Wu & Shyaron Poudel & Darcie J. Miller & Jayaraman Seetharaman & Taosheng Chen, 2024. "Chemical manipulation of an activation/inhibition switch in the nuclear receptor PXR," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    20. Kristy Rochon & Brianna L. Bauer & Nathaniel A. Roethler & Yuli Buckley & Chih-Chia Su & Wei Huang & Rajesh Ramachandran & Maria S. K. Stoll & Edward W. Yu & Derek J. Taylor & Jason A. Mears, 2024. "Structural basis for regulated assembly of the mitochondrial fission GTPase Drp1," Nature Communications, Nature, vol. 15(1), pages 1-10, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cca:wpaper:738. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Giovanni Bert (email available below). General contact details of provider: https://edirc.repec.org/data/fccaait.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.