IDEAS home Printed from https://ideas.repec.org/a/oup/indcch/v27y2018i3p525-553..html

Exploring and yet failing less: learning from past and current exploration in R&D

Author

Listed:
  • Pablo D’Este
  • Alberto Marzucchi
  • Francesco Rentocchini

Abstract

Exploration is both an important part of a firm’s innovation strategy and an activity that involves a high degree of uncertainty. This article investigates a duality in the exploratory component of R&D activity with regard to innovation failure: while exploration is likely to increase firms’ exposure to failure, it might also provide learning opportunities to reduce failure. Our study contributes to the innovation management and organizational learning literatures by demonstrating the value of exploratory R&D for enabling two types of learning mechanisms. The first, experience-based learning, is based on the learning opportunities derived from accumulated experience in exploratory R&D: it involves improvements to procedures associated with experimentation and provides guidance for current exploration and to navigate the search space. The second, inferential-based learning, is based on the learning opportunities derived from current exploratory R&D efforts, which are associated with improved interpretation of ill-defined problems and timely responses to unstructured information. We draw on a longitudinal data set of 2226 Spanish manufacturing companies and show that, when past experience is associated with current exploration, innovation failure in the conception phase is reduced. We also find an inverted U-shaped relation between current exploratory R&D and innovation failure, in both the conception and implementation phases of innovation activities, showing that increasing levels of investment in current exploration activities attenuate the initial positive association between exploratory R&D and failure.

Suggested Citation

  • Pablo D’Este & Alberto Marzucchi & Francesco Rentocchini, 2018. "Exploring and yet failing less: learning from past and current exploration in R&D," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 27(3), pages 525-553.
  • Handle: RePEc:oup:indcch:v:27:y:2018:i:3:p:525-553.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/icc/dtx044
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Mairesse, Jacques & Mohnen, Pierre, 2010. "Using Innovation Surveys for Econometric Analysis," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 2, chapter 0, pages 1129-1155, Elsevier.
    2. James G. March, 1991. "Exploration and Exploitation in Organizational Learning," Organization Science, INFORMS, vol. 2(1), pages 71-87, February.
    3. Pierre Blanchard & Jean-Pierre Huiban & Antonio Musolesi & Patrick Sevestre, 2013. "Where there is a will, there is a way? Assessing the impact of obstacles to innovation," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 22(3), pages 679-710, June.
    4. Christina Fang & Daniel Levinthal, 2009. "Near-Term Liability of Exploitation: Exploration and Exploitation in Multistage Problems," Organization Science, INFORMS, vol. 20(3), pages 538-551, June.
    5. Willard I. Zangwill & Paul B. Kantor, 1998. "Toward a Theory of Continuous Improvement and the Learning Curve," Management Science, INFORMS, vol. 44(7), pages 910-920, July.
    6. Seung Ki Moon & Xiaomeng Chang & Janis Terpenny & Timothy W. Simpson & Soundar R. T. Kumara, 2009. "Towards a Knowledge Support System for Product Family Design," World Scientific Book Chapters, in: Frank T Piller & Mitchell M Tseng (ed.), Handbook of Research in Mass Customization and Personalization (In 2 Volumes), chapter 16, pages 297-318, World Scientific Publishing Co. Pte. Ltd..
    7. Francesco Bogliacino & Mario Pianta, 2016. "The Pavitt Taxonomy, revisited: patterns of innovation in manufacturing and services," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 33(2), pages 153-180, August.
    8. Pablo D'Este & Francesco Rentocchini & Jaider Vega-Jurado, 2014. "The Role of Human Capital in Lowering the Barriers to Engaging in Innovation: Evidence from the Spanish Innovation Survey," Industry and Innovation, Taylor & Francis Journals, vol. 21(1), pages 1-19, January.
    9. Maarten L. Buis, 2010. "Stata tip 87: Interpretation of interactions in nonlinear models," Stata Journal, StataCorp LLC, vol. 10(2), pages 305-308, June.
    10. Barge-Gil, Andrés & López, Alberto, 2014. "R&D determinants: Accounting for the differences between research and development," Research Policy, Elsevier, vol. 43(9), pages 1634-1648.
    11. Marzucchi, Alberto & Montresor, Sandro, 2017. "Forms of knowledge and eco-innovation modes: Evidence from Spanish manufacturing firms," Ecological Economics, Elsevier, vol. 131(C), pages 208-221.
    12. Pavitt, Keith, 1984. "Sectoral patterns of technical change: Towards a taxonomy and a theory," Research Policy, Elsevier, vol. 13(6), pages 343-373, December.
    13. Zi-Lin He & Poh-Kam Wong, 2004. "Exploration vs. Exploitation: An Empirical Test of the Ambidexterity Hypothesis," Organization Science, INFORMS, vol. 15(4), pages 481-494, August.
    14. Linda Argote & Ella Miron-Spektor, 2011. "Organizational Learning: From Experience to Knowledge," Organization Science, INFORMS, vol. 22(5), pages 1123-1137, October.
    15. Trigo, Alexandre & Vence, Xavier, 2012. "Scope and patterns of innovation cooperation in Spanish service enterprises," Research Policy, Elsevier, vol. 41(3), pages 602-613.
    16. Dirk Czarnitzki & Hanna Hottenrott & Susanne Thorwarth, 2011. "Industrial research versus development investment: the implications of financial constraints," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 35(3), pages 527-544.
    17. P. Mohnen & F. Palm & S. Loeff & A. Tiwari, 2008. "Financial Constraints and Other Obstacles: are they a Threat to Innovation Activity?," De Economist, Springer, vol. 156(2), pages 201-214, June.
    18. Greene, William, 2010. "Testing hypotheses about interaction terms in nonlinear models," Economics Letters, Elsevier, vol. 107(2), pages 291-296, May.
    19. Christian Rammer & Dirk Czarnitzki & Alfred Spielkamp, 2009. "Innovation success of non-R&D-performers: substituting technology by management in SMEs," Small Business Economics, Springer, vol. 33(1), pages 35-58, June.
    20. Scott D. N. Cook & John Seely Brown, 1999. "Bridging Epistemologies: The Generative Dance Between Organizational Knowledge and Organizational Knowing," Organization Science, INFORMS, vol. 10(4), pages 381-400, August.
    21. Hall, Bronwyn H, 1993. "The Stock Market's Valuation of R&D Investment during the 1980's," American Economic Review, American Economic Association, vol. 83(2), pages 259-264, May.
    22. Czarnitzki, Dirk & Kraft, Kornelius & Thorwarth, Susanne, 2009. "The knowledge production of 'R' and 'D'," Economics Letters, Elsevier, vol. 105(1), pages 141-143, October.
    23. Dean A. Shepherd & Melissa S. Cardon, 2009. "Negative Emotional Reactions to Project Failure and the Self‐Compassion to Learn from the Experience," Journal of Management Studies, Wiley Blackwell, vol. 46(6), pages 923-949, September.
    24. Maurizio Zollo & Sidney G. Winter, 2002. "Deliberate Learning and the Evolution of Dynamic Capabilities," Organization Science, INFORMS, vol. 13(3), pages 339-351, June.
    25. Davide Antonioli & Alberto Marzucchi & Maria Savona, 2017. "Pain shared, pain halved? Cooperation as a coping strategy for innovation barriers," The Journal of Technology Transfer, Springer, vol. 42(4), pages 841-864, August.
    26. Jerker. Denrell & Christina. Fang & Daniel A. Levinthal, 2004. "From T-Mazes to Labyrinths: Learning from Model-Based Feedback," Management Science, INFORMS, vol. 50(10), pages 1366-1378, October.
    27. Bennet A. Zelner, 2009. "Using simulation to interpret results from logit, probit, and other nonlinear models," Strategic Management Journal, Wiley Blackwell, vol. 30(12), pages 1335-1348, December.
    28. Mudambi, Ram & Swift, Tim, 2011. "Proactive R&D management and firm growth: A punctuated equilibrium model," Research Policy, Elsevier, vol. 40(3), pages 429-440, April.
    29. Sterlacchini, Alessandro, 1999. "Do innovative activities matter to small firms in non-R&D-intensive industries? An application to export performance," Research Policy, Elsevier, vol. 28(8), pages 819-832, November.
    30. von Hippel, Eric & Tyre, Marcie J., 1995. "How learning by doing is done: problem identification in novel process equipment," Research Policy, Elsevier, vol. 24(1), pages 1-12, January.
    31. Emmanuel Duguet, 2006. "Innovation height, spillovers and tfp growth at the firm level: Evidence from French manufacturing," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 15(4-5), pages 415-442.
    32. Lori Rosenkopf & Atul Nerkar, 2001. "Beyond local search: boundary‐spanning, exploration, and impact in the optical disk industry," Strategic Management Journal, Wiley Blackwell, vol. 22(4), pages 287-306, April.
    33. Christina Fang & Jeho Lee & Melissa A. Schilling, 2010. "Balancing Exploration and Exploitation Through Structural Design: The Isolation of Subgroups and Organizational Learning," Organization Science, INFORMS, vol. 21(3), pages 625-642, June.
    34. Lhuillery, Stéphane & Pfister, Etienne, 2009. "R&D cooperation and failures in innovation projects: Empirical evidence from French CIS data," Research Policy, Elsevier, vol. 38(1), pages 45-57, February.
    35. Kathleen M. Eisenhardt & Jeffrey A. Martin, 2000. "Dynamic capabilities: what are they?," Strategic Management Journal, Wiley Blackwell, vol. 21(10‐11), pages 1105-1121, October.
    36. Monjon, Stephanie & Waelbroeck, Patrick, 2003. "Assessing spillovers from universities to firms: evidence from French firm-level data," International Journal of Industrial Organization, Elsevier, vol. 21(9), pages 1255-1270, November.
    37. Andrés Barge-Gil & Alberto López, 2015. "R versus D: estimating the differentiated effect of research and development on innovation results," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 24(1), pages 93-129.
    38. June-Young Kim & Ji-Yub (Jay) Kim & Anne S. Miner, 2009. "Organizational Learning from Extreme Performance Experience: The Impact of Success and Recovery Experience," Organization Science, INFORMS, vol. 20(6), pages 958-978, December.
    39. Ann Majchrzak & Lynne P. Cooper & Olivia E. Neece, 2004. "Knowledge Reuse for Innovation," Management Science, INFORMS, vol. 50(2), pages 174-188, February.
    40. Ai, Chunrong & Norton, Edward C., 2003. "Interaction terms in logit and probit models," Economics Letters, Elsevier, vol. 80(1), pages 123-129, July.
    41. Atul Nerkar, 2003. "Old Is Gold? The Value of Temporal Exploration in the Creation of New Knowledge," Management Science, INFORMS, vol. 49(2), pages 211-229, February.
    42. Christina Fang, 2012. "Organizational Learning as Credit Assignment: A Model and Two Experiments," Organization Science, INFORMS, vol. 23(6), pages 1717-1732, December.
    43. S.A. Lippman & R.P. Rumelt, 1982. "Uncertain Imitability: An Analysis of Interfirm Differences in Efficiency under Competition," Bell Journal of Economics, The RAND Corporation, vol. 13(2), pages 418-438, Autumn.
    44. Melissa A. Schilling & Patricia Vidal & Robert E. Ployhart & Alexandre Marangoni, 2003. "Learning by Doing Something Else: Variation, Relatedness, and the Learning Curve," Management Science, INFORMS, vol. 49(1), pages 39-56, January.
    45. C. Lanier Benkard, 2000. "Learning and Forgetting: The Dynamics of Aircraft Production," American Economic Review, American Economic Association, vol. 90(4), pages 1034-1054, September.
    46. repec:dau:papers:123456789/13785 is not listed on IDEAS
    47. Jo Thori Lind & Halvor Mehlum, 2010. "With or Without U? The Appropriate Test for a U‐Shaped Relationship," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 72(1), pages 109-118, February.
    48. Jaider Vega-Jurado & Antonio Gutiérrez-Gracia & Ignacio Fernández-de-Lucio, 2009. "Does external knowledge sourcing matter for innovation? Evidence from the Spanish manufacturing industry," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 18(4), pages 637-670, August.
    49. Isabel Busom & Beatriz Corchuelo & Ester Martínez-Ros, 2014. "Tax incentives… or subsidies for business R&D?," Small Business Economics, Springer, vol. 43(3), pages 571-596, October.
    50. D’Este, Pablo & Iammarino, Simona & Savona, Maria & von Tunzelmann, Nick, 2012. "What hampers innovation? Revealed barriers versus deterring barriers," Research Policy, Elsevier, vol. 41(2), pages 482-488.
    51. Linda Argote & Sara L. Beckman & Dennis Epple, 1990. "The Persistence and Transfer of Learning in Industrial Settings," Management Science, INFORMS, vol. 36(2), pages 140-154, February.
    52. Leoncini, Riccardo, 2016. "Learning-by-failing. An empirical exercise on CIS data," Research Policy, Elsevier, vol. 45(2), pages 376-386.
    53. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    54. Cédric Schneider & Reinhilde Veugelers, 2010. "On young highly innovative companies: why they matter and how (not) to policy support them," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 19(4), pages 969-1007, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Stojcic, Nebojsa, 2024. "Innovation failure, training for innovative activities and public support for innovation: Multi-annual evidence from emerging European innovation systems," Research Policy, Elsevier, vol. 53(8).
    2. Wang, Tao, 2023. "Toward an understanding of innovation failure: The timing of failure experience," Technovation, Elsevier, vol. 125(C).
    3. Sithipolvanichgul, Juthamon & Dhir, Amandeep & Talwar, Shalini & Kaur, Puneet, 2025. "Decomposition of double-loop failure risk in post-innovation failure phase," Technovation, Elsevier, vol. 140(C).
    4. Love, James H. & Roper, Stephen & Vahter, Priit, 2023. "The dynamics of abandoned innovation activities: Learning from failure or learning to prevent failure?," Research Policy, Elsevier, vol. 52(8).
    5. Mavroudi, Eva & Kesidou, Effie & Pandza, Krsto, 2023. "Effects of ambidextrous and specialized R&D strategies on firm performance: The contingent role of industry orientation," Journal of Business Research, Elsevier, vol. 154(C).
    6. Xiangming (Tommy) Tao & Catherine L. Wang & Paul J. A. Robson & Mathew (Mat) Hughes, 2025. "How does team learning from failure facilitate new product performance? The double-edged moderating effect of collective efficacy," Small Business Economics, Springer, vol. 64(1), pages 133-155, January.
    7. Santamaría, Luis & Nieto, María Jesús & Rodríguez, Alicia, 2021. "Failed and successful innovations: The role of geographic proximity and international diversity of partners in technological collaboration," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    8. Lucas Gabriel De Paula Silveira & Eugênia Vale De Paula, 2026. "Dynamic capabilities erosion: a systematic review, integrative framework, and research agenda," Future Business Journal, Springer, vol. 12(1), pages 1-33, December.
    9. Baxter, David & Trott, Paul & Ellwood, Paul, 2023. "Reconceptualising innovation failure," Research Policy, Elsevier, vol. 52(7).
    10. Chatterjee, Sheshadri & Chaudhuri, Ranjan & Mariani, Marcello & Fosso Wamba, Samuel, 2023. "The consequences of innovation failure: An innovation capabilities and dynamic capabilities perspective," Technovation, Elsevier, vol. 128(C).
    11. James H. Love & Stephen Roper & Priit Vahter, 2020. "Do Firms Really Learn From Failure? The Dynamics Of Abandoned Innovation," University of Tartu - Faculty of Economics and Business Administration Working Paper Series 124, Faculty of Economics and Business Administration, University of Tartu (Estonia).
    12. Ponta, Linda & Puliga, Gloria & Manzini, Raffaella & Cincotti, Silvano, 2024. "Reacting and recovering after an innovation failure. An agent-based approach," Technovation, Elsevier, vol. 129(C).
    13. Qingyi Chen & Yuting Liu & Zuolin Yao, 2024. "Spatial–Temporal Pattern Evolution and Differentiation Mechanism of Urban Dual Innovation: A Case Study of China’s Three Major Urban Agglomerations," Land, MDPI, vol. 13(9), pages 1-22, August.
    14. Andrés Barge-Gil & Pablo D'Este & Liliana Herrera, 2021. "PhD trained employees and firms’ transitions to upstream R&D activities," Industry and Innovation, Taylor & Francis Journals, vol. 28(4), pages 424-455, April.
    15. Guillermo Arenas Díaz & Andrés Barge-Gil & Joost Heijs & Alberto Marzucchi, 2025. "The effect of external innovation on firm employment," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 34(1), pages 44-69, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pablo D’Este & Alberto Marzucchi & Francesco Rentocchini, 2014. "Exploring and yet failing less: Learning from exploration, exploitation and human capital in R&D," SPRU Working Paper Series 2014-23, SPRU - Science Policy Research Unit, University of Sussex Business School.
    2. Linda Argote & Ella Miron-Spektor, 2011. "Organizational Learning: From Experience to Knowledge," Organization Science, INFORMS, vol. 22(5), pages 1123-1137, October.
    3. Linda Argote & Sunkee Lee & Jisoo Park, 2021. "Organizational Learning Processes and Outcomes: Major Findings and Future Research Directions," Management Science, INFORMS, vol. 67(9), pages 5399-5429, September.
    4. Mavroudi, Eva & Kesidou, Effie & Pandza, Krsto, 2020. "Shifting back and forth: How does the temporal cycling between exploratory and exploitative R&D influence firm performance?," Journal of Business Research, Elsevier, vol. 110(C), pages 386-396.
    5. Leoncini, Riccardo, 2016. "Learning-by-failing. An empirical exercise on CIS data," Research Policy, Elsevier, vol. 45(2), pages 376-386.
    6. Scott F. Rockart & Nilanjana Dutt, 2015. "The rate and potential of capability development trajectories," Strategic Management Journal, Wiley Blackwell, vol. 36(1), pages 53-75, January.
    7. Owusu Sarpong & Peter Teirlinck, 2018. "The influence of functional and geographical diversity in collaboration on product innovation performance in SMEs," The Journal of Technology Transfer, Springer, vol. 43(6), pages 1667-1695, December.
    8. Arza, Valeria & López, Emanuel, 2021. "Obstacles affecting innovation in small and medium enterprises: Quantitative analysis of the Argentinean manufacturing sector," Research Policy, Elsevier, vol. 50(9).
    9. Stojcic, Nebojsa, 2024. "Innovation failure, training for innovative activities and public support for innovation: Multi-annual evidence from emerging European innovation systems," Research Policy, Elsevier, vol. 53(8).
    10. Peeters, T.J.G., 2013. "External knowledge search and use in new product development," Other publications TiSEM 300ebb34-b090-4210-b95e-f, Tilburg University, School of Economics and Management.
    11. Frank T. Rothaermel & Maria Tereza Alexandre, 2009. "Ambidexterity in Technology Sourcing: The Moderating Role of Absorptive Capacity," Organization Science, INFORMS, vol. 20(4), pages 759-780, August.
    12. Vanesa Barrales-Molina & Leopoldo Gutierrez-Gutierrez & Marta Riquelme-Medina, 2023. "International breadth in coopetition and innovation performance: evidence from the Spanish biotechnology industry," Industry and Innovation, Taylor & Francis Journals, vol. 30(2), pages 286-309, February.
    13. Toft-Kehler, Rasmus & Wennberg, Karl & Kim, Phillip H., 2014. "Practice makes perfect: Entrepreneurial-experience curves and venture performance," Journal of Business Venturing, Elsevier, vol. 29(4), pages 453-470.
    14. Anindya Ghosh & Xavier Martin & Johannes M. Pennings & Filippo Carlo Wezel, 2014. "Ambition Is Nothing Without Focus: Compensating for Negative Transfer of Experience in R&D," Organization Science, INFORMS, vol. 25(2), pages 572-590, April.
    15. Mavroudi, Eva & Kesidou, Effie & Pandza, Krsto, 2023. "Effects of ambidextrous and specialized R&D strategies on firm performance: The contingent role of industry orientation," Journal of Business Research, Elsevier, vol. 154(C).
    16. Alhusen, Harm & Bennat, Tatjana & Bizer, Kilian & Cantner, Uwe & Horstmann, Elaine & Kalthaus, Martin & Proeger, Till & Sternberg, Rolf & Töpfer, Stefan, 2021. "A New Measurement Conception for the ‘Doing-Using-Interacting’ Mode of Innovation," Research Policy, Elsevier, vol. 50(4).
    17. Scott F. Rockart & Kristin Wilson, 2019. "Learning in Cycles," Organization Science, INFORMS, vol. 30(1), pages 70-87, February.
    18. Xinwei Ye & Lei Ma & Junwen Feng & Yang Cheng & Zheng Liu, 2018. "Impact of Technology Habitual Domain on Ambidextrous Innovation: Case Study of a Chinese High-Tech Enterprise," Sustainability, MDPI, vol. 10(12), pages 1-21, December.
    19. Dennys Eduardo Rossetto & Roberto Carlos Bernardes & Felipe Mendes Borini & Cristiane Chaves Gattaz, 2018. "Structure and evolution of innovation research in the last 60 years: review and future trends in the field of business through the citations and co-citations analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1329-1363, June.
    20. D'Este, Pablo & Amara, Nabil & Olmos-Peñuela, Julia, 2016. "Fostering novelty while reducing failure: Balancing the twin challenges of product innovation," Technological Forecasting and Social Change, Elsevier, vol. 113(PB), pages 280-292.

    More about this item

    JEL classification:

    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives
    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • D22 - Microeconomics - - Production and Organizations - - - Firm Behavior: Empirical Analysis
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:indcch:v:27:y:2018:i:3:p:525-553.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/icc .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.