IDEAS home Printed from https://ideas.repec.org/p/ost/wpaper/374.html
   My bibliography  Save this paper

Bidding against the odds? The impact evaluation of grants for young micro and small firms during the recession

Author

Listed:
  • Stjepan Srhoj
  • Bruno Škrinjarić
  • Sonja Radas

Abstract

Impact evaluations of entrepreneurship policies targeting young firms have been somewhat neglected thus far in the literature. While most research studies focus on the impact of research and development (R&D) grants, a larger percentage of young firms would benefit from grants that assist them in other activities. In this paper we examine the impact of small business development grants on survival and performance of young firms. We study this topic in the context of a long recession in Croatia (2009 to 2014), which makes it possible to better observe the effect of the public instrument intervention. As the grants were too small to produce any direct effects, the positive effects were achieved indirectly through enabling young firms to get bank loans, either by means of certification effect or because of behavoral additionality which raised their ability to apply for loans. The results show positive impact on firm survival after the recession.

Suggested Citation

  • Stjepan Srhoj & Bruno Škrinjarić & Sonja Radas, 2018. "Bidding against the odds? The impact evaluation of grants for young micro and small firms during the recession," Working Papers 374, Leibniz Institut für Ost- und Südosteuropaforschung (Institute for East and Southeast European Studies).
  • Handle: RePEc:ost:wpaper:374
    as

    Download full text from publisher

    File URL: https://www.dokumente.ios-regensburg.de/publikationen/wp/wp_374.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kimberly A. Eddleston & Jamie J. Ladge & Cheryl Mitteness & Lakshmi Balachandra, 2016. "Do you See what I See? Signaling Effects of Gender and Firm Characteristics on Financing Entrepreneurial Ventures," Entrepreneurship Theory and Practice, , vol. 40(3), pages 489-514, May.
    2. Ramana Nanda & William R. Kerr, 2015. "Financing Innovation," Annual Review of Financial Economics, Annual Reviews, vol. 7(1), pages 445-462, December.
    3. Bronwyn Hall & Alessandro Maffioli, 2008. "Evaluating the impact of technology development funds in emerging economies: evidence from Latin America," The European Journal of Development Research, Taylor and Francis Journals, vol. 20(2), pages 172-198.
    4. Patrick Musso & Stefano Schiavo, 2008. "The impact of financial constraints on firm survival and growth," Journal of Evolutionary Economics, Springer, vol. 18(2), pages 135-149, April.
    5. Massimo G. Colombo & Evila Piva & Anita Quas & Cristina Rossi-Lamastra, 2016. "How high-tech entrepreneurial ventures cope with the global crisis: changes in product innovation and internationalization strategies," Industry and Innovation, Taylor & Francis Journals, vol. 23(7), pages 647-671, October.
    6. José Ángel Zúñiga-Vicente & César Alonso-Borrego & Francisco J. Forcadell & José I. Galán, 2014. "Assessing The Effect Of Public Subsidies On Firm R&D Investment: A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 28(1), pages 36-67, February.
    7. Alperovych, Yan & Hübner, Georges & Lobet, Fabrice, 2015. "How does governmental versus private venture capital backing affect a firm's efficiency? Evidence from Belgium," Journal of Business Venturing, Elsevier, vol. 30(4), pages 508-525.
    8. Uwe Cantner & Sarah Kösters, 2012. "Picking the winner? Empirical evidence on the targeting of R&D subsidies to start-ups," Small Business Economics, Springer, vol. 39(4), pages 921-936, November.
    9. Anže Burger & Matija Rojec, 2018. "Impotence of Crisis-Motivated Subsidization of Firms: The Case of Slovenia," Eastern European Economics, Taylor & Francis Journals, vol. 56(2), pages 122-148, March.
    10. Daniel P. Forbes & Patricia S. Borchert & Mary E. Zellmer–Bruhn & Harry J. Sapienza, 2006. "Entrepreneurial Team Formation: An Exploration of New Member Addition," Entrepreneurship Theory and Practice, , vol. 30(2), pages 225-248, March.
    11. Dirk Czarnitzki, 2006. "Research And Development In Small And Medium‐Sized Enterprises: The Role Of Financial Constraints And Public Funding," Scottish Journal of Political Economy, Scottish Economic Society, vol. 53(3), pages 335-357, July.
    12. Stefano Costa & Carmine Pappalardo & Claudio Vicarelli, 2017. "Internationalization choices and Italian firm performance during the crisis," Small Business Economics, Springer, vol. 48(3), pages 753-769, March.
    13. Tobias Stucki, 2014. "Success of start-up firms: the role of financial constraints," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 23(1), pages 25-64, February.
    14. G. M.P. Swann, 2009. "The Economics of Innovation," Books, Edward Elgar Publishing, number 13211.
    15. Miriam Bruhn & Dean Karlan & Antoinette Schoar, 2018. "The Impact of Consulting Services on Small and Medium Enterprises: Evidence from a Randomized Trial in Mexico," Journal of Political Economy, University of Chicago Press, vol. 126(2), pages 635-687.
    16. Criscuolo, Chiara & Martin, Ralf & Overman, Henry & Van Reenen, John, 2012. "The Causal Effects of an Industrial Policy," IZA Discussion Papers 6323, Institute of Labor Economics (IZA).
    17. Jerzy Michalek & Pavel Ciaian & D'Artis Kancs, 2016. "Investment Crowding Out: Firm-Level Evidence from Northern Germany," Regional Studies, Taylor & Francis Journals, vol. 50(9), pages 1579-1594, September.
    18. Dirk Czarnitzki & Julie Delanote, 2015. "R&D policies for young SMEs: input and output effects," Small Business Economics, Springer, vol. 45(3), pages 465-485, October.
    19. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    20. Richard Ericson & Ariel Pakes, 1995. "Markov-Perfect Industry Dynamics: A Framework for Empirical Work," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 62(1), pages 53-82.
    21. Isabel Busom, 2000. "An Empirical Evaluation of The Effects of R&D Subsidies," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 9(2), pages 111-148.
    22. DiPrete, Thomas A. & Gangl, Markus, 2004. "Assessing bias in the estimation of causal effects: Rosenbaum bounds on matching estimators and instrumental variables estimation with imperfect instruments," Discussion Papers, Research Unit: Labor Market Policy and Employment SP I 2004-101, WZB Berlin Social Science Center.
    23. Hud, Martin & Hussinger, Katrin, 2015. "The impact of R&D subsidies during the crisis," Research Policy, Elsevier, vol. 44(10), pages 1844-1855.
    24. Backman, Mikaela & Gabe, Todd & Mellander, Charlotta, 2016. "Effects of Human Capital on the Growth and Survival of Swedish Businesses," Journal of Regional Analysis and Policy, Mid-Continent Regional Science Association, vol. 46(1).
    25. Jae Sim & Simon Gilchrist, 2007. "Investment during the Korean financial crisis: A structural econometric approach," 2007 Meeting Papers 53, Society for Economic Dynamics.
    26. Ben S. Bernanke, 1983. "Irreversibility, Uncertainty, and Cyclical Investment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 98(1), pages 85-106.
    27. Hall, Bronwyn H. & Lerner, Josh, 2010. "The Financing of R&D and Innovation," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 609-639, Elsevier.
    28. Gladys Lopez-Acevedo & Hong W. Tan, 2011. "Impact Evaluation of Small and Medium Enterprise Programs in Latin America and the Caribbean," World Bank Publications - Books, The World Bank Group, number 2298.
    29. Scott Shane, 2009. "Why encouraging more people to become entrepreneurs is bad public policy," Small Business Economics, Springer, vol. 33(2), pages 141-149, August.
    30. Dejan Kovac & Vuk Vukovic & Nikola Kleut & Boris Podobnik, 2016. "To Invest or Not to Invest, That Is the Question: Analysis of Firm Behavior under Anticipated Shocks," PLOS ONE, Public Library of Science, vol. 11(8), pages 1-18, August.
    31. repec:zbw:bofrdp:urn:nbn:fi:bof-201512141480 is not listed on IDEAS
    32. Sabrina T. Howell, 2017. "Financing Innovation: Evidence from R&D Grants," American Economic Review, American Economic Association, vol. 107(4), pages 1136-1164, April.
    33. Guido Pellegrini & Teo Muccigrosso, 2017. "Do subsidized new firms survive longer? Evidence from a counterfactual approach," Regional Studies, Taylor & Francis Journals, vol. 51(10), pages 1483-1493, October.
    34. Colombo, Massimo G. & Grilli, Luca, 2005. "Founders' human capital and the growth of new technology-based firms: A competence-based view," Research Policy, Elsevier, vol. 34(6), pages 795-816, August.
    35. Meuleman, Miguel & De Maeseneire, Wouter, 2012. "Do R&D subsidies affect SMEs’ access to external financing?," Research Policy, Elsevier, vol. 41(3), pages 580-591.
    36. Lerner, Josh, 1999. "The Government as Venture Capitalist: The Long-Run Impact of the SBIR Program," The Journal of Business, University of Chicago Press, vol. 72(3), pages 285-318, July.
    37. Inés Butler & Gabriela Galassi & Hernán Ruffo, 2016. "Public funding for startups in Argentina: an impact evaluation," Small Business Economics, Springer, vol. 46(2), pages 295-309, February.
    38. Pfeiffer, Friedhelm & Reize, Frank, 2000. "Business start-ups by the unemployed -- an econometric analysis based on firm data," Labour Economics, Elsevier, vol. 7(5), pages 629-663, September.
    39. Cumming, Douglas J. & Grilli, Luca & Murtinu, Samuele, 2017. "Governmental and independent venture capital investments in Europe: A firm-level performance analysis," Journal of Corporate Finance, Elsevier, vol. 42(C), pages 439-459.
    40. Pedro J. García‐Teruel & Pedro Martínez‐Solano, 2008. "On the Determinants of SME Cash Holdings: Evidence from Spain," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 35(1‐2), pages 127-149, January.
    41. David Aristei & Alessandro Sterlacchini & Francesco Venturini, 2017. "Effectiveness of R&D subsidies during the crisis: firm-level evidence across EU countries," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 26(6), pages 554-573, August.
    42. Huber, Peter & Oberhofer, Harald & Pfaffermayr, Michael, 2017. "Who creates jobs? Econometric modeling and evidence for Austrian firm level data," European Economic Review, Elsevier, vol. 91(C), pages 57-71.
    43. Hans Landström, 2005. "Pioneers in Entrepreneurship and Small Business Research," International Studies in Entrepreneurship, Springer, number 978-0-387-23633-9, November.
    44. Alberto Abadie & Guido W. Imbens, 2008. "On the Failure of the Bootstrap for Matching Estimators," Econometrica, Econometric Society, vol. 76(6), pages 1537-1557, November.
    45. Colin Wren, 2002. "Evaluating the effect of soft business support upon small firm performance," Oxford Economic Papers, Oxford University Press, vol. 54(2), pages 334-365, April.
    46. Simon Gilchrist & Jae W. Sim, 2007. "Investment during the Korean Financial Crisis: A Structural Econometric Analysis," NBER Working Papers 13315, National Bureau of Economic Research, Inc.
    47. Bertoni, Fabio & Tykvová, Tereza, 2015. "Does governmental venture capital spur invention and innovation? Evidence from young European biotech companies," Research Policy, Elsevier, vol. 44(4), pages 925-935.
    48. David McKenzie, 2017. "Identifying and Spurring High-Growth Entrepreneurship: Experimental Evidence from a Business Plan Competition," American Economic Review, American Economic Association, vol. 107(8), pages 2278-2307, August.
    49. José Martí & Anita Quas, 2018. "A beacon in the night: government certification of SMEs towards banks," Small Business Economics, Springer, vol. 50(2), pages 397-413, February.
    50. Evans, David S & Jovanovic, Boyan, 1989. "An Estimated Model of Entrepreneurial Choice under Liquidity Constraints," Journal of Political Economy, University of Chicago Press, vol. 97(4), pages 808-827, August.
    51. Bronwyn Hall & Alessandro Maffioli, 2008. "Evaluating the impact of technology development funds in emerging economies: evidence from Latin America," The European Journal of Development Research, Taylor and Francis Journals, vol. 20(2), pages 172-198.
    52. Heli Koski & Mika Pajarinen, 2013. "The role of business subsidies in job creation of start-ups, gazelles and incumbents," Small Business Economics, Springer, vol. 41(1), pages 195-214, June.
    53. Elena Huergo & Mayte Trenado, 2010. "The Application for and the Awarding of Low-Interest Credits to Finance R&D Projects," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 37(3), pages 237-259, November.
    54. repec:lic:licosd:37015 is not listed on IDEAS
    55. Klette, Tor Jakob & Moen, Jarle & Griliches, Zvi, 2000. "Do subsidies to commercial R&D reduce market failures? Microeconometric evaluation studies1," Research Policy, Elsevier, vol. 29(4-5), pages 471-495, April.
    56. repec:zbw:bofrdp:2015_028 is not listed on IDEAS
    57. CREPON Bruno & DUGUET Emmanuel, 2004. "Bank loans, start-up subsidies and the survival of the new firms: an econometric analysis at the entrepreneur level," Labor and Demography 0411004, University Library of Munich, Germany.
    58. Guerini, Massimiliano & Quas, Anita, 2016. "Governmental venture capital in Europe: Screening and certification," Journal of Business Venturing, Elsevier, vol. 31(2), pages 175-195.
    59. Jovanovic, Boyan, 1982. "Selection and the Evolution of Industry," Econometrica, Econometric Society, vol. 50(3), pages 649-670, May.
    60. Vitezić Vanja & Srhoj Stjepan & Perić Marko, 2018. "Investigating Industry Dynamics in a Recessionary Transition Economy," South East European Journal of Economics and Business, Sciendo, vol. 13(1), pages 43-67, June.
    61. Alex Coad, 2018. "Firm age: a survey," Journal of Evolutionary Economics, Springer, vol. 28(1), pages 13-43, January.
    62. David McKenzie & Nabila Assaf & Ana Paula Cusolito, 2017. "The additionality impact of a matching grant programme for small firms: experimental evidence from Yemen," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 9(1), pages 1-14, January.
    63. Daniel Neicu & Peter Teirlinck & Stijn Kelchtermans, 2016. "Dipping in the policy mix: Do R&D subsidies foster behavioral additionality effects of R&D tax credits?," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 25(3), pages 218-239, April.
    64. Bertoni, Fabio & Martí, Jose & Reverte, Carmelo, 2019. "The impact of government-supported participative loans on the growth of entrepreneurial ventures," Research Policy, Elsevier, vol. 48(1), pages 371-384.
    65. Dimos, Christos & Pugh, Geoff, 2016. "The effectiveness of R&D subsidies: A meta-regression analysis of the evaluation literature," Research Policy, Elsevier, vol. 45(4), pages 797-815.
    66. Donald B. Rubin, 1977. "Assignment to Treatment Group on the Basis of a Covariate," Journal of Educational and Behavioral Statistics, , vol. 2(1), pages 1-26, March.
    67. Lionel Désiage & Richard Duhautois & Dominique Redor, 2010. "Do Public Subsidies Have an Impact on New Firm Survival? An Empirical Study with French Data," TEPP Working Paper 2010-04, TEPP.
    68. Flavio Calvino & Chiara Criscuolo & Carlo Menon, 2015. "Cross-country evidence on start-up dynamics," OECD Science, Technology and Industry Working Papers 2015/6, OECD Publishing.
    69. Felipe Rojas & Elena Huergo, 2016. "Characteristics of entrepreneurs and public support for NTBFs," Small Business Economics, Springer, vol. 47(2), pages 363-382, August.
    70. John Haltiwanger & Ron S. Jarmin & Javier Miranda, 2013. "Who Creates Jobs? Small versus Large versus Young," The Review of Economics and Statistics, MIT Press, vol. 95(2), pages 347-361, May.
    71. Grilli, Luca & Murtinu, Samuele, 2014. "Government, venture capital and the growth of European high-tech entrepreneurial firms," Research Policy, Elsevier, vol. 43(9), pages 1523-1543.
    72. Kostas Axarloglou, 2003. "The Cyclicality of New Product Introductions," The Journal of Business, University of Chicago Press, vol. 76(1), pages 29-48, January.
    73. Wooldridge, Jeffrey M., 2009. "On estimating firm-level production functions using proxy variables to control for unobservables," Economics Letters, Elsevier, vol. 104(3), pages 112-114, September.
    74. Stefaan Decramer & Stijn Vanormelingen, 2016. "The effectiveness of investment subsidies: evidence from a regression discontinuity design," Small Business Economics, Springer, vol. 47(4), pages 1007-1032, December.
    75. Alfredo Del Monte & Domenico Scalera, 2001. "The Life Duration of Small Firms Born Within a Start-up Programme: Evidence from Italy," Regional Studies, Taylor & Francis Journals, vol. 35(1), pages 11-21.
    76. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    77. Agustí Segarra-Blasco & Mercedes Teruel, 2016. "Application and success of R&D subsidies: what is the role of firm age?," Industry and Innovation, Taylor & Francis Journals, vol. 23(8), pages 713-733, November.
    78. Chapman, Gary & Hewitt-Dundas, Nola, 2018. "The effect of public support on senior manager attitudes to innovation," Technovation, Elsevier, vol. 69(C), pages 28-39.
    79. Fernando Galindo-Rueda & Fabien Verger, 2016. "OECD Taxonomy of Economic Activities Based on R&D Intensity," OECD Science, Technology and Industry Working Papers 2016/4, OECD Publishing.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Srhoj, Stjepan & Walde, Janette, 2020. "Getting ready for EU Single Market: The effect of export-oriented grant schemes on firm performance," Structural Change and Economic Dynamics, Elsevier, vol. 52(C), pages 279-293.
    2. Stjepan Srhoj & Bruno Skrinjaric & Sonja Radas & Janette Walde, 2019. "Closing the Finance Gap by Nudging: Impact Assessment of Public Grants for Women Entrepreneurs," Working Papers 1902, The Institute of Economics, Zagreb.
    3. Hottenrott, Hanna & Richstein, Robert, 2020. "Start-up subsidies: Does the policy instrument matter?," Research Policy, Elsevier, vol. 49(1).
    4. Stjepan Srhoj & Michael Lapinski & Janette Walde, 2019. "Size matters? Impact evaluation of business development grants on SME performance," Working Papers 2019-14, Faculty of Economics and Statistics, Universität Innsbruck.
    5. Bertoni, Fabio & Martí, Jose & Reverte, Carmelo, 2019. "The impact of government-supported participative loans on the growth of entrepreneurial ventures," Research Policy, Elsevier, vol. 48(1), pages 371-384.
    6. Stjepan Srhoj & Michal Lapinski & Janette Walde, 2021. "Impact evaluation of business development grants on SME performance," Small Business Economics, Springer, vol. 57(3), pages 1285-1301, October.
    7. Stjepan Srhoj & Bruno Škrinjarić & Sonja Radas & Janette Walde, 2022. "Small matching grants for women entrepreneurs: lessons from the past recession," Small Business Economics, Springer, vol. 59(1), pages 117-142, June.
    8. Thomas H. W. Ziesemer, 2021. "The Effects of R&D Subsidies and Publicly Performed R&D on Business R&D: A Survey," Hacienda Pública Española / Review of Public Economics, IEF, vol. 236(1), pages 171-205, March.
    9. Andrea Bellucci & Luca Pennacchio & Alberto Zazzaro, 2019. "R&D Subsidies and Firms’ Debt Financing," CSEF Working Papers 527, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
    10. Bellucci, Andrea & Pennacchio, Luca & Zazzaro, Alberto, 2023. "Debt financing of SMEs: The certification role of R&D Subsidies," International Review of Financial Analysis, Elsevier, vol. 90(C).
    11. José Martí & Anita Quas, 2018. "A beacon in the night: government certification of SMEs towards banks," Small Business Economics, Springer, vol. 50(2), pages 397-413, February.
    12. Felipe Rojas & Elena Huergo, 2016. "Characteristics of entrepreneurs and public support for NTBFs," Small Business Economics, Springer, vol. 47(2), pages 363-382, August.
    13. Alperovych, Yan & Groh, Alexander & Quas, Anita, 2020. "Bridging the equity gap for young innovative companies: The design of effective government venture capital fund programs," Research Policy, Elsevier, vol. 49(10).
    14. Zhao, Bo & Ziedonis, Rosemarie, 2020. "State governments as financiers of technology startups: Evidence from Michigan's R&D loan program," Research Policy, Elsevier, vol. 49(4).
    15. Pietro Santoleri & Andrea Mina & Alberto Di Minin & Irene Martelli, 2024. "The Causal Effects of R&D Grants: Evidence from a Regression Discontinuity," The Review of Economics and Statistics, MIT Press, vol. 106(6), pages 1495-1510, November.
    16. Enrico Vanino & Stephen Roper & Bettina Becker, 2020. "Knowledge to Money: Assessing the Business Performance Effects of Publicly Funded R&D Grants," ifo DICE Report, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 17(04), pages 20-24, January.
    17. Ugur, Mehmet & Trushin, Eshref, 2018. "Asymmetric information and heterogeneous effects of R&D subsidies: evidence on R&D investment and employment of R&D personel," Greenwich Papers in Political Economy 21943, University of Greenwich, Greenwich Political Economy Research Centre.
    18. Raphaël CHIAPPINI & Sophie POMMET, 2023. "The impact of public support for innovation on SME performance and efficiency," Bordeaux Economics Working Papers 2023-06, Bordeaux School of Economics (BSE).
    19. Grilli, Luca & Murtinu, Samuele, 2018. "Selective subsidies, entrepreneurial founders' human capital, and access to R&D alliances," Research Policy, Elsevier, vol. 47(10), pages 1945-1963.
    20. Berger, Marius & Hottenrott, Hanna, 2021. "Start-up subsidies and the sources of venture capital," Journal of Business Venturing Insights, Elsevier, vol. 16(C).

    More about this item

    Keywords

    Grants; recession; young firms; survival; firm performance; bank loans;
    All these keywords.

    JEL classification:

    • H25 - Public Economics - - Taxation, Subsidies, and Revenue - - - Business Taxes and Subsidies

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ost:wpaper:374. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kseniia Gatskova (email available below). General contact details of provider: https://edirc.repec.org/data/osteide.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.