IDEAS home Printed from https://ideas.repec.org/p/ekd/008007/8482.html
   My bibliography  Save this paper

Structural Reforms in DSGE Models : A Plead for Sensitivity Analysis

Author

Listed:
  • Benoît Campagne
  • Aurélien Poissonnier

Abstract

The evaluation of fiscal and structural reforms has become not only a standard but indispensable exercise in the DSGE literature and in the policy-making publications and reports. Institutions such as the IMF, the European Commission, the OECD, the ECB, and many central banks have now developed and refined their own tools and are capable of conducting such analyses in different contexts. The effects of structural reforms have been documented by D'Auria et al. (2009) for EU member states and for Italy by Annicchiarico et al. (2013) both in the R&D version of the Quest III model. The IMF or the OECD have also conducted their own evaluations for Europe (Bayoumi et al., 2004; Everaert and Schule, 2006,2008; Cacciatore et al., 2012). Fiscal reforms or consolidation have also been assessed through DSGE models. In the European context some work were conducted on the Quest III model (Vogel, 2012). Coenen et al. (2008) investigate labor tax reforms in the New Area Wide Model (NAWM). Clinton et al. (2011) provide similar insights in the case of an international model (GIMF). Coenen et al. (2012) give an extensive review of the size of fiscal multipliers in the main institutional models. The recurrence and the systematic use of DSGEs today therefore raises the question of their actual capabilities. Whereas their qualitative behaviours have largely improved and now properly describe economic data, their quantitative accuracy is still debated among economists (see for instance Schorfheide (2011) for a summary of current DSGE weaknesses). We use the two country DSGE model of the Euro area MELEZE developed at Insee to shed a new light on two standard exercises: structural and fiscal reforms evaluations. The main features of the model compare with standard tools developed in international institutions and central banks: nominal and wage rigidities, capital adjustment cost, and both Ricardian and non-Ricardian consumers. We study the dependency of fiscal and structural simulations' results to various specifications in our DSGE model. Within a range of feasible calibrations for the elasticities in the utility function, the share of non Ricardian consumers, and among other sensitivity tests, the analysis focuses on short and long term multipliers of both fiscal and structural reforms. We also rank policy schemes based on welfare analyses along the transitional paths. The model MELEZE used in this paper features the standard modeling choices of the two country monetary union literature. The core of the model for each country is inspired by Christiano et al. (2005) and Smets and Wouter (2003, 2005, 2007): firms and consumers maximize their objective (utility or profit) by interacting on the goods, labor and capital markets with both prices and wages rigidities introducing neo-Keynesian features in the model à la Erceg et al. (2000). The model also integrates risk free assets to ensure an intertemporal trade-off and real rigidities on the capital market. In addition, our model builds on academic works studying monetary and fiscal policies in monetary unions Gali and Monacelli (2008), Benigno (2004) by introducing capital markets. We also introduce non Ricardian households as advocated by Mankiw (2000), a feature which is crucial for the reaction of private consumption to public spending (Gali et al. 2007), and therefore a priori crucial to the size of fiscal multipliers. We compare this mechanism with Edgeworth complementarity as advocated by Fève and Sahuc (2013). Moreover, we introduce in our model public and private debts exchanged on a union wide financial market both at steady state and out of equilibrium. Holding debt or asset is motivated by agents' preferences for the present and comes at a financial intermediation cost embodied through a debt elastic premium. We explicit and micro-found this financial intermediation service by introducing a financial intermediation sector. Beyond public debt, the government uses public spending to stimulate and monitor economic activity. It can also exogenously modify its fiscal policy along different axes: lump-sum transfers and taxes on consumption, labor, capital income or dividends. As detailed below, we depart from traditional budget rules behaviors used in the literature, and derive a forward-looking optimizing behavior for the government. All these modeling elements are generally embedded in large scale models developed in central banks and international institutions among which are GEM at the IMF (Bayoumi et al., 2004), NAWM at the ECB (Coenen et al., 2008) or in open economy EAGLE (Gomes et al., 2012), QUEST III at the European Commission (Ratto et al., 2009) and its R&D version (Roeger et al., 2008). Whereas these models sometimes also consider both tradable and non-tradable goods, heterogeneous agents on the labor market, or endogenous growth, we choose to simplify our model and do not consider these additions. The outcome is a model tractable enough to be fully linearized by hand. We are also able to solve for the steady state for the real variables in levels and carefully account for all the steady state restrictions imposed on the parameters of the model. We replicate three different settings: France against the rest of the Eurozone, Italy against the rest of the Eurozone, and a symmetric calibration for the Euro area as a closed economy. In a first section, we study the long-term impact of mark-up reforms in both the labor and goods markets. Even in the absence of entry costs, wage bargaining and an endogenous determination of the number of firms as in Blanchard and Giavazzi (2003), our results compare with stylized facts obtained in their model. Moreover and numerically, reforms simulation as conducted in Everaert and Schule (2006) indicates that the absence of additional rigidities and of a distinction between tradable and non-tradable goods may overestimate the long-term gains from pro-competitive reforms. More importantly, even though the stylized facts behind such reforms are robust, they increase output level at steady state, their quantification is uncertain. Within a range of feasible calibrations for the elasticities in the utility function, the effect of a structural reform can be magnified threefold. Similarly, the introduction of non Ricardian agents amplifies the gains from deregulation up to a doubling factor. In a second section, we study the effect of temporary or permanent fiscal reforms. We simulate increases in public spending, transfers or decreases in various tax rates calibrated to 1% of pre-stimulus output. The resulting fiscal multipliers are compared to the main existing DSGE models based on the results provided in Coenen et al. (2012), and to the French macroeconometric model Mésange developed at Insee (Klein and Simon, 2010). We find that our model gives comparable multipliers for temporary shocks but highlight that these measures of the fiscal multipliers crucially depend on their timing and the way both fiscal and monetary authorities commit or react to the stimulus. In particular, the modeling of government spending, usually introduced through an ad hoc spending rule, can imply fiscal multipliers larger or smaller than one. We compare these results with an alternative modeling of governments' behavior. Actually, we depart from ad hoc fiscal or budget rules traditionally introduced in quantitative models to endogenise public spending and tax rates to ensure governments' solvency (Bayoumi et al., 2004; Coenen et al., 2008; Ratto et al. 2009 ; Corsetti et al., 2009). We consider governments that maximize their stream of spending in a forward-looking way, closely equivalent to a Euler equation for households. In the end, public spending fiscal multipliers can range from 0.7 to 1.3 depending on the specification of the governments' spending rule and of the monetary environment. Cuts on distorting tax rates provides lower multipliers, that turn out to be even negative in the absence of government commitment for cuts in corporate income taxes and labor income taxes. Coordination across countries leads to increased fiscal multipliers. In response to permanent spending shocks financed though lump-sum transfers, our model provides weaker long-term multipliers yet comparable to Coenen et al. (2012) results. This weaker response stems from the negative wealth effect implied by the necessary financing fall in transfers. In all, our results raise questions on the ability for current quantitative DSGE models to provide accurate quantitative estimates for economic policies. In the conduct of policy analysis, one should therefore be very cautious to properly assess the dependency of the results to the specification of the model, and provide detailed sensitivity tests. Ongoing developments to be included in this paper include: a. Studying the transitional dynamic of structural reforms b. Ranking policy schemes based on welfare analyses along the transitional paths c. Stronger justification of the government’s behavior by the introduction of government spending in households’ utility function.

Suggested Citation

  • Benoît Campagne & Aurélien Poissonnier, 2015. "Structural Reforms in DSGE Models : A Plead for Sensitivity Analysis," EcoMod2015 8482, EcoMod.
  • Handle: RePEc:ekd:008007:8482
    as

    Download full text from publisher

    File URL: http://ecomod.net/system/files/Campagne.DT-Structural_Reforms_light.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Philippe Martin & Thomas Philippon, 2017. "Inspecting the Mechanism: Leverage and the Great Recession in the Eurozone," American Economic Review, American Economic Association, vol. 107(7), pages 1904-1937, July.
    2. Abel, Andrew B, 1990. "Asset Prices under Habit Formation and Catching Up with the Joneses," American Economic Review, American Economic Association, vol. 80(2), pages 38-42, May.
    3. Olivier Blanchard & Francesco Giavazzi, 2003. "Macroeconomic Effects of Regulation and Deregulation in Goods and Labor Markets," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 879-907.
    4. Vogel, Lukas, 2017. "Structural reforms at the zero bound," European Journal of Political Economy, Elsevier, vol. 48(C), pages 74-90.
    5. Matteo Cacciatore & Romain Duval & Giuseppe Fiori, 2012. "Short-Term Gain or Pain? A DSGE Model-Based Analysis of the Short-Term Effects of Structural Reforms in Labour and Product Markets," OECD Economics Department Working Papers 948, OECD Publishing.
    6. Jody Overland & Christopher D. Carroll & David N. Weil, 2000. "Saving and Growth with Habit Formation," American Economic Review, American Economic Association, vol. 90(3), pages 341-355, June.
    7. Romain Duval & Jørgen Elmeskov, 2005. "The Effects of EMU on Structural Reforms in Labour and Product Markets," OECD Economics Department Working Papers 438, OECD Publishing.
    8. Daragh Clancy & Rossana Merola, 2016. "ÉIRE Mod: A DSGE Model for Ireland," The Economic and Social Review, Economic and Social Studies, vol. 47(1), pages 1-31.
    9. Patrick Fève & Jean-Guillaume Sahuc, 2015. "On the size of the government spending multiplier in the euro area," Oxford Economic Papers, Oxford University Press, vol. 67(3), pages 531-552.
    10. Bayoumi, Tamim & Laxton, Douglas & Pesenti, Paolo, 2004. "Benefits and spillovers of greater competition in Europe: a macroeconomic assessment," Working Paper Series 341, European Central Bank.
    11. Annicchiarico, Barbara & Di Dio, Fabio & Felici, Francesco, 2013. "Structural reforms and the potential effects on the Italian economy," Journal of Policy Modeling, Elsevier, vol. 35(1), pages 88-109.
    12. Frank Smets & Raf Wouters, 2005. "Comparing shocks and frictions in US and euro area business cycles: a Bayesian DSGE Approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(2), pages 161-183.
    13. Sandra Gomes & Pascal Jacquinot & Matthias Mohr & Massimiliano Pisani, 2013. "Structural Reforms and Macroeconomic Performance in the Euro Area Countries: A Model-Based Assessment," International Finance, Wiley Blackwell, vol. 16(1), pages 23-44, February.
    14. Greg Kaplan & Giovanni L. Violante & Justin Weidner, 2014. "The Wealthy Hand-to-Mouth," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 48(1 (Spring), pages 77-153.
    15. Janos Varga & Werner Roeger & Jan in’t Veld, 2014. "Growth effects of structural reforms in Southern Europe: the case of Greece, Italy, Spain and Portugal," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 41(2), pages 323-363, May.
    16. Gali, Jordi, 1994. "Keeping Up with the Joneses: Consumption Externalities, Portfolio Choice, and Asset Prices," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 26(1), pages 1-8, February.
    17. Campbell, John Y & Mankiw, N Gregory, 1990. "Permanent Income, Current Income, and Consumption," Journal of Business & Economic Statistics, American Statistical Association, vol. 8(3), pages 265-279, July.
    18. repec:hal:spmain:info:hdl:2441/59bp0vqv2b8k7a185vg2hert9v is not listed on IDEAS
    19. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    20. Werner Roeger & Janos Varga & Jan in 't Veld, 2008. "Structural Reforms in the EU: A simulation-based analysis using the QUEST model with endogenous growth," European Economy - Economic Papers 2008 - 2015 351, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    21. Magnus Jonsson, 2007. "The welfare cost of imperfect competition and distortionary taxation," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 10(4), pages 576-594, October.
    22. Christopher D. Carroll & Jody Overland & David N. Weil, 1995. "Saving and growth with habit formation," Working Papers 95-42, Brown University, Department of Economics.
    23. Eggertsson, Gauti & Ferrero, Andrea & Raffo, Andrea, 2014. "Can structural reforms help Europe?," Journal of Monetary Economics, Elsevier, vol. 61(C), pages 2-22.
    24. Erceg, Christopher J. & Henderson, Dale W. & Levin, Andrew T., 2000. "Optimal monetary policy with staggered wage and price contracts," Journal of Monetary Economics, Elsevier, vol. 46(2), pages 281-313, October.
    25. Forni, Lorenzo & Gerali, Andrea & Pisani, Massimiliano, 2010. "The macroeconomics of fiscal consolidations in euro area countries," Journal of Economic Dynamics and Control, Elsevier, vol. 34(9), pages 1791-1812, September.
    26. Greg Kaplan & Giovanni L. Violante & Justin Weidner, 2014. "The Wealthy Hand-to-Mouth," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 45(1 (Spring), pages 77-153.
    27. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    28. Coenen, Günter & McAdam, Peter & Straub, Roland, 2008. "Tax reform and labour-market performance in the euro area: A simulation-based analysis using the New Area-Wide Model," Journal of Economic Dynamics and Control, Elsevier, vol. 32(8), pages 2543-2583, August.
    29. Trabandt, Mathias & Uhlig, Harald, 2011. "The Laffer curve revisited," Journal of Monetary Economics, Elsevier, vol. 58(4), pages 305-327.
    30. Miles S. Kimball & Matthew D. Shapiro, 2008. "Labor Supply: Are the Income and Substitution Effects Both Large or Both Small?," NBER Working Papers 14208, National Bureau of Economic Research, Inc.
    31. B. Campagne & A. Poissonnier, 2016. "MELEZE: A DSGE model for France within the Euro Area," Documents de Travail de l'Insee - INSEE Working Papers g2016-05, Institut National de la Statistique et des Etudes Economiques.
    32. Ratto, Marco & Roeger, Werner & Veld, Jan in 't, 2009. "QUEST III: An estimated open-economy DSGE model of the euro area with fiscal and monetary policy," Economic Modelling, Elsevier, vol. 26(1), pages 222-233, January.
    33. Matheron, Julien & Maury, Tristan-Pierre, 2004. "The welfare cost of monopolistic competition: a quantitative assessment," Economic Modelling, Elsevier, vol. 21(6), pages 933-948, December.
    34. King, Robert G & Plosser, Charles I & Rebelo, Sergio T, 2002. "Production, Growth and Business Cycles: Technical Appendix," Computational Economics, Springer;Society for Computational Economics, vol. 20(1-2), pages 87-116, October.
    35. Dimitris Papageorgiou & Evangelia Vourvachaki, 2015. "The Macroeconomic Impact of Structural Reforms in Product and Labour Markets: Trade-Offs and Complementarities," Working Papers 197, Bank of Greece.
    36. Matheron, Julien, 2002. "The welfare cost of monopolistic competition revisited," Economics Letters, Elsevier, vol. 75(1), pages 129-133, March.
    37. Carroll, Christopher D., 2000. "Solving consumption models with multiplicative habits," Economics Letters, Elsevier, vol. 68(1), pages 67-77, July.
    38. Mr. Luc Everaert & Mr. Werner Schule, 2006. "Structural Reforms in the Euro Area: Economic Impact and Role of Synchronization Across Markets and Countries," IMF Working Papers 2006/137, International Monetary Fund.
    39. Jeffrey C. Fuhrer, 2000. "Habit Formation in Consumption and Its Implications for Monetary-Policy Models," American Economic Review, American Economic Association, vol. 90(3), pages 367-390, June.
    40. Vogel, Lukas, 2012. "Structural reforms, fiscal consolidation and external rebalancing in monetary union: A model-based analysis," Economic Modelling, Elsevier, vol. 29(4), pages 1286-1298.
    41. Janos Varga & Jan in 't Veld, 2014. "The potential growth impact of structural reforms in the EU. A benchmarking exercise," European Economy - Economic Papers 2008 - 2015 541, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    42. Francesca D'Auria & Andrea Pagano & Marco Ratto & Janos Varga, 2009. "A comparison of structural reform scenarios across the EU member states - Simulation-based analysis using the QUEST model with endogenous growth," European Economy - Economic Papers 2008 - 2015 392, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    43. Taylor, John B., 1993. "Discretion versus policy rules in practice," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 39(1), pages 195-214, December.
    44. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    45. Luc Everaert & Werner Schule, 2008. "Why It Pays to Synchronize Structural Reforms in the Euro Area Across Markets and Countries," IMF Staff Papers, Palgrave Macmillan, vol. 55(2), pages 356-366, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jocelyn Boussard & Benoît Campagne, 2017. "Fiscal policy coordination in a monetary union at the zero lower bound," Economie et Statistique / Economics and Statistics, Institut National de la Statistique et des Etudes Economiques (INSEE), issue 494-495-4, pages 65-90.
    2. repec:prs:ecstat:estat_0336-1454_2017_num_494_1_10782 is not listed on IDEAS
    3. Annicchiarico, Barbara & Di Dio, Fabio & Felici, Francesco, 2013. "Structural reforms and the potential effects on the Italian economy," Journal of Policy Modeling, Elsevier, vol. 35(1), pages 88-109.
    4. FRANCESCO FELICI & Barbara Annicchiarico & Fabio Di Dio, 2012. "Structural Reforms and the Potential Effects on the Italian Economy," EcoMod2012 5073, EcoMod.
    5. Barbara Annicchiarico, Fabio Di Dio, Francesco Felici, 2013. "Pro-Competitive Reforms And Timing Of Implementation: An Igem-Based Simulation Analysis For Italy," RIEDS - Rivista Italiana di Economia, Demografia e Statistica - The Italian Journal of Economic, Demographic and Statistical Studies, SIEDS Societa' Italiana di Economia Demografia e Statistica, vol. 67(2), pages 155-170, April-Jun.
    6. Jean Boivin & Marc P. Giannoni, 2006. "Has Monetary Policy Become More Effective?," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 445-462, August.
    7. Albonico, Alice & Tirelli, Patrizio, 2020. "Financial crises and sudden stops: Was the European monetary union crisis different?," Economic Modelling, Elsevier, vol. 93(C), pages 13-26.
    8. Annabelle Mourougane & Lukas Vogel, 2009. "Speed of Adjustment to Selected Labour Market and Tax Reforms," Comparative Economic Studies, Palgrave Macmillan;Association for Comparative Economic Studies, vol. 51(4), pages 500-519, December.
    9. Alice, Albonico & Alessia, Paccagnini & Patrizio, Tirelli, 2016. "PIIGS in the Euro Area. An Empirical DSGE Model," Working Papers 331, University of Milano-Bicocca, Department of Economics, revised 11 Mar 2016.
    10. Aida Caldera Sánchez & Alain de Serres & Naomitsu Yashiro, 2017. "Reforming in a Difficult Macroeconomic Context: A Review of Issues and Recent Literature," Journal of International Commerce, Economics and Policy (JICEP), World Scientific Publishing Co. Pte. Ltd., vol. 8(01), pages 1-41, February.
    11. Fritz Breuss, 2015. "In Search of Growth in a Future with Diminished Expectations. The Case of Austria," WIFO Working Papers 493, WIFO.
    12. Matthieu Darracq Paries, 2018. "Financial frictions and monetary policy conduct," Erudite Ph.D Dissertations, Erudite, number ph18-01 edited by Ferhat Mihoubi, December.
    13. Alice Albonico & Alessia Paccagnini & Patrizio Tirelli, 2019. "Limited Asset Market Participation And The Euro Area Crisis: An Empirical Dsge Model," Economic Inquiry, Western Economic Association International, vol. 57(3), pages 1302-1323, July.
    14. Ryan Banerjee & Nicoletta Batini, 2003. "UK Consumers’ Habits," Discussion Papers 13, Monetary Policy Committee Unit, Bank of England.
    15. Matthias Burgert & Werner Roeger & Janos Varga & Jan in 't Veld & Lukas Vogel, 2020. "A Global Economy Version of QUEST: Simulation Properties," European Economy - Discussion Papers 126, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    16. Andrei Polbin & Sergey Drobyshevsky, 2014. "Developing a Dynamic Stochastic Model of General Equilibrium for the Russian Economy," Research Paper Series, Gaidar Institute for Economic Policy, issue 166P, pages 156-156.
    17. Marco Del Negro & Frank Schorfheide, 2009. "Monetary Policy Analysis with Potentially Misspecified Models," American Economic Review, American Economic Association, vol. 99(4), pages 1415-1450, September.
    18. Campos, Nauro F. & Eichenauer, Vera Z. & Sturm, Jan-Egbert, 2020. "Close encounters of the European kind: Economic integration, sectoral heterogeneity and structural reforms," European Economic Review, Elsevier, vol. 129(C).
    19. Sandra Gomes & Pascal Jacquinot & Matthias Mohr & Massimiliano Pisani, 2013. "Structural Reforms and Macroeconomic Performance in the Euro Area Countries: A Model-Based Assessment," International Finance, Wiley Blackwell, vol. 16(1), pages 23-44, February.
    20. Wieland, Volker & Cwik, Tobias & Müller, Gernot J. & Schmidt, Sebastian & Wolters, Maik, 2012. "A new comparative approach to macroeconomic modeling and policy analysis," Journal of Economic Behavior & Organization, Elsevier, vol. 83(3), pages 523-541.
    21. Ali Choudhary & Paul Levine, 2006. "The 24/7 Society and Multiple Habits," School of Economics Discussion Papers 0506, School of Economics, University of Surrey.

    More about this item

    Keywords

    Euro Area; France; Italy; General equilibrium modeling (CGE); Impact and scenario analysis;
    All these keywords.

    JEL classification:

    • E10 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - General
    • E60 - Macroeconomics and Monetary Economics - - Macroeconomic Policy, Macroeconomic Aspects of Public Finance, and General Outlook - - - General
    • E20 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - General (includes Measurement and Data)

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ekd:008007:8482. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Theresa Leary (email available below). General contact details of provider: https://edirc.repec.org/data/ecomoea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.