IDEAS home Printed from https://ideas.repec.org/p/wpa/wuwpgt/0502048.html
   My bibliography  Save this paper

Reaping Benefits from Management Research: Lessons from the Forecasting Principles Project, with Reply to Commentators

Author

Listed:
  • JS Armstrong

    (The Wharton School)

  • Ruth Pagell

    (Emory University)

Abstract

It is often claimed that managers do not read serious research papers in journals. If true, this neglect would seem to pose a problem because journals are the dominant source of knowledge in management science. By examining results from the forecasting principles project, which was designed to summarize all useful knowledge in forecasting, we found that journals have provided 89 percent of the useful knowledge. However, journal papers relevant to practice are difficult to find because fewer than three percent of papers on forecasting contain useful findings. That turns out to be about one useful paper per month over the last half-century. Once found, the papers are difficult to interpret. Managers need low-cost, easily accessible sources that summarize advice (principles) from research; journals do not meet this need. To increase the rate of progress in developing and communicating principles, researchers, journal editors, textbook writers, software developers, web site designers, and practitioners should make some changes. Some examples: Researchers should directly study forecasting principles. Journal editors should actively solicit papers – invited submissions were about 20 times better than standard submissions at producing useful findings that were often cited, and does so at a lower cost. Web-site and software developers should provide practitioners with low-cost ways to use principles. Practitioners should apply the principles that are currently available.

Suggested Citation

  • JS Armstrong & Ruth Pagell, 2005. "Reaping Benefits from Management Research: Lessons from the Forecasting Principles Project, with Reply to Commentators," General Economics and Teaching 0502048, University Library of Munich, Germany.
  • Handle: RePEc:wpa:wuwpgt:0502048
    Note: Type of Document - pdf; pages: 19
    as

    Download full text from publisher

    File URL: https://econwpa.ub.uni-muenchen.de/econ-wp/get/papers/0502/0502048.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Green, Kesten C., 2002. "Forecasting decisions in conflict situations: a comparison of game theory, role-playing, and unaided judgement," International Journal of Forecasting, Elsevier, vol. 18(3), pages 321-344.
    2. J. Scott Armstrong & Ruth Pagell, 2003. "The Ombudsman: Reaping Benefits from Management Research: Lessons from the Forecasting Principles Project," Interfaces, INFORMS, vol. 33(6), pages 91-111, December.
    3. Lomborg,Bjørn, 2001. "The Skeptical Environmentalist," Cambridge Books, Cambridge University Press, number 9780521010689.
    4. Hubbard, Raymond & Vetter, Daniel E., 1996. "An empirical comparison of published replication research in accounting, economics, finance, management, and marketing," Journal of Business Research, Elsevier, vol. 35(2), pages 153-164, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. JS Armstrong, 2005. "Incentives for Developing and Communicating Principles: A Reply," General Economics and Teaching 0502049, University Library of Munich, Germany.
    2. J. Scott Armstrong & Ruth Pagell, 2003. "The Ombudsman: Reaping Benefits from Management Research: Lessons from the Forecasting Principles Project," Interfaces, INFORMS, vol. 33(6), pages 91-111, December.
    3. Armstrong, J. Scott & Fildes, Robert, 2006. "Making progress in forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 433-441.
    4. Geuens, Maggie, 2011. "Where does business research go from here? Food-for-thought on academic papers in business research," Journal of Business Research, Elsevier, vol. 64(10), pages 1104-1107, October.
    5. Armstrong, J. Scott, 2006. "Findings from evidence-based forecasting: Methods for reducing forecast error," International Journal of Forecasting, Elsevier, vol. 22(3), pages 583-598.
    6. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    7. Jim Butcher, 2006. "The United Nations International Year of Ecotourism: a critical analysis of development implications," Progress in Development Studies, , vol. 6(2), pages 146-156, April.
    8. Rakesh Sambharya & Martina Musteen, 2014. "Institutional environment and entrepreneurship: An empirical study across countries," Journal of International Entrepreneurship, Springer, vol. 12(4), pages 314-330, December.
    9. James A. Brander, 2007. "Viewpoint: Sustainability: Malthus revisited?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 40(1), pages 1-38, February.
    10. Valerie A. Ramey & Neville Francis, 2009. "A Century of Work and Leisure," American Economic Journal: Macroeconomics, American Economic Association, vol. 1(2), pages 189-224, July.
    11. Jennifer Marohasy, 2005. "Australia's Environment Undergoing Renewal, Not Collapse," Energy & Environment, , vol. 16(3-4), pages 457-480, July.
    12. Litsiou, Konstantia & Polychronakis, Yiannis & Karami, Azhdar & Nikolopoulos, Konstantinos, 2022. "Relative performance of judgmental methods for forecasting the success of megaprojects," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1185-1196.
    13. Green, Kesten C., 2005. "Game theory, simulated interaction, and unaided judgement for forecasting decisions in conflicts: Further evidence," International Journal of Forecasting, Elsevier, vol. 21(3), pages 463-472.
    14. Jac C. Heckelman, 2017. "Tullock on the organization of scientific inquiry," Constitutional Political Economy, Springer, vol. 28(1), pages 1-17, March.
    15. Peura, Pekka, 2013. "From Malthus to sustainable energy—Theoretical orientations to reforming the energy sector," Renewable and Sustainable Energy Reviews, Elsevier, vol. 19(C), pages 309-327.
    16. Mohajan, Haradhan, 2011. "Green marketing is a sustainable marketing system in the twenty first century," MPRA Paper 50857, University Library of Munich, Germany, revised 16 Feb 2012.
    17. Hensel, Przemysław G., 2019. "Supporting replication research in management journals: Qualitative analysis of editorials published between 1970 and 2015," European Management Journal, Elsevier, vol. 37(1), pages 45-57.
    18. Rachel Sun & Daniel Shek, 2012. "Positive Youth Development, Life Satisfaction and Problem Behaviour Among Chinese Adolescents in Hong Kong: A Replication," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(3), pages 541-559, February.
    19. Pannell, David J., 2004. "Effectively communicating economics to policy makers," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 48(3), pages 1-21.
    20. Richard Matthew, 2014. "Integrating climate change into peacebuilding," Climatic Change, Springer, vol. 123(1), pages 83-93, March.

    More about this item

    Keywords

    journals; meta-analysis; peer review; principles; software; websites.;
    All these keywords.

    JEL classification:

    • A - General Economics and Teaching

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wpa:wuwpgt:0502048. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: EconWPA (email available below). General contact details of provider: https://econwpa.ub.uni-muenchen.de .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.