IDEAS home Printed from https://ideas.repec.org/p/wpa/wuwpgt/0502051.html
   My bibliography  Save this paper

Replications and Extensions in Marketing – Rarely Published But Quite Contrary

Author

Listed:
  • Raymond Hubbard

    (Drake University)

  • JS Armstrong

    (The Wharton School)

Abstract

Replication is rare in marketing. Of 1,120 papers sampled from three major marketing journals, none were replications. Only 1.8% of the papers were extensions, and they consumed 1.1% of the journal space. On average, these extensions appeared seven years after the original study. The publication rate for such works has been decreasing since the 1970s. Published extensions typically produced results that conflicted with the original studies; of the 20 extensions published, 12 conflicted with the earlier results, and only 3 provided full confirmation. Published replications do not attract as many citations after publication as do the original studies, even when the results fail to support the original studies.

Suggested Citation

  • Raymond Hubbard & JS Armstrong, 2005. "Replications and Extensions in Marketing – Rarely Published But Quite Contrary," General Economics and Teaching 0502051, University Library of Munich, Germany.
    • Handle: RePEc:wpa:wuwpgt:0502051
    Note: Type of Document - pdf; pages: 22
    as

    Download full text from publisher

    File URL: https://econwpa.ub.uni-muenchen.de/econ-wp/get/papers/0502/0502051.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Raymond Hubbard & JS Armstrong, 2005. "Are Null Results Becoming an Endangered Species in Marketing?," General Economics and Teaching 0502038, University Library of Munich, Germany.
    2. McGrath, Joseph E & Brinberg, David, 1983. "External Validity and the Research Process: A Comment on the Calder-Lynch Dialogue," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 10(1), pages 115-124, June.
    3. Feige, Edgar L, 1975. "The Consequences of Journal Editorial Policies and a Suggestion for Revision," Journal of Political Economy, University of Chicago Press, vol. 83(6), pages 1291-1295, December.
    4. Dewald, William G & Thursby, Jerry G & Anderson, Richard G, 1986. "Replication in Empirical Economics: The Journal of Money, Credit and Banking Project," American Economic Review, American Economic Association, vol. 76(4), pages 587-603, September.
    5. Mayer, Thomas, 1980. "Economics as a Hard Science: Realistic Goal or Wishful Thinking?," Economic Inquiry, Western Economic Association International, vol. 18(2), pages 165-178, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ian Phau & Garick Kea, 2007. "Attitudes of University Students toward Business Ethics: A Cross-National Investigation of Australia, Singapore and Hong Kong," Journal of Business Ethics, Springer, vol. 72(1), pages 61-75, April.
    2. JS Armstrong & Roderick J. Brodie & Andrew G. Parsons, 2004. "Hypotheses in Marketing Science: Literature Review and Publication Audit," General Economics and Teaching 0412013, University Library of Munich, Germany.
    3. Raymond Hubbard & JS Armstrong, 2005. "Publication Bias Against Null Results," General Economics and Teaching 0502034, University Library of Munich, Germany.
    4. JS Armstrong, 2005. "Quality Control Versus Innovation in Research on Marketing," General Economics and Teaching 0502050, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Steven Caudill, 1990. "Econometrics in Theory and Practice," Eastern Economic Journal, Eastern Economic Association, vol. 16(3), pages 249-256, Jul-Sep.
    2. Raymond Hubbard & Daniel E. Vetter, 1992. "The Publication Incidence of Replications and Critical Commentary in Economics," The American Economist, Sage Publications, vol. 36(1), pages 29-34, March.
    3. Maren Duvendack & Richard W. Palmer-Jones & W. Robert Reed, 2014. "Replications in Economics: A Progress Report," Working Papers in Economics 14/26, University of Canterbury, Department of Economics and Finance.
    4. Hubbard, Raymond & Vetter, Daniel E., 1996. "An empirical comparison of published replication research in accounting, economics, finance, management, and marketing," Journal of Business Research, Elsevier, vol. 35(2), pages 153-164, February.
    5. repec:ejw:journl:v:9:y:2012:i:3:p:256-297 is not listed on IDEAS
    6. repec:ejw:journl:v:12:y:2015:i:2:p:164-191 is not listed on IDEAS
    7. R. Murray Lindsay, 1994. "Publication System Biases Associated with the Statistical Testing Paradigm," Contemporary Accounting Research, John Wiley & Sons, vol. 11(1), pages 33-57, June.
    8. Klos, Alexander & Rottke, Simon, 2013. "Saving and Consumption When Children Move Out," VfS Annual Conference 2013 (Duesseldorf): Competition Policy and Regulation in a Global Economic Order 79786, Verein für Socialpolitik / German Economic Association.
    9. Hussinger, Katrin & Pellens, Maikel, 2019. "Guilt by association: How scientific misconduct harms prior collaborators," Research Policy, Elsevier, vol. 48(2), pages 516-530.
    10. Mueller-Langer, Frank & Andreoli-Versbach, Patrick, 2018. "Open access to research data: Strategic delay and the ambiguous welfare effects of mandatory data disclosure," Information Economics and Policy, Elsevier, vol. 42(C), pages 20-34.
    11. Robert A. Moffitt, 2011. "Report of the Editor: American Economic Review (with Appendix by Philip J. Glandon)," American Economic Review, American Economic Association, vol. 101(3), pages 684-693, May.
    12. Ferman, Bruno & Finamor, Lucas, 2025. "There must be an error here! Experimental evidence on coding errors' biases," I4R Discussion Paper Series 266, The Institute for Replication (I4R).
    13. Hensel, Przemysław G., 2019. "Supporting replication research in management journals: Qualitative analysis of editorials published between 1970 and 2015," European Management Journal, Elsevier, vol. 37(1), pages 45-57.
    14. Bruns, Stephan B. & König, Johannes & Stern, David I., 2019. "Replication and robustness analysis of ‘energy and economic growth in the USA: A multivariate approach’," Energy Economics, Elsevier, vol. 82(C), pages 100-113.
    15. Roger Backhouse & Beatrice Cherrier, 2014. "Becoming Applied: The Transformation of Economics after 1970," Discussion Papers 14-11, Department of Economics, University of Birmingham.
    16. John Duffy, 1998. "Monetary theory in the laboratory," Review, Federal Reserve Bank of St. Louis, issue Sep, pages 9-26.
    17. Benedikt Fecher & Sascha Friesike & Marcel Hebing, 2014. "What Drives Academic Data Sharing?," SOEPpapers on Multidisciplinary Panel Data Research 655, DIW Berlin, The German Socio-Economic Panel (SOEP).
    18. Morten Søberg, 2002. "The Duhem-Quine thesis and experimental economics. A reinterpretation," Discussion Papers 329, Statistics Norway, Research Department.
    19. Bas Bosma & Ellen Loots & Paul Stroet & Arjen Witteloostuijn, 2025. "Passionately or reluctantly independent? Artistic and non-artistic self-employment compared," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 49(3), pages 515-545, September.
    20. Diekmann Andreas, 2011. "Are Most Published Research Findings False?," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 231(5-6), pages 628-635, October.
    21. William L. Goffe & Bob Parks, 1996. "The Future Information Structure in Economics," Microeconomics 9605001, University Library of Munich, Germany, revised 02 Dec 1996.
    22. Kevin D. Hoover & Stephen J. Perez, 1999. "Data mining reconsidered: encompassing and the general-to-specific approach to specification search," Econometrics Journal, Royal Economic Society, vol. 2(2), pages 167-191.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • A - General Economics and Teaching

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wpa:wuwpgt:0502051. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: EconWPA The email address of this maintainer does not seem to be valid anymore. Please ask EconWPA to update the entry or send us the correct address (email available below). General contact details of provider: https://econwpa.ub.uni-muenchen.de .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.