IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/4149.html
   My bibliography  Save this paper

Verification of Citations: Fawlty Towers of Knowledge?

Author

Listed:
  • Wright, Malcolm
  • Armstrong, J. Scott

Abstract

The prevalence of faulty citations impedes the growth of scientific knowledge. Faulty citations include omissions of relevant papers, incorrect references, and quotation errors that misreport findings. We discuss key studies in these areas. We then examine citations to Estimating nonresponse bias in mail surveys, one of the most frequently cited papers from the Journal of Marketing Research, as an exploratory study to illustrate these issues. This paper is especially useful in testing for quotation errors because it provides specific operational recommendations on adjusting for nonresponse bias; therefore, it allows us to determine whether the citing papers properly used the findings. By any number of measures, those doing survey research fail to cite this paper and, presumably, make inadequate adjustments for nonresponse bias. Furthermore, even when the paper was cited, 49 of the 50 studies that we examined reported its findings improperly. The inappropriate use of statistical-significance testing led researchers to conclude that nonresponse bias was not present in 76 percent of the studies in our sample. Only one of the studies in the sample made any adjustment for it. Judging from the original paper, we estimate that the study researchers should have predicted nonresponse bias and adjusted for 148 variables. In this case, the faulty citations seem to have arisen either because the authors did not read the original paper or because they did not fully understand its implications. To address the problem of omissions, we recommend that journals include a section on their websites to list all relevant papers that have been overlooked and show how the omitted paper relates to the published paper. In general, authors should routinely verify the accuracy of their sources by reading the cited papers. For substantive findings, they should attempt to contact the authors for confirmation or clarification of the results and methods. This would also provide them with the opportunity to enquire about other relevant references. Journal editors should require that authors sign statements that they have read the cited papers and, when appropriate, have attempted to verify the citations.

Suggested Citation

  • Wright, Malcolm & Armstrong, J. Scott, 2007. "Verification of Citations: Fawlty Towers of Knowledge?," MPRA Paper 4149, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:4149
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/4149/1/MPRA_paper_4149.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Armstrong, J. Scott, 2007. "Significance tests harm progress in forecasting," International Journal of Forecasting, Elsevier, vol. 23(2), pages 321-327.
    2. Armstrong, J. Scott & Overton, Terry S., 1977. "Estimating Nonresponse Bias in Mail Surveys," MPRA Paper 81694, University Library of Munich, Germany.
    3. Eichorn, P. & Yankauer, A., 1987. "Do authors check their references? A survey of accuracy of references in three public health journals," American Journal of Public Health, American Public Health Association, vol. 77(8), pages 1011-1012.
    4. Robert N. Horn, 1988. "Analysis," Challenge, Taylor & Francis Journals, vol. 31(4), pages 56-58, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jeong-Yoo Kim & Insik Min & Christian Zimmermann, 2011. "The Economics of Citation," Korean Economic Review, Korean Economic Association, vol. 27, pages 93-114.
    2. Matthias Ehrgott & Felix Reimann & Lutz Kaufmann & Craig Carter, 2011. "Social Sustainability in Selecting Emerging Economy Suppliers," Journal of Business Ethics, Springer, vol. 98(1), pages 99-119, January.
    3. Armstrong, J. Scott, 2007. "Significance tests harm progress in forecasting," International Journal of Forecasting, Elsevier, vol. 23(2), pages 321-327.
    4. D. R. Amancio & M. G. V. Nunes & O. N. Oliveira & L. F. Costa, 2012. "Using complex networks concepts to assess approaches for citations in scientific papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(3), pages 827-842, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Malcolm Wright & J. Scott Armstrong, 2008. "The Ombudsman: Verification of Citations: Fawlty Towers of Knowledge?," Interfaces, INFORMS, vol. 38(2), pages 125-139, April.
    2. Yoon, Junghyun & Lee, Hee Yong & Dinwoodie, John, 2015. "Competitiveness of container terminal operating companies in South Korea and the industry–university–government network," Transportation Research Part A: Policy and Practice, Elsevier, vol. 80(C), pages 1-14.
    3. Sousa, Carlos M.P. & Bradley, Frank, 2008. "Antecedents of international pricing adaptation and export performance," Journal of World Business, Elsevier, vol. 43(3), pages 307-320, July.
    4. Son K. Lam & Thomas E. DeCarlo & Ashish Sharma, 2019. "Salesperson ambidexterity in customer engagement: do customer base characteristics matter?," Journal of the Academy of Marketing Science, Springer, vol. 47(4), pages 659-680, July.
    5. Van Wijk, Raymond & Nadolska, Anna, 2020. "Making more of alliance portfolios: The role of alliance portfolio coordination," European Management Journal, Elsevier, vol. 38(3), pages 388-399.
    6. Jarle Aarstad & Olav Andreas Kvitastein & Stig-Erik Jakobsen, 2019. "What Drives Enterprise Product Innovation? Assessing How Regional, National, And International Inter-Firm Collaboration Complement Or Substitute For R&D Investments," International Journal of Innovation Management (ijim), World Scientific Publishing Co. Pte. Ltd., vol. 23(05), pages 1-25, June.
    7. Aziz Barhmi & Omar Hajaji, 2023. "Multidisciplinary Approach to Supply Chain Resilience: Conceptualization and Scale Development," Central European Business Review, Prague University of Economics and Business, vol. 2023(5), pages 43-69.
    8. Franck Brulhart & Sandrine Gherra & Bertrand V. Quelin, 2019. "Do Stakeholder Orientation and Environmental Proactivity Impact Firm Profitability?," Journal of Business Ethics, Springer, vol. 158(1), pages 25-46, August.
    9. Chin-Shan Lu & Kuo-Chung Shang & Chi-Chang Lin, 2016. "Examining sustainability performance at ports: port managers’ perspectives on developing sustainable supply chains," Maritime Policy & Management, Taylor & Francis Journals, vol. 43(8), pages 909-927, November.
    10. Van Gils, Anita & Huybrechts, Jolien & Minola, Tommaso & Cassia, Lucio, 2019. "Unraveling the impact of family antecedents on family firm image: A serial multiple-mediation model," Journal of Family Business Strategy, Elsevier, vol. 10(1), pages 17-27.
    11. Mei, Maggie Qiuzhu & Wang, Le & Yan, Jie, 2023. "Maintaining product quality consistency when offshoring to emerging markets: The role of subsidiary control," Journal of International Management, Elsevier, vol. 29(1).
    12. Thomas, Rhodri & Wood, Emma, 2015. "The absorptive capacity of tourism organisations," Annals of Tourism Research, Elsevier, vol. 54(C), pages 84-99.
    13. Dominik M. Wielgos & Christian Homburg & Christina Kuehnl, 2021. "Digital business capability: its impact on firm and customer performance," Journal of the Academy of Marketing Science, Springer, vol. 49(4), pages 762-789, July.
    14. Schneider, Christian O. & Bremen, Philipp & Schönsleben, Paul & Alard, Robert, 2013. "Transaction cost economics in global sourcing: Assessing regional differences and implications for performance," International Journal of Production Economics, Elsevier, vol. 141(1), pages 243-254.
    15. Chih-Ting Shih & Cheng-Chen Lin, 2014. "From good friends to good soldiers: A psychological contract perspective," Asia Pacific Journal of Management, Springer, vol. 31(1), pages 309-326, March.
    16. Sikandar Ali Qalati & Dragana Ostic & Gu Shuibin & Fan Mingyue, 2022. "A mediated–moderated model for social media adoption and small and medium‐sized enterprise performance in emerging countries," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 43(3), pages 846-861, April.
    17. Wang, Daojuan & Hain, Daniel S. & Larimo, Jorma & Dao, Li T., 2020. "Cultural differences and synergy realization in cross-border acquisitions," International Business Review, Elsevier, vol. 29(3).
    18. Prajogo, Daniel & Toy, Jordan & Bhattacharya, Ananya & Oke, Adegoke & Cheng, T.C.E., 2018. "The relationships between information management, process management and operational performance: Internal and external contexts," International Journal of Production Economics, Elsevier, vol. 199(C), pages 95-103.
    19. Charlene L. Al-Qallaf, 2003. "Citation patterns in the Kuwaiti journal Medical Principles and Practice: The first 12 years, 1989-2000," Scientometrics, Springer;Akadémiai Kiadó, vol. 56(3), pages 369-382, March.
    20. García, V.J. & Gómez-Déniz, E. & Vázquez-Polo, F.J., 2010. "A new skew generalization of the normal distribution: Properties and applications," Computational Statistics & Data Analysis, Elsevier, vol. 54(8), pages 2021-2034, August.

    More about this item

    Keywords

    citation errors; evidence-based research; nonresponse bias; quotation errors; surveys;
    All these keywords.

    JEL classification:

    • Y8 - Miscellaneous Categories - - Related Disciplines
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • B4 - Schools of Economic Thought and Methodology - - Economic Methodology

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:4149. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.