IDEAS home Printed from https://ideas.repec.org/a/spr/binfse/v65y2023i2d10.1007_s12599-022-00782-8.html
   My bibliography  Save this article

Self-reporting Limitations in Information Systems Design Science Research

Author

Listed:
  • João Barata

    (University of Coimbra)

  • Paulo Rupino Cunha

    (University of Coimbra)

  • António Dias Figueiredo

    (University of Coimbra)

Abstract

Besides increasing transparency and demonstrating awareness of the author, self-reported limitations enable other researchers to effectively learn from, build on, validate, and extend the original work. However, this topic is understudied in information systems design science research (IS DSR). The study has assessed 243 IS DSR papers published in the period 2013–2022 and built a typology of the 19 most relevant limitations, organized into four categories: (1) Input Knowledge and Technology, (2) Research Process, (3) Resulting Artifact, and (4) Design Knowledge. Further, the contribution suggests actions to mitigate each type of limitation throughout the entire IS DSR project lifecycle. The authors have also created guidelines to report the limitations in a useful way for knowledge accumulation. The proposed typology and guidelines enable reviewers and editors to better frame self-reported limitations, assess rigor and relevance more systematically, and provide more precise feedback. Moreover, the contribution may help design researchers identify, mitigate, and effectively communicate the uncertainties inherent to all scientific advances.

Suggested Citation

  • João Barata & Paulo Rupino Cunha & António Dias Figueiredo, 2023. "Self-reporting Limitations in Information Systems Design Science Research," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 65(2), pages 143-160, April.
    • Handle: RePEc:spr:binfse:v:65:y:2023:i:2:d:10.1007_s12599-022-00782-8
    DOI: 10.1007/s12599-022-00782-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s12599-022-00782-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s12599-022-00782-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Tanguy Coenen & Liesje Coertjens & Peter Vlerick & Marije Lesterhuis & Anneleen Viona Mortier & Vincent Donche & Pieter Ballon & Sven De Maeyer & Ken Peffers & Tuure Tuunanen & Bjoern Niehaves, 2018. "An information system design theory for the comparative judgement of competences," European Journal of Information Systems, Taylor & Francis Journals, vol. 27(2), pages 248-261, March.
    2. Paul Gray & Anat Hovav, 2014. "Using scenarios to understand the frontiers of IS," Information Systems Frontiers, Springer, vol. 16(3), pages 337-345, July.
    3. Anat Hovav, 2014. "Using scenarios to understand the frontiers of IS: Fifteen years later (a postscript)," Information Systems Frontiers, Springer, vol. 16(3), pages 347-352, July.
    4. Herbert A. Simon, 1996. "The Sciences of the Artificial, 3rd Edition," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262691914, December.
    5. Gerard De Leoz & Stacie Petter & Ken Peffers & Tuure Tuunanen & Bjoern Niehaves, 2018. "Considering the social impacts of artefacts in information systems design science research," European Journal of Information Systems, Taylor & Francis Journals, vol. 27(2), pages 154-170, March.
    6. Stéphane Brutus & Herman Aguinis & Ulrich Wassmer, 2013. "Self-Reported Limitations and Future Directions in Scholarly Reports : Analysis and Recommendations," Post-Print hal-02313051, HAL.
    7. Elaine M Beller & Paul P Glasziou & Douglas G Altman & Sally Hopewell & Hilda Bastian & Iain Chalmers & Peter C Gøtzsche & Toby Lasserson & David Tovey & for the PRISMA for Abstracts Group, 2013. "PRISMA for Abstracts: Reporting Systematic Reviews in Journal and Conference Abstracts," PLOS Medicine, Public Library of Science, vol. 10(4), pages 1-8, April.
    8. Soroosh Nalchigar & Eric Yu, 2020. "Designing Business Analytics Solutions," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 62(1), pages 61-75, February.
    9. Aguinis, Herman & Lawal, Sola O., 2012. "Conducting field experiments using eLancing's natural environment," Journal of Business Venturing, Elsevier, vol. 27(4), pages 493-505.
    10. John Venable & Jan Pries-Heje & Richard Baskerville, 2016. "FEDS: a Framework for Evaluation in Design Science Research," European Journal of Information Systems, Taylor & Francis Journals, vol. 25(1), pages 77-89, January.
    11. Ersin Dincelli & InduShobha Chengalur-Smith, 2020. "Choose your own training adventure: designing a gamified SETA artefact for improving information security and privacy through interactive storytelling," European Journal of Information Systems, Taylor & Francis Journals, vol. 29(6), pages 669-687, November.
    12. Herman Aguinis & Ravi S Ramani & Wayne F Cascio, 2020. "Methodological practices in international business research: An after-action review of challenges and solutions," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 51(9), pages 1593-1608, December.
    13. Alexander Linhart & Maximilian Röglinger & Katharina Stelzl, 2020. "A Project Portfolio Management Approach to Tackling the Exploration/Exploitation Trade-off," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 62(2), pages 103-119, April.
    14. Herman Aguinis & Angelo M. Solarino, 2019. "Transparency and replicability in qualitative research: The case of interviews with elite informants," Strategic Management Journal, Wiley Blackwell, vol. 40(8), pages 1291-1315, August.
    15. Frantz Rowe & Sebastian Olbrich & Ulrich Frank & Shirley Gregor & Fred Niederman, 2017. "On the Merits and Limits of Replication and Negation for IS Research," Post-Print hal-03701576, HAL.
    16. Samir Chatterjee & Jongbok Byun & Kaushik Dutta & Rasmus Ulslev Pedersen & Akshay Pottathil & Harry (Qi) Xie, 2018. "Designing an Internet-of-Things (IoT) and sensor-based in-home monitoring system for assisting diabetes patients: iterative learning from two case studies," European Journal of Information Systems, Taylor & Francis Journals, vol. 27(6), pages 670-685, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hendrik Haße & Hendrik Valk & Frederik Möller & Boris Otto, 2022. "Design Principles for Shared Digital Twins in Distributed Systems," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 64(6), pages 751-772, December.
    2. Herman Aguinis & Donald Bergh & José F. Molina-Azorin, 2023. "Methodological challenges and insights for future international business research," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 54(2), pages 219-232, March.
    3. Manoj A. Thomas & Yan Li & Allen S. Lee, 2022. "Generalizing the Information Systems Artifact," Information Systems Research, INFORMS, vol. 33(4), pages 1452-1466, December.
    4. Lorraine Eden & Bo Bernhard Nielsen, 2020. "Research methods in international business: The challenge of complexity," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 51(9), pages 1609-1620, December.
    5. Paul M. Gangi & Allen C. Johnston & James L. Worrell & Samuel C. Thompson, 2018. "What could possibly go wrong? A multi-panel Delphi study of organizational social media risk," Information Systems Frontiers, Springer, vol. 20(5), pages 1097-1116, October.
    6. Herman Aguinis & Ravi S Ramani & Wayne F Cascio, 2020. "Methodological practices in international business research: An after-action review of challenges and solutions," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 51(9), pages 1593-1608, December.
    7. Tobias Knabke & Sebastian Olbrich, 2018. "Building novel capabilities to enable business intelligence agility: results from a quantitative study," Information Systems and e-Business Management, Springer, vol. 16(3), pages 493-546, August.
    8. Sunder Shyam, 2011. "Imagined Worlds of Accounting," Accounting, Economics, and Law: A Convivium, De Gruyter, vol. 1(1), pages 1-14, January.
    9. McCown, R. L., 2002. "Changing systems for supporting farmers' decisions: problems, paradigms, and prospects," Agricultural Systems, Elsevier, vol. 74(1), pages 179-220, October.
    10. Hsu, Dan K. & Burmeister-Lamp, Katrin & Simmons, Sharon A. & Foo, Maw-Der & Hong, Michelle C. & Pipes, Jesse D., 2019. "“I know I can, but I don't fit”: Perceived fit, self-efficacy, and entrepreneurial intention," Journal of Business Venturing, Elsevier, vol. 34(2), pages 311-326.
    11. Basile, Luigi Jesus & Carbonara, Nunzia & Pellegrino, Roberta & Panniello, Umberto, 2023. "Business intelligence in the healthcare industry: The utilization of a data-driven approach to support clinical decision making," Technovation, Elsevier, vol. 120(C).
    12. Loris Gaio, 2005. "A diversity-based approach to requirements tracing in new product development," ROCK Working Papers 031, Department of Computer and Management Sciences, University of Trento, Italy, revised 13 Jun 2008.
    13. B. A. Huberman & N. S. Glance, "undated". "Diversity and Collective Action," Working Papers _001, Xerox Research Park.
    14. Zhewei Zhang & Youngjin Yoo & Kalle Lyytinen & Aron Lindberg, 2021. "The Unknowability of Autonomous Tools and the Liminal Experience of Their Use," Information Systems Research, INFORMS, vol. 32(4), pages 1192-1213, December.
    15. Giuseppe La Torre & Remigio Bova & Rosario Andrea Cocchiara & Cristina Sestili & Anna Tagliaferri & Simona Maggiacomo & Camilla Foschi & William Zomparelli & Maria Vittoria Manai & David Shaholli & Va, 2023. "What Are the Determinants of the Quality of Systematic Reviews in the International Journals of Occupational Medicine? A Methodological Study Review of Published Literature," IJERPH, MDPI, vol. 20(2), pages 1-12, January.
    16. Raffaele Fabio Ciriello & Alexandra Cecilie Gjøl Torbensen & Magnus Rotvit Perlt Hansen & Christoph Müller-Bloch, 2023. "Blockchain-based digital rights management systems: Design principles for the music industry," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-21, December.
    17. David Stadelmann & Benno Torgler, 2012. "Bounded Rationality and Voting Decisions Exploring a 160-Year Period," Working Papers 2012.70, Fondazione Eni Enrico Mattei.
    18. Francis Marleau Donais & Irène Abi-Zeid & E. Owen D. Waygood & Roxane Lavoie, 2021. "A Framework for Post-Project Evaluation of Multicriteria Decision Aiding Processes from the Stakeholders’ Perspective: Design and Application," Group Decision and Negotiation, Springer, vol. 30(5), pages 1161-1191, October.
    19. H. Christopher Frey & Sumeet R. Patil, 2002. "Identification and Review of Sensitivity Analysis Methods," Risk Analysis, John Wiley & Sons, vol. 22(3), pages 553-578, June.
    20. Marie-Laure Salles-Djelic & Michel Gutsatz, 2000. "Managerial Competencies for Organizational Flexibility: The Luxury Goods Industry between Tradition and Postmodernism," Post-Print hal-01892018, HAL.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:binfse:v:65:y:2023:i:2:d:10.1007_s12599-022-00782-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.