IDEAS home Printed from https://ideas.repec.org/a/spr/metrik/v22y2011i1p47-77.html
   My bibliography  Save this article

Institutionalized dualism: statistical significance testing as myth and ceremony

Author

Listed:
  • Marc Orlitzky

Abstract

Several well-known statisticians regard significance testing as a deeply problematic procedure in statistical inference. Yet, in-depth discussion of null hypothesis significance testing (NHST) has largely been absent from the literature on organizations or, more specifically, management control systems. This article attempts to redress this oversight by drawing on neoinstitutional theory to frame, analyze, and explore the NHST problem. Regulative, normative, and cultural-cognitive forces partly explain the longevity of NHST in organization studies. The unintended negative consequences of NHST include a reinforcement of the academic-practitioner divide, an obstacle to the growth of knowledge, discouragement of study replications, and mechanization of researcher decision making. An appreciation of these institutional explanations for NHST as well as the harm caused by NHST may ultimately help researchers develop superior methodological alternatives to a controversial statistical technique. Copyright Springer Verlag 2011

Suggested Citation

  • Marc Orlitzky, 2011. "Institutionalized dualism: statistical significance testing as myth and ceremony," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 22(1), pages 47-77, September.
    • Handle: RePEc:spr:metrik:v:22:y:2011:i:1:p:47-77
    DOI: 10.1007/s00187-011-0126-7
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s00187-011-0126-7
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s00187-011-0126-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fidler, Fiona & Geoff, Cumming & Mark, Burgman & Neil, Thomason, 2004. "Statistical reform in medicine, psychology and ecology," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 33(5), pages 615-630, November.
    2. Gigerenzer, Gerd, 2004. "Mindless statistics," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 33(5), pages 587-606, November.
    3. Thomas C. Powell, 2001. "Competitive advantage: logical and philosophical considerations," Strategic Management Journal, Wiley Blackwell, vol. 22(9), pages 875-888, September.
    4. Ken Crofts & Jayne Bisman, 2010. "Interrogating accountability," Qualitative Research in Accounting & Management, Emerald Group Publishing Limited, vol. 7(2), pages 180-207, June.
    5. Joshua S. Gans & George B. Shepherd, 1994. "How Are the Mighty Fallen: Rejected Classic Articles by Leading Economists," Journal of Economic Perspectives, American Economic Association, vol. 8(1), pages 165-179, Winter.
    6. Kincaid,Harold, 1996. "Philosophical Foundations of the Social Sciences," Cambridge Books, Cambridge University Press, number 9780521482684, January.
    7. Davila, Tony, 2000. "An empirical study on the drivers of management control systems' design in new product development," Accounting, Organizations and Society, Elsevier, vol. 25(4-5), pages 383-409, May.
    8. Leamer, Edward E, 1983. "Let's Take the Con Out of Econometrics," American Economic Review, American Economic Association, vol. 73(1), pages 31-43, March.
    9. Fadi Alkaraan & Deryl Northcott, 2007. "Strategic investment decision making: the influence of pre‐decision control mechanisms," Qualitative Research in Accounting & Management, Emerald Group Publishing Limited, vol. 4(2), pages 133-150, June.
    10. Orlitzky, Marc, 2011. "Institutional Logics in the Study of Organizations: The Social Construction of the Relationship between Corporate Social and Financial Performance," Business Ethics Quarterly, Cambridge University Press, vol. 21(3), pages 409-444, July.
    11. Lynne, Gary D., 1999. "Divided self models of the socioeconomic person: the metaeconomics approach," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 28(3), pages 267-288.
    12. Louis Guttman, 1985. "The illogic of statistical inference for cumulative science," Applied Stochastic Models and Data Analysis, John Wiley & Sons, vol. 1(1), pages 3-9.
    13. Chenhall, Robert H., 2003. "Management control systems design within its organizational context: findings from contingency-based research and directions for the future," Accounting, Organizations and Society, Elsevier, vol. 28(2-3), pages 127-168.
    14. Vern T. Farewell & Brian D.M. Tom & Patrick Royston, 2004. "The Impact of Dichotomization on the Efficiency of Testing for an Interaction Effect in Exponential Family Models," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 822-831, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hensel, Przemysław G., 2021. "Reproducibility and replicability crisis: How management compares to psychology and economics – A systematic review of literature," European Management Journal, Elsevier, vol. 39(5), pages 577-594.
    2. Williams, Ralph I. & Clark, Leigh Anne & Clark, W. Randy & Raffo, Deana M., 2021. "Re-examining systematic literature review in management research: Additional benefits and execution protocols," European Management Journal, Elsevier, vol. 39(4), pages 521-533.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hall, Matthew, 2008. "The effect of comprehensive performance measurement systems on role clarity, psychological empowerment and managerial performance," Accounting, Organizations and Society, Elsevier, vol. 33(2-3), pages 141-163.
    2. Cuguero, Natalia & Rosanas, Josep M., 2011. "The next generation of management control systems: Justice and fairness as antecedents for goal congruence," IESE Research Papers D/917, IESE Business School.
    3. repec:wsi:acsxxx:v:21:y:2019:i:08:n:s1363919619500117 is not listed on IDEAS
    4. Andrea Fried, 2017. "Terminological distinctions of ‘control’: a review of the implications for management control research in the context of innovation," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 28(1), pages 5-40, February.
    5. Cuguero-Escofet, Natalia & Rosanas, Josep M., 2012. "The just design and use of management control systems as requirements for goal congruence," IESE Research Papers D/949, IESE Business School.
    6. Ossi Pesämaa, 2017. "Personnel- and action control in gazelle companies in Sweden," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 28(1), pages 107-132, February.
    7. Gopalakrishnan, Mohan & Libby, Theresa & Samuels, Janet A. & Swenson, Dan, 2015. "The effect of cost goal specificity and new product development process on cost reduction performance," Accounting, Organizations and Society, Elsevier, vol. 42(C), pages 1-11.
    8. Huikku, Jari & Karjalainen, Jouko & Seppälä, Tomi, 2018. "The dynamism of pre-decision controls in the appraisal of strategic investments," The British Accounting Review, Elsevier, vol. 50(5), pages 516-538.
    9. Müller-Stewens, Benedikt & Widener, Sally K. & Möller, Klaus & Steinmann, Jan-Christoph, 2020. "The role of diagnostic and interactive control uses in innovation," Accounting, Organizations and Society, Elsevier, vol. 80(C).
    10. Gomez-Conde, Jacobo & Lopez-Valeiras, Ernesto & Ripoll-Feliú, Vicente M. & Gonzalez-Sanchez, María Beatriz, 2013. "El efecto mediador y moderador de la internacionalización en la relación entre los sistemas de control de gestión y el compromiso con la innovación," Revista de Contabilidad - Spanish Accounting Review, Elsevier, vol. 16(1), pages 53-65.
    11. Henri, Jean-Francois, 2006. "Management control systems and strategy: A resource-based perspective," Accounting, Organizations and Society, Elsevier, vol. 31(6), pages 529-558, August.
    12. Kaveh Asiaei & Nick Bontis & Omid Barani & Ruzita Jusoh, 2021. "Corporate social responsibility and sustainability performance measurement systems: implications for organizational performance," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 32(1), pages 85-126, March.
    13. Cooper, Christine, 2015. "Entrepreneurs of the self: The development of management control since 1976," Accounting, Organizations and Society, Elsevier, vol. 47(C), pages 14-24.
    14. Charles Kabwigiri & Didier van Caillie, 2007. "Le Design Des Systèmes De Contrôle De Gestion Adoptés Au Sein Des Spinoffs Académiques De Haute Technologie : Le Rôle De L'Incertitude Perçue Par Les Managers," Post-Print halshs-00543204, HAL.
    15. Chan, Kam C. & Chang, Chih-Hsiang & Chang, Yuanchen, 2015. "The network effects of publishing in finance," The North American Journal of Economics and Finance, Elsevier, vol. 33(C), pages 305-316.
    16. Paolo Perego & Frank Hartmann, 2009. "Aligning Performance Measurement Systems With Strategy: The Case of Environmental Strategy," Abacus, Accounting Foundation, University of Sydney, vol. 45(4), pages 397-428, December.
    17. Ditillo, Angelo, 2004. "Dealing with uncertainty in knowledge-intensive firms: the role of management control systems as knowledge integration mechanisms," Accounting, Organizations and Society, Elsevier, vol. 29(3-4), pages 401-421.
    18. Mundy, Julia, 2010. "Creating dynamic tensions through a balanced use of management control systems," Accounting, Organizations and Society, Elsevier, vol. 35(5), pages 499-523, July.
    19. Cadez, Simon & Guilding, Chris, 2008. "An exploratory investigation of an integrated contingency model of strategic management accounting," Accounting, Organizations and Society, Elsevier, vol. 33(7-8), pages 836-863.
    20. Nikolaos Theriou & Vassilis Aggelidis, 2014. "Management Accounting Systems, Top Management Team’s Risk Characteristics and Their Effect on Strategic Change," International Journal of Economics & Business Administration (IJEBA), International Journal of Economics & Business Administration (IJEBA), vol. 0(2), pages 3-38.
    21. Songini, Lucrezia & Gnan, Luca & Malmi, Teemu, 2013. "The role and impact of accounting in family business," Journal of Family Business Strategy, Elsevier, vol. 4(2), pages 71-83.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:metrik:v:22:y:2011:i:1:p:47-77. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.