IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v36y2011i6p699-719.html
   My bibliography  Save this article

Solutions for Determining the Significance Region Using the Johnson-Neyman Type Procedure in Generalized Linear (Mixed) Models

Author

Listed:
  • Ann A. Lazar

    (University of California, San Francisco)

  • Gary O. Zerbe

    (University of Colorado, Denver)

Abstract

Researchers often compare the relationship between an outcome and covariate for two or more groups by evaluating whether the fitted regression curves differ significantly. When they do, researchers need to determine the “significance region,†or the values of the covariate where the curves significantly differ. In analysis of covariance (ANCOVA), the Johnson-Neyman procedure can be used to determine the significance region; for the hierarchical linear model (HLM), the Miyazaki and Maier (M-M) procedure has been suggested. However, neither procedure can assume nonnormally distributed data. Furthermore, the M-M procedure produces biased (downward) results because it uses the Wald test, does not control the inflated Type I error rate due to multiple testing, and requires implementing multiple software packages to determine the significance region. In this article, we address these limitations by proposing solutions for determining the significance region suitable for generalized linear (mixed) model (GLM or GLMM). These proposed solutions incorporate test statistics that resolve the biased results, control the Type I error rate using Scheffé’s method, and uses a single statistical software package to determine the significance region.

Suggested Citation

  • Ann A. Lazar & Gary O. Zerbe, 2011. "Solutions for Determining the Significance Region Using the Johnson-Neyman Type Procedure in Generalized Linear (Mixed) Models," Journal of Educational and Behavioral Statistics, , vol. 36(6), pages 699-719, December.
    • Handle: RePEc:sae:jedbes:v:36:y:2011:i:6:p:699-719
    DOI: 10.3102/1076998610396889
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998610396889
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998610396889?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Richard Potthoff, 1964. "On the Johnson-Neyman technique and some extensions thereof," Psychometrika, Springer;The Psychometric Society, vol. 29(3), pages 241-256, September.
    2. Palmer Johnson & Leo Fay, 1950. "The Johnson-Neyman technique, its theory and application," Psychometrika, Springer;The Psychometric Society, vol. 15(4), pages 349-367, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Frank Germann & Gary L. Lilien & Christine Moorman & Lars Fiedler & Till Groβmaβ, 2020. "Driving Customer Analytics From the Top," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 7(3), pages 43-61, October.
    2. Dixon, Darcie & Mikolon, Sven, 2021. "Cents of self: How and when self-signals influence consumer value derived from choices of green products," International Journal of Research in Marketing, Elsevier, vol. 38(2), pages 365-386.
    3. Chen, Jeng-Chung & Yu, Vincent F., 2018. "Relationship between human error intervention strategies and unsafe acts: The role of strategy implementability," Journal of Air Transport Management, Elsevier, vol. 69(C), pages 112-122.
    4. Jorge Hernández-Pérez & Salvador Cruz Rambaud & Tomás Lorenzana de la Varga, 2019. "Economic situation, the key to understanding the links between CEOs’ personal traits and the financial structure of large private companies," PLOS ONE, Public Library of Science, vol. 14(7), pages 1-15, July.
    5. Hendrik Slabbinck & Arjen van Witteloostuijn & Julie Hermans & Johanna Vanderstraeten & Marcus Dejardin & Jacqueline Brassey & Dendi Ramdani, 2018. "The added value of implicit motives for management research Development and first validation of a Brief Implicit Association Test (BIAT) for the measurement of implicit motives," PLOS ONE, Public Library of Science, vol. 13(6), pages 1-29, June.
    6. Raghuveer Negi & Amit Kumar Gupta & Vidhu Gaur, 2023. "Effect of green marketing orientation dimensions on green innovation and organizational performance: A mediation‐moderation analysis," Business Strategy and the Environment, Wiley Blackwell, vol. 32(8), pages 5435-5458, December.
    7. Jingjing Zhu & Xiaoying Xia & Qianqian Wu & Shiyao Zou & Yan Li, 2023. "Callous-Unemotional Traits and Social Adjustment among Chinese Preschoolers: The Moderating Role of Teacher-Child Relationship," IJERPH, MDPI, vol. 20(4), pages 1-15, February.
    8. Stefano De Dominicis & Rebecca Sokoloski & Christine M. Jaeger & P. Wesley Schultz, 2019. "Making the smart meter social promotes long-term energy conservation," Palgrave Communications, Palgrave Macmillan, vol. 5(1), pages 1-8, December.
    9. Sanyu Zhou, 2018. "An exact method for the multiple comparison of several polynomial regression models with applications in dose-response study," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(3), pages 413-429, July.
    10. Peter M. Fischer & Katharina P. Zeugner-Roth, 2017. "Disentangling country-of-origin effects: the interplay of product ethnicity, national identity, and consumer ethnocentrism," Marketing Letters, Springer, vol. 28(2), pages 189-204, June.
    11. Katarzyna Prochwicz & Rachela Antosz-Rekucka & Alina Kałużna-Wielobób & Dominika Sznajder & Joanna Kłosowska, 2022. "Negative Affectivity Moderates the Relationship between Attentional Control and Focused Skin Picking," IJERPH, MDPI, vol. 19(11), pages 1-12, May.
    12. Olsen, Jesse E. & Gahan, Peter & Adamovic, Mladen & Choi, Daejeong & Harley, Bill & Healy, Joshua & Theilacker, Max, 2022. "When the Minority Rules: Leveraging Difference While Facilitating Congruence for Cultural Minority Senior Leaders," Journal of International Management, Elsevier, vol. 28(2).
    13. Ashley V Whillans & Elizabeth W Dunn, 2018. "Agentic appeals increase charitable giving in an affluent sample of donors," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-10, December.
    14. Wim Linden, 1981. "Using aptitude measurements for the optimal assignment of subjects to treatments with and without mastery scores," Psychometrika, Springer;The Psychometric Society, vol. 46(3), pages 257-274, September.
    15. Meredith A. Shafto & Lori E. James & Lise Abrams & Lorraine K. Tyler & Cam-CAN, 2017. "Age-Related Increases in Verbal Knowledge Are Not Associated With Word Finding Problems in the Cam-CAN Cohort: What You Know Won’t Hurt You," The Journals of Gerontology: Series B, The Gerontological Society of America, vol. 72(1), pages 100-106.
    16. repec:cup:judgdm:v:16:y:2021:i:6:p:1549-1574 is not listed on IDEAS
    17. Larissa Batrancea & Anca Nichita & Ioan Batrancea & Lucian Gaban, 2018. "The Strenght of the Relationship Between Shadow Economy and Corruption: Evidence from a Worldwide Country-Sample," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 138(3), pages 1119-1143, August.
    18. Frank Germann & Gary L. Lilien & Christine Moorman & Lars Fiedler & Till Groβmaβ, 2021. "Driving Customer Analytics From the Top," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 7(3), pages 43-61, October.
    19. Gaia Molinaro & Irene Cogliati Dezza & Sarah Katharina Bühler & Christina Moutsiana & Tali Sharot, 2023. "Multifaceted information-seeking motives in children," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    20. Bienmali Kombate & Muganga Emmanuel & Kouadio Konan Richard, 2021. "The Implication of the Strategic Implementation Style and Middle Management Effort in Public Organization Strategic Management Implementation and Its Organizational Performance," Journal of Public Administration and Governance, Macrothink Institute, vol. 11(1), pages 125-125, December.
    21. Kalai Hung & Naomi A. Lee & Kaiping Peng & Jie Sui, 2021. "Profile Pictures in the Digital World: Self-Photographs Predict Better Life Satisfaction," IJERPH, MDPI, vol. 18(12), pages 1-10, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:36:y:2011:i:6:p:699-719. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.