IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/pe5bj.html
   My bibliography  Save this paper

A General Model-Implied Simulation-Based Power Estimation Method for Correctly and Misspecfied Models: Applications to Nonlinear and Linear Structural Equation Models

Author

Listed:
  • Irmer, Julien Patrick
  • Klein, Andreas
  • Schermelleh-Engel, Karin

Abstract

Closed form power estimation is only available for limited classes of models, requiring correct model specification for most applications. Simulation is used in other scenarios, but a general framework in computing required sample sizes for given power rates is still missing. We propose a new model-implied simulation-based power estimation (MSPE) method that makes use of the asymptotic normality property of estimates of a wide class of estimators, the $M$-estimators, and we give theoretical justification for the approach. $M$-estimators include maximum-likelihood estimates and least squares estimates, but also limited information estimators and estimators used for misspecified models, hence, the new power modeling method is widely applicable. We highlight its performance for linear and nonlinear structural equation models (SEM) and a moderated logistic regression model for correctly specified models and models under distributional misspecification. Simulation results suggest that the new power modeling method is unbiased and shows good performance with regard to root mean squared error and Type I error rates for the predicted required sample sizes and predicted power rates. Alternative approaches, such as the na\"ive approach of selecting arbitrary sample sizes with linear interpolation of power or simple logistic regression approaches, showed poor performance. The MSPE appears to be a valuable tool to estimate power for models without (asymptotic) analytical power estimation.

Suggested Citation

  • Irmer, Julien Patrick & Klein, Andreas & Schermelleh-Engel, Karin, 2024. "A General Model-Implied Simulation-Based Power Estimation Method for Correctly and Misspecfied Models: Applications to Nonlinear and Linear Structural Equation Models," OSF Preprints pe5bj, Center for Open Science.
  • Handle: RePEc:osf:osfxxx:pe5bj
    DOI: 10.31219/osf.io/pe5bj
    as

    Download full text from publisher

    File URL: https://osf.io/download/660662a458fa4906f2e4ed22/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/pe5bj?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Allen Fleishman, 1978. "A method for simulating non-normal distributions," Psychometrika, Springer;The Psychometric Society, vol. 43(4), pages 521-532, December.
    2. Amemiya, Takeshi, 1981. "Qualitative Response Models: A Survey," Journal of Economic Literature, American Economic Association, vol. 19(4), pages 1483-1536, December.
    3. Steffen Grønneberg & Julien Patrick Irmer, 2024. "Non-parametric Regression Among Factor Scores: Motivation and Diagnostics for Nonlinear Structural Equation Models," Psychometrika, Springer;The Psychometric Society, vol. 89(3), pages 822-850, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Doole, Graeme J. & Romera, Alvaro J. & Leslie, Jennifer E. & Chapman, David F. & Pinxterhuis, Ina (J.B.). & Kemp, Peter D., 2021. "Economic assessment of plantain (Plantago lanceolata) uptake in the New Zealand dairy sector," Agricultural Systems, Elsevier, vol. 187(C).
    2. Arturo Estrella & Anthony P. Rodrigues, 1998. "Consistent covariance matrix estimation in probit models with autocorrelated errors," Staff Reports 39, Federal Reserve Bank of New York.
    3. T.R.L. Fry & R.D. Brooks & Br. Comley & J. Zhang, 1993. "Economic Motivations for Limited Dependent and Qualitative Variable Models," The Economic Record, The Economic Society of Australia, vol. 69(2), pages 193-205, June.
    4. Paleti, Rajesh, 2018. "Generalized multinomial probit Model: Accommodating constrained random parameters," Transportation Research Part B: Methodological, Elsevier, vol. 118(C), pages 248-262.
    5. Maria Iacovou, 2002. "Class Size in the Early Years: Is Smaller Really Better?," Education Economics, Taylor & Francis Journals, vol. 10(3), pages 261-290.
    6. Erik Stam & Roy Thurik & Peter van der Zwan, 2010. "Entrepreneurial exit in real and imagined markets," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 19(4), pages 1109-1139, August.
    7. Sarah Ann Wheeler & Céline Nauges & Alec Zuo, 2021. "How stable are Australian farmers’ climate change risk perceptions? New evidence of the feedback loop between risk perceptions and behaviour," Post-Print hal-04670841, HAL.
    8. Haoying Wang & Guohui Wu, 2022. "Modeling discrete choices with large fine-scale spatial data: opportunities and challenges," Journal of Geographical Systems, Springer, vol. 24(3), pages 325-351, July.
    9. Y. Saks, 2016. "Socio-economic transitions on the labour market : a European benchmarking exercise," Economic Review, National Bank of Belgium, issue iii, pages 41-58, December.
    10. Kodila-Tedika, Oasis & Khalifa, Sherif, 2022. "State History and State Fragility in Sub-Saharan Africa," Journal of Economic Development, The Economic Research Institute, Chung-Ang University, vol. 47(4), pages 39-53, December.
    11. Garcia, Philip & Hudson, Michael A. & Waller, Mark L., 1988. "The Pricing Efficiency of Agricultural Futures Markets: An Analysis of Previous Research Results," Journal of Agricultural and Applied Economics, Cambridge University Press, vol. 20(1), pages 119-130, July.
    12. Haaijer, Marinus E., 1996. "Predictions in conjoint choice experiments : the x-factor probit model," Research Report 96B22, University of Groningen, Research Institute SOM (Systems, Organisations and Management).
    13. Ashok Mishra & Barry Goodwin, 2006. "Revenue insurance purchase decisions of farmers," Applied Economics, Taylor & Francis Journals, vol. 38(2), pages 149-159.
    14. Hu, Michael Y. & Chen, Haiyang, 1996. "An empirical analysis of factors explaining foreign joint venture performance in China," Journal of Business Research, Elsevier, vol. 35(2), pages 165-173, February.
    15. Bagi, Faqir Singh, 1983. "A Logit Model Of Farmers' Decisions About Credit," Southern Journal of Agricultural Economics, Southern Agricultural Economics Association, vol. 15(2), pages 1-7, December.
    16. Monika Bütler, 2002. "The Political Feasibility of Increasing the Retirement Age: Lessons from a Ballot on the Female Retirement Age," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 9(4), pages 349-365, August.
    17. Per Botolf Maurseth, 2005. "Lovely but dangerous: The impact of patent citations on patent renewal," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 14(5), pages 351-374.
    18. Fiorella Kostoris Padoa Schioppa & Claudio Lupi, 2002. "Family Income and Wealth, Youth Unemployment and Active Labour Market Policies," International Review of Applied Economics, Taylor & Francis Journals, vol. 16(4), pages 407-416.
    19. Michael LaCour-Little & Michael Marschoun & Clark L. Maxam, 2002. "Improving Parametric Mortgage Prepayment Models with Non-parametric Kernel Regression," Journal of Real Estate Research, American Real Estate Society, vol. 24(3), pages 299-328.
    20. Jakusch, Sven Thorsten, 2017. "On the applicability of maximum likelihood methods: From experimental to financial data," SAFE Working Paper Series 148, Leibniz Institute for Financial Research SAFE, revised 2017.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:pe5bj. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.