IDEAS home Printed from https://ideas.repec.org/a/wly/apecpp/v45y2023i3p1292-1331.html
   My bibliography  Save this article

On the robustness/replication of econometric analyses from nonlinear models using various commonplace software packages

Author

Listed:
  • Oral Capps

Abstract

Because replicability is an important part of every scientific endeavor, this research deals with comparing and contrasting parameter estimates, standard errors, and p‐values from the estimation of five commonly encountered nonlinear models in applied econometrics. Commonplace software packages indigenous to econometrics and statistics are used, namely EVIEWS 11.0, SAS 9.4, Stata 17, and R 4.1.2 in five replication exercises to determine potential differences, if any, in empirical results. The hypothesis that mainstream software packages generate different empirical results in the estimation of nonlinear models is confirmed for the polynomial distributed lag (PDL) model and the GARCH(1,1) model. For the probit model and the Barten synthetic demand system model, the differences in parameter estimates, standard errors, and p‐values are less evident across the four commonly used software packages. For the Tobit model, the respective sets of parameter estimates, standard errors, and p‐values are nearly identical across the respective software packages. Economic analysts should not just accept estimation results uncritically, but instead, conduct sensitivity analyses involving the use of at least two software packages. The agricultural economics profession should adopt this recommendation as standard practice.

Suggested Citation

  • Oral Capps, 2023. "On the robustness/replication of econometric analyses from nonlinear models using various commonplace software packages," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 45(3), pages 1292-1331, September.
    • Handle: RePEc:wly:apecpp:v:45:y:2023:i:3:p:1292-1331
    DOI: 10.1002/aepp.13367
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/aepp.13367
    Download Restriction: no
    File URL: https://libkey.io/10.1002/aepp.13367?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Capps, Oral & Bessler, David A. & Williams, Gary W., 2016. "The Ramifications of Nearly Going Dark: A Natural Experiment in the Case of U.S. Generic Orange Juice Advertising," Agricultural and Resource Economics Review, Cambridge University Press, vol. 45(1), pages 68-97, April.
    2. Capps, Oral Jr. & Gvillo, Rejeana Marie, 2020. "Economic and Sociodemographic Drivers Associated with the Decision to Purchase Food Items and Nonalcoholic Beverages from Vending Machines in the United States," Journal of Food Distribution Research, Food Distribution Research Society, vol. 51(3), November.
    3. Veall, Michael R & Zimmermann, Klaus F, 1996. "Pseudo-R-[superscript 2] Measures for Some Common Limited Dependent Variable Models," Journal of Economic Surveys, Wiley Blackwell, vol. 10(3), pages 241-259, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ahn T. Le, 2003. "Female Labour Market Participation: Differences Between Primary and Tied Movers," Economics Discussion / Working Papers 03-17, The University of Western Australia, Department of Economics.
    2. Lovejoy, Kristin, 2012. "Mobility Fulfillment Among Low-car Households: Implications for Reducing Auto Dependence in the United States," Institute of Transportation Studies, Working Paper Series qt4v44b5qn, Institute of Transportation Studies, UC Davis.
    3. Patrick A. Puhani, 2000. "On the Identification of Relative Wage Rigidity Dynamics," William Davidson Institute Working Papers Series 343, William Davidson Institute at the University of Michigan.
    4. Martin Kukuk & Manfred Stadler, 2001. "Financing Constraints and the Timing of Innovations in the German Services Sector," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 28(3), pages 277-292, September.
    5. Shew, Aaron M. & Nalley, Lawton L. & Durand-Morat, Alvaro & Meredith, Kylie & Parajuli, Ranjan & Thoma, Greg & Henry, Christopher G., 2021. "Holistically valuing public investments in agricultural water conservation," Agricultural Water Management, Elsevier, vol. 252(C).
    6. PUHANI Patrick A., 2000. "On the Identification of Relative Wage Rigidity Dynamics A Proposal for a Methodology on Cross-Section Data and Empirical Evidence for Poland in Transition," IRISS Working Paper Series 2000-11, IRISS at CEPS/INSTEAD.
    7. Arcidiacono, Peter & Kinsler, Josh & Ransom, Tyler, 2022. "Asian American Discrimination in Harvard Admissions," European Economic Review, Elsevier, vol. 144(C).
    8. Kumagai, Junya & Managi, Shunsuke, 2019. "Environmental behaviour and choice of sustainable travel mode in urban areas: comparative evidence from commuters in Asian cities," MPRA Paper 97493, University Library of Munich, Germany.
    9. Thomas Bauer & Klaus F. Zimmermann, 1999. "Overtime Work and Overtime Compensation in Germany," Scottish Journal of Political Economy, Scottish Economic Society, vol. 46(4), pages 419-436, September.
    10. David Jung-Hwi Lee & Jean-Michel Guldmann, 2023. "Optimal Regional Allocation of Future Population and Employment under Urban Boundary and Density Constraints: A Spatial Interaction Modeling Approach," Land, MDPI, vol. 12(2), pages 1-33, February.
    11. Michael A. Shields & Stephen Wheatley Price, 2002. "The English language fluency and occupational success of ethnic minority immigrant men living in English metropolitan areas," Journal of Population Economics, Springer;European Society for Population Economics, vol. 15(1), pages 137-160.
    12. Y. Wu, 1998. "Redundancy and Firm Characteristics in Chinese State-owned Enterprises," Economics Discussion / Working Papers 98-17, The University of Western Australia, Department of Economics.
    13. Md Irteja Islam & Shah Saif Jahan & Mohammad Tawfique Hossain Chowdhury & Samia Naz Isha & Arup Kumar Saha & Sujan Kanti Nath & Mohammed Shahed Jahan & Md. Humayun Kabir & Ehsanul Hoque Apu & Russell , 2022. "Experience of Bangladeshi Dental Students towards Online Learning during the COVID-19 Pandemic: A Web-Based Cross-Sectional Study," IJERPH, MDPI, vol. 19(13), pages 1-13, June.
    14. Sengupta, Sanchita & Kurkalova, Lyubov A. & Kling, Catherine L., 2006. "Avoiding biases from data-dependent specification search: an application to a tillage choice model," 2006 Annual meeting, July 23-26, Long Beach, CA 21399, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    15. Huang, Francis L. & Cornell, Dewey, 2018. "The relationship of school climate with out-of-school suspensions," Children and Youth Services Review, Elsevier, vol. 94(C), pages 378-389.
    16. Corrado Giulietti & Guangjie Ning & Klaus F. Zimmermann, 2012. "Self‐employment of rural‐to‐urban migrants in China," International Journal of Manpower, Emerald Group Publishing Limited, vol. 33(1), pages 96-117, March.
    17. Pim Verbunt & Anne-Catherine Guio, 2019. "Explaining Differences Within and Between Countries in the Risk of Income Poverty and Severe Material Deprivation: Comparing Single and Multilevel Analyses," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 827-868, July.
    18. Zimmermann, Laura & Gataullina, Liliya & Constant, Amelie & Zimmermann, Klaus F., 2008. "Human capital and ethnic self-identification of immigrants," Economics Letters, Elsevier, vol. 98(3), pages 235-239, March.
    19. Salvatore Ingrassia & Antonio Punzo, 2020. "Cluster Validation for Mixtures of Regressions via the Total Sum of Squares Decomposition," Journal of Classification, Springer;The Classification Society, vol. 37(2), pages 526-547, July.
    20. Gero Carletto & Alberto Zezza, 2006. "Being poor, feeling poorer: Combining objective and subjective measures of welfare in Albania," Journal of Development Studies, Taylor & Francis Journals, vol. 42(5), pages 739-760.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:apecpp:v:45:y:2023:i:3:p:1292-1331. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)2040-5804 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.