IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v33y2018i2d10.1007_s00180-017-0776-5.html
   My bibliography  Save this article

On the examination of the reliability of statistical software for estimating regression models with discrete dependent variables

Author

Listed:
  • Jason S. Bergtold

    (Kansas State University)

  • Krishna P. Pokharel

    (Kansas State University)

  • Allen M. Featherstone

    (Kansas State University)

  • Lijia Mo

    (Kansas State University)

Abstract

The numerical reliability of statistical software packages was examined for logistic regression models, including SAS 9.4, MATLAB R2015b, R 3.3.1., Stata/IC 14, and LIMDEP 10. Thirty unique benchmark datasets were created by simulating alternative conditional binary choice processes examining rare events, near-multicollinearity, quasi-separation and nonlinear transformation of variables. Certified benchmark estimates for parameters and standard errors of associated datasets were obtained following standards set-out by the National Institute of Standards and Technology. The logarithm of relative error was used as a measure of accuracy for numerical reliability. The paper finds that choice of software package and procedure for estimating logistic regressions will impact accuracy and use of default settings in these packages may significantly reduce reliability of results in different situations.

Suggested Citation

  • Jason S. Bergtold & Krishna P. Pokharel & Allen M. Featherstone & Lijia Mo, 2018. "On the examination of the reliability of statistical software for estimating regression models with discrete dependent variables," Computational Statistics, Springer, vol. 33(2), pages 757-786, June.
    • Handle: RePEc:spr:compst:v:33:y:2018:i:2:d:10.1007_s00180-017-0776-5
    DOI: 10.1007/s00180-017-0776-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00180-017-0776-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00180-017-0776-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Huber, Joel & Train, Kenneth, 2000. "On the Similarity of Classical and Bayesian Estimates of Individual Mean Partworths," Department of Economics, Working Paper Series qt7zm4f51b, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    2. Keeling, Kellie B. & Pavur, Robert J., 2007. "A comparative study of the reliability of nine statistical software packages," Computational Statistics & Data Analysis, Elsevier, vol. 51(8), pages 3811-3831, May.
    3. McCullough, B D, 1999. "Econometric Software Reliability: EViews, LIMDEP, SHAZAM and TSP," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(2), pages 191-202, March-Apr.
    4. B. D. McCullough & H. D. Vinod, 2003. "Verifying the Solution from a Nonlinear Solver: A Case Study," American Economic Review, American Economic Association, vol. 93(3), pages 873-892, June.
    5. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555, November.
    6. McCullough, B. D. & Wilson, Berry, 1999. "On the accuracy of statistical procedures in Microsoft Excel 97," Computational Statistics & Data Analysis, Elsevier, vol. 31(1), pages 27-37, July.
    7. Jae Bong Chang & Jayson L. Lusk, 2011. "Mixed logit models: accuracy and software choice," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(1), pages 167-172, January/F.
    8. Oluwarotimi O. Odeh & Allen M. Featherstone & Jason S. Bergtold, 2010. "Reliability of Statistical Software," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 92(5), pages 1472-1489.
    9. C. R. McKenzie & Sumiko Takaoka, 2003. "2002: A LIMDEP odyssey," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(2), pages 241-247.
    10. Huber, Joel & Train, Kenneth, 2000. "On the Similarity of Classical and Bayesian Estimates of Individual Mean Partworths," Department of Economics, Working Paper Series qt7zm4f51b, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    11. van Damme, E.E.C., 2002. "Economische analyse van politieke processen," Other publications TiSEM 54188f86-501c-4808-b802-1, Tilburg University, School of Economics and Management.
    12. William G. Tomek, 1993. "Confirmation and Replication in Empirical Econometrics: A Step Toward Improved Scholarship," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 75(Special_I), pages 6-14.
    13. H. D. Vinod & B. D. McCullough, 1999. "Corrigenda: The Numerical Reliability of Econometric Software," Journal of Economic Literature, American Economic Association, vol. 37(4), pages 1565-1565, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bergtold, Jason S. & Pokharel, Krishna & Featherstone, Allen, 2015. "On the Examination of the Reliability of Statistical Software for Estimating Logistic Regression Models," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205643, Agricultural and Applied Economics Association.
    2. A. Yalta & A. Yalta, 2010. "Should Economists Use Open Source Software for Doing Research?," Computational Economics, Springer;Society for Computational Economics, vol. 35(4), pages 371-394, April.
    3. Yalta, A. Talha & Jenal, Olaf, 2009. "On the importance of verifying forecasting results," International Journal of Forecasting, Elsevier, vol. 25(1), pages 62-73.
    4. Charles G. Renfro, 2009. "The Practice of Econometric Theory," Advanced Studies in Theoretical and Applied Econometrics, Springer, number 978-3-540-75571-5.
    5. Villas-Boas, Sofia B & Taylor, Rebecca & Krovetz, Hannah, 2016. "Willingness to Pay for Low Water Footprint Food Choices During Drought," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt9vh3x180, Department of Agricultural & Resource Economics, UC Berkeley.
    6. Kim, Junghun & Seung, Hyunchan & Lee, Jongsu & Ahn, Joongha, 2020. "Asymmetric preference and loss aversion for electric vehicles: The reference-dependent choice model capturing different preference directions," Energy Economics, Elsevier, vol. 86(C).
    7. Daniele Pacifico, 2012. "Fitting nonparametric mixed logit models via expectation-maximization algorithm," Stata Journal, StataCorp LLC, vol. 12(2), pages 284-298, June.
    8. Erlend Dancke Sandorf & Danny Campbell & Caspar Chorus, 2022. "A simple satisficing model," PLOS ONE, Public Library of Science, vol. 17(10), pages 1-30, October.
    9. Byun, Hyunsuk & Shin, Jungwoo & Lee, Chul-Yong, 2018. "Using a discrete choice experiment to predict the penetration possibility of environmentally friendly vehicles," Energy, Elsevier, vol. 144(C), pages 312-321.
    10. Shin, Jungwoo & Park, Yuri & Lee, Daeho, 2018. "Who will be smart home users? An analysis of adoption and diffusion of smart homes," Technological Forecasting and Social Change, Elsevier, vol. 134(C), pages 246-253.
    11. Stefanie Lena Heinzle & Rolf Wüstenhagen, 2012. "Dynamic Adjustment of Eco‐labeling Schemes and Consumer Choice – the Revision of the EU Energy Label as a Missed Opportunity?," Business Strategy and the Environment, Wiley Blackwell, vol. 21(1), pages 60-70, January.
    12. Stefanie Heinzle, 2012. "Disclosure of Energy Operating Cost Information: A Silver Bullet for Overcoming the Energy-Efficiency Gap?," Journal of Consumer Policy, Springer, vol. 35(1), pages 43-64, March.
    13. Xiaoxue Sherry Gao & Glenn W. Harrison & Rusty Tchernis, 2023. "Behavioral welfare economics and risk preferences: a Bayesian approach," Experimental Economics, Springer;Economic Science Association, vol. 26(2), pages 273-303, April.
    14. Hoyos, David, 2010. "The state of the art of environmental valuation with discrete choice experiments," Ecological Economics, Elsevier, vol. 69(8), pages 1595-1603, June.
    15. Mørkbak, Morten Raun & Olsen, Søren Bøye & Campbell, Danny, 2014. "Behavioral implications of providing real incentives in stated choice experiments," Journal of Economic Psychology, Elsevier, vol. 45(C), pages 102-116.
    16. Lee, Daeho & Shin, Jungwoo & Lee, Sangwon, 2015. "Network management in the era of convergence: Focusing on application-based quality assessment of Internet access service," Telecommunications Policy, Elsevier, vol. 39(8), pages 705-716.
    17. Hye-Jeong Lee & Beom Jin Chung & Sung-Yoon Huh, 2023. "Consumer Preferences for Smart Energy Services Based on AMI Data in the Power Sector," Energies, MDPI, vol. 16(9), pages 1-20, May.
    18. repec:ebl:ecbull:v:30:y:2010:i:1:p:437-449 is not listed on IDEAS
    19. Kyuho Maeng & Sungmin Ko & Jungwoo Shin & Youngsang Cho, 2020. "How Much Electricity Sharing Will Electric Vehicle Owners Allow from Their Battery? Incorporating Vehicle-to-Grid Technology and Electricity Generation Mix," Energies, MDPI, vol. 13(16), pages 1-25, August.
    20. Arne Risa Hole & Hong Il Yoo, 2017. "The use of heuristic optimization algorithms to facilitate maximum simulated likelihood estimation of random parameter logit models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(5), pages 997-1013, November.
    21. Sung-Yoon Huh & JongRoul Woo & Chul-Yong Lee, 2019. "What Do Potential Residents Really Want When Hosting a Nuclear Power Plant? An Empirical Study of Economic Incentives in South Korea," Energies, MDPI, vol. 12(7), pages 1-17, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:33:y:2018:i:2:d:10.1007_s00180-017-0776-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.