IDEAS home Printed from https://ideas.repec.org/p/ags/aaea15/205643.html
   My bibliography  Save this paper

On the Examination of the Reliability of Statistical Software for Estimating Logistic Regression Models

Author

Listed:
  • Bergtold, Jason S.
  • Pokharel, Krishna
  • Featherstone, Allen

Abstract

The numerical reliability of software packages was examined for the logistic regression model. Software tested include SAS 9.3, MATLAB R2012a, R 3.1.0, Stata/IC 13.1 and LIMDEP 10.5. Thirty benchmark datasets were created by simulating different conditional binary choice processes. To obtain certified values, this study followed the National Institute of Standards and Technology procedures when they generated certified values of parameter estimates and standard errors for the nonlinear logistic regression models used. The logarithm of the relative error was used as a measure of accuracy to examine the numerical reliability of these packages.

Suggested Citation

  • Bergtold, Jason S. & Pokharel, Krishna & Featherstone, Allen, 2015. "On the Examination of the Reliability of Statistical Software for Estimating Logistic Regression Models," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205643, Agricultural and Applied Economics Association.
    • Handle: RePEc:ags:aaea15:205643
    DOI: 10.22004/ag.econ.205643
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/205643/files/Logit%20Reliability%20Paper%20Bergtold%20et%20al%20AAEA%202015.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.205643?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Keeling, Kellie B. & Pavur, Robert J., 2007. "A comparative study of the reliability of nine statistical software packages," Computational Statistics & Data Analysis, Elsevier, vol. 51(8), pages 3811-3831, May.
    2. Huber, Joel & Train, Kenneth, 2000. "On the Similarity of Classical and Bayesian Estimates of Individual Mean Partworths," Department of Economics, Working Paper Series qt7zm4f51b, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    3. Jae Bong Chang & Jayson L. Lusk, 2011. "Mixed logit models: accuracy and software choice," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(1), pages 167-172, January/F.
    4. Silk, Julian, 1996. "Systems Estimation: A Comparison of SAS, SHAZAM and TSP," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(4), pages 437-450, July-Aug..
    5. H. D. Vinod & B. D. McCullough, 1999. "Corrigenda: The Numerical Reliability of Econometric Software," Journal of Economic Literature, American Economic Association, vol. 37(4), pages 1565-1565, December.
    6. Simon, Stephen D. & Lesage, James P., 1988. "Benchmarking numerical accuracy of statistical algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 7(2), pages 197-209, December.
    7. Arne Risa Hole, 2011. "A comment on ‘Mixed logit models: Accuracy and software choice.'," Working Papers 2011011, The University of Sheffield, Department of Economics, revised May 2011.
    8. Stanislav Kolenikov, 2001. "Review of Stata 7," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(5), pages 637-646.
    9. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555, Enero-Abr.
    10. Korosi, Gabor & Matyas, Laszlo & Szekely, Istvan P, 1993. "Comparative Review of Some Econometric Software Packages," Journal of Economic Surveys, Wiley Blackwell, vol. 7(1), pages 105-118.
    11. McCullough, B. D. & Wilson, Berry, 1999. "On the accuracy of statistical procedures in Microsoft Excel 97," Computational Statistics & Data Analysis, Elsevier, vol. 31(1), pages 27-37, July.
    12. Sawitzki, Gunther, 1994. "Report on the Numerical Reliability of Data Analysis Systems," Computational Statistics & Data Analysis, Elsevier, vol. 18(2), pages 289-301, September.
    13. William G. Tomek, 1993. "Confirmation and Replication in Empirical Econometrics: A Step Toward Improved Scholarship," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 75(Special_I), pages 6-14.
    14. H. D. Vinod & B. D. McCullough, 1999. "The Numerical Reliability of Econometric Software," Journal of Economic Literature, American Economic Association, vol. 37(2), pages 633-665, June.
    15. Oluwarotimi O. Odeh & Allen M. Featherstone & Jason S. Bergtold, 2010. "Reliability of Statistical Software," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 92(5), pages 1472-1489.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jason S. Bergtold & Krishna P. Pokharel & Allen M. Featherstone & Lijia Mo, 2018. "On the examination of the reliability of statistical software for estimating regression models with discrete dependent variables," Computational Statistics, Springer, vol. 33(2), pages 757-786, June.
    2. Oluwarotimi O. Odeh & Allen M. Featherstone & Jason S. Bergtold, 2010. "Reliability of Statistical Software," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 92(5), pages 1472-1489.
    3. A. Yalta & A. Yalta, 2010. "Should Economists Use Open Source Software for Doing Research?," Computational Economics, Springer;Society for Computational Economics, vol. 35(4), pages 371-394, April.
    4. McCullough, B. D., 2000. "Is it safe to assume that software is accurate?," International Journal of Forecasting, Elsevier, vol. 16(3), pages 349-357.
    5. Yalta, A. Talha, 2008. "The accuracy of statistical distributions in Microsoft® Excel 2007," Computational Statistics & Data Analysis, Elsevier, vol. 52(10), pages 4579-4586, June.
    6. Yalta, A. Talha & Jenal, Olaf, 2009. "On the importance of verifying forecasting results," International Journal of Forecasting, Elsevier, vol. 25(1), pages 62-73.
    7. Charles G. Renfro, 2009. "The Practice of Econometric Theory," Advanced Studies in Theoretical and Applied Econometrics, Springer, number 978-3-540-75571-5, April.
    8. A. Talha Yalta, 2010. "The Accuracy of Statistical Distributions in Microsoft (R) Excel 2007," Working Papers 1006, TOBB University of Economics and Technology, Department of Economics.
    9. A. M. Kitchen & R. Drachenberg & J. Symanzik, 2003. "Assessing the reliability of web-based statistical software," Computational Statistics, Springer, vol. 18(1), pages 107-122, March.
    10. Peter Winker & Dietmar Maringer, 2009. "The convergence of estimators based on heuristics: theory and application to a GARCH model," Computational Statistics, Springer, vol. 24(3), pages 533-550, August.
    11. B. D. McCullough & H. D. Vinod, 2003. "Verifying the Solution from a Nonlinear Solver: A Case Study," American Economic Review, American Economic Association, vol. 93(3), pages 873-892, June.
    12. Ooms, M., 2008. "Trends in Applied Econometrics Software Development 1985-2008, an analysis of Journal of Applied Econometrics research articles, software reviews, data and code," Serie Research Memoranda 0021, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    13. McCullough, B.D. & Heiser, David A., 2008. "On the accuracy of statistical procedures in Microsoft Excel 2007," Computational Statistics & Data Analysis, Elsevier, vol. 52(10), pages 4570-4578, June.
    14. McCullough, B D, 1999. "Econometric Software Reliability: EViews, LIMDEP, SHAZAM and TSP," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(2), pages 191-202, March-Apr.
    15. Johnson, F. Reed & Ozdemir, Semra & Phillips, Kathryn A., 2010. "Effects of simplifying choice tasks on estimates of taste heterogeneity in stated-choice surveys," Social Science & Medicine, Elsevier, vol. 70(2), pages 183-190, January.
    16. Francisco Javier Amador & Rosa Marina González & Juan de Dios Ortúzar, 2004. "Preference heterogeneity and willingness to pay for travel time," Documentos de trabajo conjunto ULL-ULPGC 2004-12, Facultad de Ciencias Económicas de la ULPGC.
    17. Justin Wolfers, 2006. "Did Unilateral Divorce Laws Raise Divorce Rates? A Reconciliation and New Results," American Economic Review, American Economic Association, vol. 96(5), pages 1802-1820, December.
    18. D. McCullough, B. & Wilson, Berry, 2002. "On the accuracy of statistical procedures in Microsoft Excel 2000 and Excel XP," Computational Statistics & Data Analysis, Elsevier, vol. 40(4), pages 713-721, October.
    19. Marco A. Palma & Dmitry V. Vedenov & David Bessler, 2020. "The order of variables, simulation noise, and accuracy of mixed logit estimates," Empirical Economics, Springer, vol. 58(5), pages 2049-2083, May.
    20. Gilles Teyssière, 2005. "Structural time series modelling with STAMP 6.02," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(4), pages 571-577, May.

    More about this item

    Keywords

    ;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:aaea15:205643. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/aaeaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.