IDEAS home Printed from https://ideas.repec.org/a/aes/infoec/v25y2021i2p64-74.html
   My bibliography  Save this article

Basic Hyperparameters Tuning Methods for Classification Algorithms

Author

Listed:
  • Claudia ANTAL-VAIDA

Abstract

Considering the dynamics of the economic environment and the amount of data generated every second, the decision-making process is changing and becomes data driven, highly influencing the business strategies setup in order to keep the competitive advantage. However, without technology, data analysis would not be feasible, reason why machine learning is seen as a disruptive innovation for businesses, especially due to its capacity to convert data into actionable outcomes. Though, for a high-quality machine learning model result, algorithm selection and hyperparameters optimization play vital roles, hence became high-interest topics in the field. To achieve this, various automatic selection methods have been proposed and the aim of this paper is to compare two of them – GridSearch and RandomizedSearch - and assess their impact on the model accuracy by comparing with the results obtained when default hyperparameters were applied.

Suggested Citation

  • Claudia ANTAL-VAIDA, 2021. "Basic Hyperparameters Tuning Methods for Classification Algorithms," Informatica Economica, Academy of Economic Studies - Bucharest, Romania, vol. 25(2), pages 64-74.
    • Handle: RePEc:aes:infoec:v:25:y:2021:i:2:p:64-74
    as

    Download full text from publisher

    File URL: http://revistaie.ase.ro/content/98/06%20-%20antal.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lee, In & Lee, Kyoochun, 2015. "The Internet of Things (IoT): Applications, investments, and challenges for enterprises," Business Horizons, Elsevier, vol. 58(4), pages 431-440.
    2. Jing Wang & Weisheng Lu & Fan Xue & Meng Ye, 2021. "A Machine Learning-Based Approach for BIM Object Localization," Springer Books, in: Gui Ye & Hongping Yuan & Jian Zuo (ed.), Proceedings of the 24th International Symposium on Advancement of Construction Management and Real Estate, pages 1391-1399, Springer.
    3. Costa, Alexandre Bonnet R. & Ferreira, Pedro Cavalcanti G. & Gaglianone, Wagner P. & Guillén, Osmani Teixeira C. & Issler, João Victor & Lin, Yihao, 2021. "Machine learning and oil price point and density forecasting," Energy Economics, Elsevier, vol. 102(C).
    4. Hao Ni & Xin Dong & Jinsong Zheng & Guangxi Yu, 2021. "An Introduction to Machine Learning in Quantitative Finance," World Scientific Books, World Scientific Publishing Co. Pte. Ltd., number q0275, August.
    5. Victor DeMiguel & Javier Gil-Bazo & Francisco J. Nogales & André A. P. Santos, 2021. "Can Machine Learning Help to Select Portfolios of Mutual Funds?," Working Papers 1245, Barcelona School of Economics.
    6. Raymond C. W. Leung & Yu-Man Tam, 2021. "Statistical Arbitrage Risk Premium by Machine Learning," Papers 2103.09987, arXiv.org.
    7. Zhang, Liang & Wen, Jin & Li, Yanfei & Chen, Jianli & Ye, Yunyang & Fu, Yangyang & Livingood, William, 2021. "A review of machine learning in building load prediction," Applied Energy, Elsevier, vol. 285(C).
    8. Christian M. Dahl & Torben S. D. Johansen & Emil N. S{o}rensen & Christian E. Westermann & Simon F. Wittrock, 2021. "Applications of Machine Learning in Document Digitisation," Papers 2102.03239, arXiv.org.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Caratozzolo, Vincenzo & Misuri, Alessio & Cozzani, Valerio, 2022. "A generalized equipment vulnerability model for the quantitative risk assessment of horizontal vessels involved in Natech scenarios triggered by floods," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    2. Hamilton, R.H. & Sodeman, William A., 2020. "The questions we ask: Opportunities and challenges for using big data analytics to strategically manage human capital resources," Business Horizons, Elsevier, vol. 63(1), pages 85-95.
    3. Ahmad, Tanveer & Madonski, Rafal & Zhang, Dongdong & Huang, Chao & Mujeeb, Asad, 2022. "Data-driven probabilistic machine learning in sustainable smart energy/smart energy systems: Key developments, challenges, and future research opportunities in the context of smart grid paradigm," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    4. Cao, Wenqiang & Yu, Junqi & Chao, Mengyao & Wang, Jingqi & Yang, Siyuan & Zhou, Meng & Wang, Meng, 2023. "Short-term energy consumption prediction method for educational buildings based on model integration," Energy, Elsevier, vol. 283(C).
    5. Dhruv Chakravarty Nath & Indranil Kundu & Ayushi Sharma & Pranav Shivhare & Asif Afzal & Manzoore Elahi M. Soudagar & Sung Goon Park, 2024. "Internet of Things integrated with solar energy applications: a state-of-the-art review," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 26(10), pages 24597-24652, October.
    6. William Villegas-Ch & Xavier Palacios-Pacheco & Milton Román-Cañizares, 2020. "An Internet of Things Model for Improving Process Management on University Campus," Future Internet, MDPI, vol. 12(10), pages 1-16, September.
    7. Omar, Yamila M. & Minoufekr, Meysam & Plapper, Peter, 2019. "Business analytics in manufacturing: Current trends, challenges and pathway to market leadership," Operations Research Perspectives, Elsevier, vol. 6(C).
    8. Benlagha, Noureddine & Hemrit, Wael, 2020. "Internet use and insurance growth: evidence from a panel of OECD countries," Technology in Society, Elsevier, vol. 62(C).
    9. Jonas Sievers & Thomas Blank, 2023. "A Systematic Literature Review on Data-Driven Residential and Industrial Energy Management Systems," Energies, MDPI, vol. 16(4), pages 1-21, February.
    10. Culot, Giovanna & Nassimbeni, Guido & Orzes, Guido & Sartor, Marco, 2020. "Behind the definition of Industry 4.0: Analysis and open questions," International Journal of Production Economics, Elsevier, vol. 226(C).
    11. Ly, Pham Thi Minh & Lai, Wen-Hsiang & Hsu, Chiung-Wen & Shih, Fang-Yin, 2018. "Fuzzy AHP analysis of Internet of Things (IoT) in enterprises," Technological Forecasting and Social Change, Elsevier, vol. 136(C), pages 1-13.
    12. Park, Jiyoun & Nam, Changi & Kim, Hye-jin & Kim, Seongcheol, 2018. "What are the relative importance of smart car utilities from consumer perspective and who will lead them?," 22nd ITS Biennial Conference, Seoul 2018. Beyond the boundaries: Challenges for business, policy and society 190334, International Telecommunications Society (ITS).
    13. Morshadul Hasan & Ariful Hoque & Thi Le, 2023. "Big Data-Driven Banking Operations: Opportunities, Challenges, and Data Security Perspectives," FinTech, MDPI, vol. 2(3), pages 1-26, July.
    14. Marco Bettiol & Mauro Capestro & Eleonora Di Maria & Roberto Ganau, 2024. "Is this time different? How Industry 4.0 affects firms’ labor productivity," Small Business Economics, Springer, vol. 62(4), pages 1449-1467, April.
    15. Tang, Lingfeng & Xie, Haipeng & Wang, Xiaoyang & Bie, Zhaohong, 2023. "Privacy-preserving knowledge sharing for few-shot building energy prediction: A federated learning approach," Applied Energy, Elsevier, vol. 337(C).
    16. Osterrieder, Philipp & Budde, Lukas & Friedli, Thomas, 2020. "The smart factory as a key construct of industry 4.0: A systematic literature review," International Journal of Production Economics, Elsevier, vol. 221(C).
    17. Liu, Che & Li, Fan & Zhang, Chenghui & Sun, Bo & Zhang, Guanguan, 2023. "A day-ahead prediction method for high-resolution electricity consumption in residential units," Energy, Elsevier, vol. 265(C).
    18. Blomqvist, Christopher & Enflo, Kerstin & Jakobsson, Andreas & Åström, Kalle, 2023. "Reading the ransom: Methodological advancements in extracting the Swedish Wealth Tax of 1571," Explorations in Economic History, Elsevier, vol. 87(C).
    19. Arman Derakhti & Ernesto D. R. Santibanez Gonzalez & Abbas Mardani, 2023. "Industry 4.0 and Beyond: A Review of the Literature on the Challenges and Barriers Facing the Agri-Food Supply Chain," Sustainability, MDPI, vol. 15(6), pages 1-22, March.
    20. Fernanda Moura Quintão Silva & Menaouar Berrehil El Kattel & Igor Amariz Pires & Thales Alexandre Carvalho Maia, 2022. "Development of a Supervisory System Using Open-Source for a Power Micro-Grid Composed of a Photovoltaic (PV) Plant Connected to a Battery Energy Storage System and Loads," Energies, MDPI, vol. 15(22), pages 1-22, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aes:infoec:v:25:y:2021:i:2:p:64-74. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Paul Pocatilu (email available below). General contact details of provider: https://edirc.repec.org/data/aseeero.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.