IDEAS home Printed from https://ideas.repec.org/a/spr/decisn/v47y2020i4d10.1007_s40622-020-00265-3.html
   My bibliography  Save this article

An approach of improving decision tree classifier using condensed informative data

Author

Listed:
  • Archana R. Panhalkar

    (Shri Guru Gobind Singhji Institute of Engineering and Technology)

  • Dharmpal D. Doye

    (Shri Guru Gobind Singhji Institute of Engineering and Technology)

Abstract

The advancement of new technologies in today’s era produces a vast amount of data. To store, analyze and mine knowledge from huge data requires large space as well as better execution speed. To train classifiers using a large amount of data requires more time and space. To avoid wastage of time and space, there is a need to mine significant information from a huge collection of data. Decision tree is one of the promising classifiers which mine knowledge from huge data. This paper aims to reduce the data to construct efficient decision tree classifier. This paper presents a method which finds informative data to improve the performance of decision tree classifier. Two clustering-based methods are proposed for dimensionality reduction and utilizing knowledge from outliers. These condensed data are applied to the decision tree for high prediction accuracy. The uniqueness of the first method is that it finds the representative instances from clusters that utilize knowledge of its neighboring data. The second method uses supervised clustering which finds the number of cluster representatives for the reduction of data. With an increase in the prediction accuracy of a tree, these methods decrease the size, building time and space required for decision tree classifiers. These novel methods are united into a single supervised and unsupervised Decision Tree based on Cluster Analysis Pre-processing (DTCAP) which hunts the informative instances from a small, medium and large dataset. The experiments are conducted on a standard UCI dataset of different sizes. It illustrates that the method with its simplicity performs a reduction of data up to 50%. It produces a qualitative dataset which enhances the performance of the decision tree classifier.

Suggested Citation

  • Archana R. Panhalkar & Dharmpal D. Doye, 2020. "An approach of improving decision tree classifier using condensed informative data," DECISION: Official Journal of the Indian Institute of Management Calcutta, Springer;Indian Institute of Management Calcutta, vol. 47(4), pages 431-445, December.
    • Handle: RePEc:spr:decisn:v:47:y:2020:i:4:d:10.1007_s40622-020-00265-3
    DOI: 10.1007/s40622-020-00265-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40622-020-00265-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s40622-020-00265-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. G. V. Kass, 1980. "An Exploratory Technique for Investigating Large Quantities of Categorical Data," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 29(2), pages 119-127, June.
    2. Robert Thorndike, 1953. "Who belongs in the family?," Psychometrika, Springer;The Psychometric Society, vol. 18(4), pages 267-276, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Strobl, Carolin & Boulesteix, Anne-Laure & Augustin, Thomas, 2007. "Unbiased split selection for classification trees based on the Gini Index," Computational Statistics & Data Analysis, Elsevier, vol. 52(1), pages 483-501, September.
    2. Hache, Emmanuel & Leboullenger, Déborah & Mignon, Valérie, 2017. "Beyond average energy consumption in the French residential housing market: A household classification approach," Energy Policy, Elsevier, vol. 107(C), pages 82-95.
    3. Koecklin, Manuel Tong & Longoria, Genaro & Fitiwi, Desta Z. & DeCarolis, Joseph F. & Curtis, John, 2021. "Public acceptance of renewable electricity generation and transmission network developments: Insights from Ireland," Energy Policy, Elsevier, vol. 151(C).
    4. Ghosh, Atish R. & Qureshi, Mahvash S. & Kim, Jun Il & Zalduendo, Juan, 2014. "Surges," Journal of International Economics, Elsevier, vol. 92(2), pages 266-285.
      • Mahvash S Qureshi & Mr. Atish R. Ghosh & Mr. Juan Zalduendo & Mr. Jun I Kim, 2012. "Surges," IMF Working Papers 2012/022, International Monetary Fund.
    5. Tomàs Aluja-Banet & Eduard Nafria, 2003. "Stability and scalability in decision trees," Computational Statistics, Springer, vol. 18(3), pages 505-520, September.
    6. Becken, Susanne & Stantic, Bela & Chen, Jinyan & Connolly, Rod M., 2022. "Twitter conversations reveal issue salience of aviation in the broader context of climate change," Journal of Air Transport Management, Elsevier, vol. 98(C).
    7. I. Albarrán & P. Alonso-González & J. M. Marin, 2017. "Some criticism to a general model in Solvency II: an explanation from a clustering point of view," Empirical Economics, Springer, vol. 52(4), pages 1289-1308, June.
    8. Schwartz, Ira M. & York, Peter & Nowakowski-Sims, Eva & Ramos-Hernandez, Ana, 2017. "Predictive and prescriptive analytics, machine learning and child welfare risk assessment: The Broward County experience," Children and Youth Services Review, Elsevier, vol. 81(C), pages 309-320.
    9. Rockstuhl, Sebastian & Wenninger, Simon & Wiethe, Christian & Ahlrichs, Jakob, 2022. "The influence of risk perception on energy efficiency investments: Evidence from a German survey," Energy Policy, Elsevier, vol. 167(C).
    10. Yousaf Muhammad & Dey Sandeep Kumar, 2022. "Best proxy to determine firm performance using financial ratios: A CHAID approach," Review of Economic Perspectives, Sciendo, vol. 22(3), pages 219-239, September.
    11. Tong Koecklin, Manuel & Fitiwi, Desta & de Carolis, Joseph F. & Curtis, John, 2020. "Renewable electricity generation and transmission network developments in light of public opposition: Insights from Ireland," Papers WP653, Economic and Social Research Institute (ESRI).
    12. Ralf Elsner & Manfred Krafft & Arnd Huchzermeier, 2003. "Optimizing Rhenania's Mail-Order Business Through Dynamic Multilevel Modeling (DMLM)," Interfaces, INFORMS, vol. 33(1), pages 50-66, February.
    13. Serrano-Cinca, Carlos & Gutiérrez-Nieto, Begoña & Bernate-Valbuena, Martha, 2019. "The use of accounting anomalies indicators to predict business failure," European Management Journal, Elsevier, vol. 37(3), pages 353-375.
    14. Osman Taylan & Abdulaziz S. Alkabaa & Mustafa Tahsin Yılmaz, 2022. "Impact of COVID-19 on G20 countries: analysis of economic recession using data mining approaches," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-30, December.
    15. Michele Cincera, 2005. "Firms' productivity growth and R&D spillovers: An analysis of alternative technological proximity measures," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 14(8), pages 657-682.
    16. Bas Donkers & Richard Paap & Jedid‐Jah Jonker & Philip Hans Franses, 2006. "Deriving target selection rules from endogenously selected samples," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(5), pages 549-562, July.
    17. Horstmann, Felix, 2017. "Measuring the shopper's attitude toward the point of sale display: Scale development and validation," Journal of Retailing and Consumer Services, Elsevier, vol. 36(C), pages 112-123.
    18. Vicente-Cera, Isaías & Acevedo-Merino, Asunción & Nebot, Enrique & López-Ramírez, Juan Antonio, 2020. "Analyzing cruise ship itineraries patterns and vessels diversity in ports of the European maritime region: A hierarchical clustering approach," Journal of Transport Geography, Elsevier, vol. 85(C).
    19. Edward Kozłowski & Anna Borucka & Andrzej Świderski & Przemysław Skoczyński, 2021. "Classification Trees in the Assessment of the Road–Railway Accidents Mortality," Energies, MDPI, vol. 14(12), pages 1-15, June.
    20. Javad Hassannataj Joloudari & Edris Hassannataj Joloudari & Hamid Saadatfar & Mohammad Ghasemigol & Seyyed Mohammad Razavi & Amir Mosavi & Narjes Nabipour & Shahaboddin Shamshirband & Laszlo Nadai, 2020. "Coronary Artery Disease Diagnosis; Ranking the Significant Features Using a Random Trees Model," IJERPH, MDPI, vol. 17(3), pages 1-24, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:decisn:v:47:y:2020:i:4:d:10.1007_s40622-020-00265-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.