IDEAS home Printed from https://ideas.repec.org/a/ibn/masjnl/v12y2018i8p69.html
   My bibliography  Save this article

An Overview of Hadoop Scheduler Algorithms

Author

Listed:
  • Faten Hamad

Abstract

Hadoop is a cloud computing open source system, used in large-scale data processing. It became the basic computing platforms for many internet companies. With Hadoop platform users can develop the cloud computing application and then submit the task to the platform. Hadoop has a strong fault tolerance, and can easily increase the number of cluster nodes, using linear expansion of the cluster size, so that clusters can process larger datasets. However Hadoop has some shortcomings, especially in the actual use of the process of exposure to the MapReduce scheduler, which calls for more researches on Hadoop scheduling algorithms.This survey provides an overview of the default Hadoop scheduler algorithms and the problem they have. It also compare between five Hadoop framework scheduling algorithms in term of the default scheduler algorithm to be enhanced, the proposed scheduler algorithm, type of cluster applied either heterogeneous or homogeneous, methodology, and clusters classification based on performance evaluation. Finally, a new algorithm based on capacity scheduling and use of perspective resource utilization to enhance Hadoop scheduling is proposed.

Suggested Citation

  • Faten Hamad, 2018. "An Overview of Hadoop Scheduler Algorithms," Modern Applied Science, Canadian Center of Science and Education, vol. 12(8), pages 1-69, August.
    • Handle: RePEc:ibn:masjnl:v:12:y:2018:i:8:p:69
    as

    Download full text from publisher

    File URL: https://ccsenet.org/journal/index.php/mas/article/download/76188/42456
    Download Restriction: no
    File URL: https://ccsenet.org/journal/index.php/mas/article/view/76188
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rizik Al-Sayyed & Hussam N. Fakhouri & Ali Rodan & Colin Pattinson, 2017. "Polar Particle Swarm Algorithm for Solving Cloud Data Migration Optimization Problem," Modern Applied Science, Canadian Center of Science and Education, vol. 11(8), pages 1-98, August.
    2. Faten Hamad & Omar Adwan, 2018. "Policy Based Approach for Information Transfer over Mobile ad hoc Network using Messages Privacy Control," Modern Applied Science, Canadian Center of Science and Education, vol. 12(5), pages 1-22, May.
    3. Faten Hamad & Abdelsalam Alawamrah, 2018. "Measuring the Performance of Parallel Information Processing in Solving Linear Equation Using Multiprocessor Supercomputer," Modern Applied Science, Canadian Center of Science and Education, vol. 12(3), pages 1-74, March.
    4. Adel Al Khattab & Hasan Al-Shalabi & Khamis Al-Khattab & Mahmaod Al-Rawad, 2015. "The effect of trust and risk perception on citizen's intention to adopt and use e-government services in Jordan," Proceedings of International Academic Conferences 1003157, International Institute of Social and Economic Sciences.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Faten Hamad, 2018. "Using Artificial Bee Colony Algorithm for Test Data Generation and Path Testing Coverage," Modern Applied Science, Canadian Center of Science and Education, vol. 12(7), pages 1-99, July.
    2. Faten hamad, 2018. "An Overview of Service Composition in Service Oriented Architecture," Modern Applied Science, Canadian Center of Science and Education, vol. 12(8), pages 172-172, August.
    3. Chiang Ku Fan & Chen-Ying Lee, 2023. "An Empirical Study of Internet Insurance in Taiwan Adopting the Theoretical Framework of UTAUT2," Journal of Applied Finance & Banking, SCIENPRESS Ltd, vol. 13(5), pages 1-1.
    4. Mehree Iqbal & Afrin Rifat & Nabila Nisha, 2021. "Evaluating Attractiveness and Perceived Risks: The Case of Green Banking Services in Bangladesh," International Journal of Asian Business and Information Management (IJABIM), IGI Global, vol. 12(1), pages 1-23, January.
    5. Shakir Hussain Parrey & Suhail Ahmad Bhat, 2019. "Individual risk propensity and agri-entrepreneurial financing effectiveness: strategy for sustainable agri-financing," DECISION: Official Journal of the Indian Institute of Management Calcutta, Springer;Indian Institute of Management Calcutta, vol. 46(1), pages 75-90, March.
    6. Hussam N. Fakhouri & Saleh H. Al-Sharaeh, 2018. "A Hybrid Methodology for Automation the Diagnosis of Leukemia Based on Quantitative and Morphological Feature Analysis," Modern Applied Science, Canadian Center of Science and Education, vol. 12(3), pages 1-56, March.
    7. Amjad A. Hudaib & Hussam N. Fakhouri, 2018. "Supernova Optimizer: A Novel Natural Inspired Meta-Heuristic," Modern Applied Science, Canadian Center of Science and Education, vol. 12(1), pages 1-32, January.

    More about this item

    JEL classification:

    • R00 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - General - - - General
    • Z0 - Other Special Topics - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ibn:masjnl:v:12:y:2018:i:8:p:69. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Canadian Center of Science and Education (email available below). General contact details of provider: https://edirc.repec.org/data/cepflch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.