IADIS International Journal on Computer Science and Information Systems

Published by IADIS (International Association for Development of the Information Society) • ISSN (Online): 1646-3692 • ISSN (Print): 1646-3692
100% Open Access
Double-Blind Peer Review
Crossref DOI Persistent IDs
Open Access Peer-Reviewed Original Research

Feasibility Analysis of Using the Maui Scheduler for Job Simulation of Large-scale Pbs Based Clusters

Georg Zitzlsberger *
Branislav Jansík *
Jan Martinovič *
* IT4Innovations, VŠB - Technical University of Ostrava, Czech Republic (Portugal)
* IT4Innovations, VŠB - Technical University of Ostrava, Czech Republic (Portugal)
* IT4Innovations, VŠB - Technical University of Ostrava, Czech Republic (Portugal)

Abstract

For large -scale High Performance Computing centers with a wide range of different projects and heterogeneous infrastructures, efficiency is an important consideration. Understanding how compute jobs are scheduled is necessary for improving the job scheduli ng strategies in order to optimize cluster utilization and job wait times. This increases the importance of a reliable simulation capability, which in turn requires accuracy and comparability with historic workloads from the cluster. Not all job schedulers have a simulation capability, including the Portable Batch System (PBS) resource manager. Hence, PBS based centers have no direct way to simulate changes and optimizations before they are applied to the production system. We propose and discuss how to run job simulations for large-scale PBS based clusters with the Maui Scheduler. This also includes awareness of node downtimes, scheduled and unexpected. For validation purposes, we use historic workloads collected at the IT4In novations supercomputing center. The viability of our approach is demonstrated by measuring the accuracy of the simulation results compared to the real workloads. In addition, we discuss how the change of the simulator’s time step resolution affects the accuracy as well as simulation tim es. We are confident that our approach is also transferable to enable job simulations for other computing centers using PBS.

Keywords

High Performance Computing (HPC) Simulation PBS Maui Scheduler Job Scheduling
Full-Text PDF Available

Read Complete Peer-Reviewed Manuscript

Includes full econometric models, data tables, policy recommendations, declarations, and citations.

Declarations & Ethics

Funding: This research received academic dissemination support through ESCAP / JournalsHub publishing programs.
Conflicts of Interest: The authors declare no competing financial or institutional interests.
Peer Review: Double-blind peer reviewed by international subject specialists.
License: Creative Commons Attribution 4.0 International (CC BY 4.0).
How to Cite This Article
APA / MLA / BibTeX
Zitzlsberger, et al. (2018). Feasibility Analysis of Using the Maui Scheduler for Job Simulation of Large-scale Pbs Based Clusters. IADIS International Journal on Computer Science and Information Systems, 13(2). https://doi.org/10.33965/ijcsis_2018_v13i2_05
Zitzlsberger, et al. "Feasibility Analysis of Using the Maui Scheduler for Job Simulation of Large-scale Pbs Based Clusters." IADIS International Journal on Computer Science and Information Systems, vol. 13, no. 2, 2018. https://doi.org/10.33965/ijcsis_2018_v13i2_05
Zitzlsberger, et al. "Feasibility Analysis of Using the Maui Scheduler for Job Simulation of Large-scale Pbs Based Clusters." IADIS International Journal on Computer Science and Information Systems 13, no. 2 (2018). https://doi.org/10.33965/ijcsis_2018_v13i2_05