2011
EMSS 2011 Proceeding
Improving Job Scheduling on a Heterogeneous Cluster by Predicting Job Execution Times Using Heuristics
Authors: Hannes Brandstätter-Müller, Bahram Parsapour, Andreas Hölzlwimmer, Gerald Lirk, Peter Kulczycki
Abstract
In this paper, we propose the scheduling system for the Bioinformatics Resource Facility Hagenberg (BiRFH). This system takes advantage of the fact that the facility offers tailored solutions for the customers, which includes having a limited amount of different programs available. Additionally, the BiRFH system provides access to dif- ferent hardware platforms (standard CPU, GPGPU on NVIDIA Cuda, and IMB Cell on Sony Playstation ma- chines) with multiple versions of the same algorithm opti- mized for these platforms. The BiRFH scheduling system takes these into account and uses knowledge about past runs and run times to predict the expected run time of a job. That leads to a better scheduling and resource usage. The prediction and scheduling use heuristic and artificial intelligence methods to achieve acceptable results. The paper presents the proposed prediction method as well as an overview of the scheduling algorithm.
I3M Scientific Sponsors
I3M Industrial Sponsors
I3M Media Sponsors
