A Scheduler based on Resource Competition for Parameter Sweep Workflow

Smanchat, Sucha, Indrawan, Maria, Ling, Sea, Enticott, Colin and Abramson, David (2011). A Scheduler based on Resource Competition for Parameter Sweep Workflow. In: Proceedings of the International Conference on Computational Science, ICCS 2011. 11th International Conference on Computational Science, ICCS 2011, Singapore Singapore, (176-185). 01-03 June 2011. doi:10.1016/j.procs.2011.04.019


Author Smanchat, Sucha
Indrawan, Maria
Ling, Sea
Enticott, Colin
Abramson, David
Title of paper A Scheduler based on Resource Competition for Parameter Sweep Workflow
Conference name 11th International Conference on Computational Science, ICCS 2011
Conference location Singapore Singapore
Conference dates 01-03 June 2011
Proceedings title Proceedings of the International Conference on Computational Science, ICCS 2011   Check publisher's open access policy
Journal name Procedia Computer Science   Check publisher's open access policy
Place of Publication Amsterdam, The Netherlands
Publisher Elsevier BV
Publication Year 2011
Year available 2011
Sub-type Fully published paper
DOI 10.1016/j.procs.2011.04.019
ISSN 1877-0509
Volume 4
Start page 176
End page 185
Total pages 10
Collection year 2012
Language eng
Formatted Abstract/Summary
Grid workflow scheduling has been a prevalent field of research in order to allocate scientific workflow tasks to grid resources. To actuate these grid workflow scheduling algorithms, schedulers need to be developed for grid workflow management systems. A scheduler is a component that gathers information, such as estimated execution times and lists of available grid resources, as inputs for scheduling algorithms. Once a grid schedule is generated, the scheduler uses it to allocate grid resources to the tasks in the workflow. This is even more complicated for parameter sweep workflow scheduling. As parameter sweep workflows are repeatedly executed a number of times with different inputs, to schedule them in parallel, the scheduler must be able to handle multiple workflow instances and multiple scheduling iterations. In this paper, we present a scheduling algorithm for parameter sweep workflows and suggest an implementation of a scheduler for parameter sweep workflows based on the algorithms. We highlight the implementation issues encountered in our experience of scheduler development
Keyword Grid workflow
Workflow scheduler
Workflow scheduling algorithm
Parameter sweep
Resource competition
Q-Index Code E1
Q-Index Status Provisional Code
Institutional Status Non-UQ

 
Versions
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 3 times in Thomson Reuters Web of Science Article | Citations
Scopus Citation Count Cited 3 times in Scopus Article | Citations
Google Scholar Search Google Scholar
Created: Tue, 22 Oct 2013, 11:50:57 EST by Ms Diana Cassidy on behalf of Research Computing Centre