Mixing grids and clouds: high-throughput science using the Nimrod tool family

Bethwaite, Blair, Abramson, David, Bohnert, Fabian, Garic, Slavisa, Enticott, Colin and Peachey, Tom (2010). Mixing grids and clouds: high-throughput science using the Nimrod tool family. In Nick Antonopoulos and Lee Gillam (Ed.), Cloud Computing: Principles, Systems and Applications (pp. 219-237) London, United Kingdom: Springer -Verlag. doi:10.1007/978-1-84996-241-4_13

Attached Files (Some files may be inaccessible until you login with your UQ eSpace credentials)
Name Description MIMEType Size Downloads

Author Bethwaite, Blair
Abramson, David
Bohnert, Fabian
Garic, Slavisa
Enticott, Colin
Peachey, Tom
Title of chapter Mixing grids and clouds: high-throughput science using the Nimrod tool family
Title of book Cloud Computing: Principles, Systems and Applications
Place of Publication London, United Kingdom
Publisher Springer -Verlag
Publication Year 2010
Sub-type Research book chapter (original research)
DOI 10.1007/978-1-84996-241-4_13
Series Computer Communications and Networks Series
ISBN 9781849962407
9781849962414
ISSN 1617-7975
Editor Nick Antonopoulos
Lee Gillam
Chapter number 13
Start page 219
End page 237
Total pages 19
Total chapters 21
Language eng
Abstract/Summary The Nimrod tool family facilitates high-throughput science by allowing researchers to explore complex design spaces using computational models. Users are able to describe large experiments in which models are executed across changing input parameters. Different members of the tool family support complete and partial parameter sweeps, numerical search by non-linear optimisation and even workflows. In order to provide timely results and to enable large-scale experiments, distributed computational resources are aggregated to form a logically single high-throughput engine. To date, we have leveraged grid middleware standards to spawn computations on remote machines. Recently, we added an interface to Amazon’s Elastic Compute Cloud (EC2), allowing users to mix conventional grid resources and clouds. A range of schedulers, from round-robin queues to those based on economic budgets, allow Nimrod to mix and match resources. This provides a powerful platform for computational researchers, because they can use a mix of university-level infrastructure and commercial clouds. In particular, the system allows a user to pay money to increase the quality of the research outcomes and to decide exactly how much they want to pay to achieve a given return. In this chapter, we will describe Nimrod and its architecture, and show how this naturally scales to incorporate clouds. We will illustrate the power of the system using a case study and will demonstrate that cloud computing has the potential to enable high-throughput science.
Q-Index Code B1
Q-Index Status Provisional Code
Institutional Status Non-UQ

 
Versions
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 7 times in Thomson Reuters Web of Science Article | Citations
Google Scholar Search Google Scholar
Created: Wed, 23 Oct 2013, 00:00:23 EST by Ms Diana Cassidy on behalf of School of Information Technol and Elec Engineering