Reynolds, Christopher J. and Winter , Stephen and Terstyanszky, Gabor and Kiss, Tamas and Greenwell, Pamela and Acs, Sandor and Kacsuk, Peter K. (2011) Scientific workflow makespan reduction through cloud augmented desktop grids. In: 2011 IEEE 3rd International Conference on Cloud Computing Technology and Science. IEEE, pp. 18-23. ISBN 9781467300902Full text not available from this repository.
Scientific workflows are common in biomedical research, particularly for molecular docking simulations such as those used in drug discovery. Such workflows typically involve data distribution between computationally demanding stages which are usually mapped onto large scale compute resources. Volunteer or Desktop Grid (DG) computing can provide such infrastructure but has limitations resulting from the heterogeneous nature of the compute nodes. These constraints mean that reducing the make span of a given workflow stage submitted to a DG becomes problematic. Late jobs can significantly affect the make span, often completing long after the bulk of the computation has finished. In this paper we present a system capable of significantly reducing the make span of a scientific workflow. Our system comprises a DG which is dynamically augmented with an infrastructure as a service (IaaS) Cloud. Using this solution, the Cloud resources are used to process replicated late jobs. Our system comprises a core component termed the scheduler, which implements an algorithm to perform late job detection, Cloud resource management (instantiation and reuse), and job monitoring. We offer a formal definition of this algorithm, whilst we also provide an evaluation of our prototype using a production scientific workflow.
|Item Type:||Book Section|
|Additional Information:||CloudCom 2011, 3rd IEEE International Conference on Cloud Computing Technology and Science, 29 November – 1 December, Athens, Greece|
|Subjects:||University of Westminster > Science and Technology > Electronics and Computer Science, School of (No longer in use)|
|Depositing User:||Rachel Wheelhouse|
|Date Deposited:||30 Apr 2012 15:03|
|Last Modified:||30 Apr 2012 15:03|
Actions (login required)
|Edit Item (Repository staff only)|