WestminsterResearch

Scientific workflow makespan reduction through cloud augmented desktop grids

Reynolds, Christopher J. and Winter , Stephen and Terstyanszky, Gabor and Kiss, Tamas and Greenwell, Pamela and Acs, Sandor and Kacsuk, Peter K. (2011) Scientific workflow makespan reduction through cloud augmented desktop grids. In: 2011 IEEE 3rd International Conference on Cloud Computing Technology and Science. IEEE, pp. 18-23. ISBN 9781467300902

Full text not available from this repository.

Official URL: http://dx.doi.org/10.1109/CloudCom.2011.13

Abstract

Scientific workflows are common in biomedical research, particularly for molecular docking simulations such as those used in drug discovery. Such workflows typically involve data distribution between computationally demanding stages which are usually mapped onto large scale compute resources. Volunteer or Desktop Grid (DG) computing can provide such infrastructure but has limitations resulting from the heterogeneous nature of the compute nodes. These constraints mean that reducing the make span of a given workflow stage submitted to a DG becomes problematic. Late jobs can significantly affect the make span, often completing long after the bulk of the computation has finished. In this paper we present a system capable of significantly reducing the make span of a scientific workflow. Our system comprises a DG which is dynamically augmented with an infrastructure as a service (IaaS) Cloud. Using this solution, the Cloud resources are used to process replicated late jobs. Our system comprises a core component termed the scheduler, which implements an algorithm to perform late job detection, Cloud resource management (instantiation and reuse), and job monitoring. We offer a formal definition of this algorithm, whilst we also provide an evaluation of our prototype using a production scientific workflow.

Item Type:Book Section
Additional Information:CloudCom 2011, 3rd IEEE International Conference on Cloud Computing Technology and Science, 29 November – 1 December, Athens, Greece
Research Community:University of Westminster > Electronics and Computer Science, School of
ID Code:10465
Deposited On:30 Apr 2012 16:03
Last Modified:30 Apr 2012 16:03

Repository Staff Only: item control page