Buttressing volatile desktop grids with cloud resources within a reconfigurable environment service for workflow orchestration

Winter, Stephen, Reynolds, Christopher J., Kiss, Tamas, Terstyanszky, Gabor, Greenwell, Pamela, McEldowney, Sharron, Acs, Sandor and Kacsuk, Peter K. (2014) Buttressing volatile desktop grids with cloud resources within a reconfigurable environment service for workflow orchestration. Journal of Cloud Computing: Advances, Systems and Applications, 3 (1). p. 1. ISSN 2192-113X

Full text not available from this repository.
Official URL: http://dx.doi.org/10.1186/2192-113X-3-1


Cloud technology has the potential for widening access to high-performance computational resources for e-science research, but barriers to engagement with the technology remain high for many scientists. Workflows help overcome barriers by hiding details of underlying computational infrastructure and are portable between various platforms including cloud; they are also increasingly accepted within e-science research communities. Issues arising from the range of workflow systems available and the complexity of workflow development have been addressed by focusing on workflow interoperability, and providing customised support for different science communities. However, the deployments of such environments can be challenging, even where user requirements are comparatively modest. RESWO (Reconfigurable Environment Service for Workflow Orchestration) is a virtual platform-as-a-service cloud model that allows leaner customised environments to be assembled and deployed within a cloud. Suitable distributed computation resources are not always easily affordable and can present a further barrier to engagement by scientists. Desktop grids that use the spare CPU cycles available within an organisation are an attractively inexpensive type of infrastructure for many, and have been effectively virtualised as a cloud-based resource. However, hosts in this environment are volatile: leading to the tail problem, where some tasks become randomly delayed, affecting overall performance. To solve this problem, new algorithms have been developed to implement a cloudbursting scheduler in which durable cloud-based CPU resources may execute replicas of jobs that have become delayed. This paper describes experiences in the development of a RESWO instance in which a desktop grid is buttressed with CPU resources in the cloud to support the aspirations of bioscience researchers. A core component of the architecture, the cloudbursting scheduler, implements an algorithm to perform late job detection, cloud resource management and job monitoring. The experimental results obtained demonstrate significant performance improvements and benefits illustrated by use cases in bioscience research.

Item Type: Article
Subjects: University of Westminster > Science and Technology > Life Sciences, School of (No longer in use)
University of Westminster > Science and Technology > Electronics and Computer Science, School of (No longer in use)
Depositing User: Miss Nina Watts
Date Deposited: 27 Feb 2014 16:26
Last Modified: 27 Feb 2014 16:26
URI: http://westminsterresearch.wmin.ac.uk/id/eprint/13692

Actions (login required)

Edit Item (Repository staff only) Edit Item (Repository staff only)