WestminsterResearch

Utilizing heterogeneous data sources in computational grid workflows

Kiss, Tamas and Tudose, Alexandru and Terstyanszky, Gabor and Kacsuk, Peter K. and Sipos, Gergely (2008) Utilizing heterogeneous data sources in computational grid workflows. In: Danelutto, Marco and Fragopoulou, Paraskevi and Getov, Vladimir, (eds.) Making grids work: Proceedings of the CoreGRID Workshop on Programming Models Grid and P2P System Architecture Grid Systems, Tools and Environments 12-13 June 2007, Heraklion, Crete, Greece. Springer, pp. 225-236. ISBN 9780387784472

Full text not available from this repository.

Official URL: http://dx.doi.org/10.1007/978-0-387-78448-9_18

Abstract

Besides computation intensive tasks, the Grid also facilitates sharing and processing very large databases and file systems that are distributed over multiple resources and administrative domains. Although accessing data in the Grid is supported by various lower level tools, end-users find it difficult to utilise these solutions directly. High level environments, such as Grid portal and workflow solutions provide little or no support for data access and manipulation. Workflow systems are widely utilised in Grid computing to automate computational tasks. Unfortunately, the ways of feeding data into these workflows is limited and in most cases requires additional tools and manual intervention. This paper describes how data can be fed into computational workflows from heterogeneous data sources. The P-GRADE Grid portal and workflow engine have been integrated with the SDSC Storage Resource Broker (SRB) in order to access SRB data resources as inputs and outputs of workflow components. The solution automates data interaction in computational workflows allowing users to seamlessly access and process data stored in SRB resources. The implemented solution also enables the seamless interoperation of SRB, SRM (Storage Resource Manager) and GridFTP file catalogues.

Item Type:Book Section
Uncontrolled Keywords:Grid workflow, SRB, P-GRADE portal, interoperation, data management
Research Community:University of Westminster > Electronics and Computer Science, School of
ID Code:6826
Deposited On:07 May 2009 15:46
Last Modified:07 May 2009 15:46

Repository Staff Only: item control page