Utilizing heterogeneous data sources in computational grid workflows

Kiss, Tamas and Tudose, Alexandru and Terstyanszky, Gabor and Kacsuk, Peter K. and Sipos, Gergely (2008) Utilizing heterogeneous data sources in computational grid workflows. In: Making grids work: Proceedings of the CoreGRID Workshop on Programming Models Grid and P2P System Architecture Grid Systems, Tools and Environments 12-13 June 2007, Heraklion, Crete, Greece. Springer, pp. 225-236. ISBN 9780387784472

Full text not available from this repository.
Official URL: http://dx.doi.org/10.1007/978-0-387-78448-9_18


Besides computation intensive tasks, the Grid also facilitates sharing and processing very large databases and file systems that are distributed over multiple resources and administrative domains. Although accessing data in the Grid is supported by various lower level tools, end-users find it difficult to utilise these solutions directly. High level environments, such as Grid portal and workflow solutions provide little or no support for data access and manipulation. Workflow systems are widely utilised in Grid computing to automate computational tasks. Unfortunately, the ways of feeding data into these workflows is limited and in most cases requires additional tools and manual intervention. This paper describes how data can be fed into computational workflows from heterogeneous data sources. The P-GRADE Grid portal and workflow engine have been integrated with the SDSC Storage Resource Broker (SRB) in order to access SRB data resources as inputs and outputs of workflow components. The solution automates data interaction in computational workflows allowing users to seamlessly access and process data stored in SRB resources. The implemented solution also enables the seamless interoperation of SRB, SRM (Storage Resource Manager) and GridFTP file catalogues.

Item Type: Book Section
Uncontrolled Keywords: Grid workflow, SRB, P-GRADE portal, interoperation, data management
Subjects: University of Westminster > Science and Technology > Electronics and Computer Science, School of (No longer in use)
Depositing User: Miss Nina Watts
Date Deposited: 07 May 2009 14:46
Last Modified: 07 May 2009 14:46
URI: http://westminsterresearch.wmin.ac.uk/id/eprint/6826

Actions (login required)

Edit Item (Repository staff only) Edit Item (Repository staff only)