GridMate The Grid Matlab Extension

Größe: px

Ab Seite anzeigen:

Download "GridMate The Grid Matlab Extension"

Hannah Hoch
vor 9 Jahren
Abrufe

1 GridMate The Grid Matlab Extension Forschungszentrum Karlsruhe, Institute for Data Processing and Electronics T. Jejkal, R. Stotzka, M. Sutter, H. Gemmeke 1

2 What is the Motivation? Graphical development environment High-level interpreter language Rapid algorithm development Increasing complexity of algorithms Local computation not realizable in acceptable time frame But for the Matlab user the traditional Grid is: Complex Hard to use 2 T.Jejkal IPE

3 What are the goals? Composition of Matlab and Grid For the user: Seamless integration into the users working environment Intuitive and easy parallelization of arbitrary algorithms Least intrusive to existing code For the underlying Grid architecture: Dynamical extensibility Return immediate response Support interactivity 3 T.Jejkal IPE

4 The Grid architecture GT4 MDS Index Server register request GT4 Worker Node N User GT4 Worker Node Client connect GT4 Container File System Service Oriented Grid Architecture (SOGA) Standard Globus WS-Core extended by some services Functionalities implemented as WSRF-compliant Web services Platform independent on client and server side WSRF: Web Services Resource Framework 4 T.Jejkal IPE

5 Design of GridMate - Client Integrated into Matlab as toolbox Functionality implemented in Java Can be used stand-alone Broker between Matlab user and SOGA No direct contact between user and Grid 5 T.Jejkal IPE

Design of GridMate - Server WSRF-compliant Web services Factory Service for management tasks Function database to hold functions Instance Service for

6 Design of GridMate - Server WSRF-compliant Web services Factory Service for management tasks Function database to hold functions Instance Service for computation Streaming Provider for data transfer Object Database to hold arguments MRE to execute Matlab code MRE: Matlab Runtime Environment 6 T.Jejkal IPE

7 Application 1 Characteristics Application Type: 3D volume reconstruction Input: 2D signal data 20 datasets, approx. 23 MB each Special Feature: Highly optimized Matlab code Partly implemented in C and assembly code 7 T.Jejkal IPE

8 Application 1 Introducing GridMate initreconstruction(); for 1 : signals loadsignal(); addsignaltovolume(<arguments>); end; connect(); initfunction('addsignaltovolume', nodes); initreconstruction(); for 1 : signals loadsignal(); runfunction(<arguments>); end; for 1 : nodes downloadresult(); end; Original / Unmodified code Slightly modified code New code Original code Using GridMate 8 T.Jejkal IPE

9 Application 1 Performance Measurement Local: Intel P4 3.2 GHz, 2 GB Ram, 100 Mbit Network, Windows XP Grid: VM@Intel Xeon, 2 GB Ram, 100 Mbit Network, OpenSUSE 10.3 [hh:mm:ss] 00:57:36 00:50:24 00:43:12 00:36:00 00:28:48 Waiting Execution Transfer 00:21:36 00:14:24 00:07:12 00:00:00 1 1,28 1,76 2,14 4,00 Local Grid (3 Nodes) Grid (4 Nodes) Grid (5 Nodes) Grid (10 Nodes) 9 T.Jejkal IPE

10 Application 2 Characteristics Application Type: Digital image correlation Input: 2D images 17 images, approx. 20 MB each Special Feature: Images must be processed synchronously Each node needs each image (5.4 GB for 16 Nodes) 10 T.Jejkal IPE

11 Application 2 Performance Measurement (1) Local: Intel Core2Quad 6600, 8 GB Ram, 100 Mbit Network, OpenSUSE 10.3 Grid: VM@Intel Xeon, 2 GB Ram, 100 Mbit Network, OpenSUSE 10.3 [hh:mm:ss] 00:50:24 00:43:12 00:36:00 00:28:48 00:21:36 Waiting Execution Transfer 00:14:24 00:07:12 00:00:00 1 1,34 2,4 2,76 Local Grid (3 Nodes) Grid (6 Nodes) Grid (8 Nodes) 11 T.Jejkal IPE

12 Application 2 Performance Measurement (2) Local: Intel Core2Quad 6600, 8 GB Ram, 100 Mbit Network, OpenSUSE 10.3 Grid: VM@Intel Xeon, 2 GB Ram, 100 Mbit Network, OpenSUSE 10.3 [hh:mm:ss] 09:36:00 08:24:00 07:12:00 06:00:00 04:48:00 Waiting Execution Transfer 03:36:00 02:24:00 01:12:00 00:00:00 1 7,63 Local Grid (16 Nodes) 12 T.Jejkal IPE

13 Conclusions Realized goals: Seamless integration into the users working environment Intuitive and easy parallelization of arbitrary algorithms Dynamically extensible Immediate response and interactively accessible Future work: Integrate access to Grid storage solutions Realize checkpoint system to increase fault tolerance 13 T.Jejkal IPE

Ähnliche Dokumente

Customer-specific software for autonomous driving and driver assistance (ADAS)

This press release is approved for publication. Press Release Chemnitz, February 6 th, 2014 Customer-specific software for autonomous driving and driver assistance (ADAS) With the new product line Baselabs