Jacket MGL: Single Node, Multiple GPUs

From Jacket Wiki

Back to the Main Page

Introduction

Computers with multiple GPUs exist all the way from laptops to special 8 GPU computation servers, which were announced late 2009. It is worth noting that the MATLAB Parallel Computing Toolbox (PCT) as well as the Jacket MGL allow up to 8 workers (for Jacket this translates to 8 GPUs). Jacket provides support for MATLAB constructs such as PARFOR and SPMD. PARFOR is an easy way to parallelize a for-loop

Fig. 1: Illustration of Jacket MGL used on a single computing node.	Fig. 1: Illustration of Jacket MGL used on a single computing node.
Fig. 1: Illustration of Jacket MGL used on a single computing node.	Fig. 1: Illustration of Jacket MGL used on a single computing node.

Fig. 1: Illustration of Jacket MGL used on a single computing node.

Fig. 1: Illustration of Jacket MGL used on a single computing node.

Programming Principles

Example 1: PARFOR Usage

Example 2: SPMD Usage

MATLABs SPMD (Single Program Multiple Data) is a way to get computations done for the same program with multiple data. But in reality it is more general than that as it is also possible to apply multiple programs to multiple data.

Performance Considerations

Limitations

Further Reading