On the Support of Task-Parallel Algorithmic Skeletons for Multi-GPU Computing

Citation:
Alexandre, F., R. Marques, and H. Paulino, "On the Support of Task-Parallel Algorithmic Skeletons for Multi-GPU Computing", 28th Annual ACM Symposium on Applied Computing, SAC '14, Gyeongju, South Korea, March 24-28, 2014, ACM, pp. 880-885, 2014.

Abstract:

An emerging trend in the field of Graphics Processing Unit (GPU) computing is the harnessing of multiple devices to cope with scalability and performance requirements. How- ever, multi-GPU execution adds new challenges to the al- ready complex world of General Purpose computing on GPUs (GPGPU), such as the efficient problem decomposition, and dealing with device heterogeneity. To this extent, we pro- pose the use of the Marrow algorithmic skeleton framework (ASkF) to abstract most of the details intrinsic to the pro- gramming of such platforms. To the best of our knowledge, Marrow is the first ASkF to support skeleton nesting on single and (now) multiple GPU systems. In this paper we present how it can transparently distribute the execution of skeleton compositions among a set of, possibly, hetero- geneous devices. An experimental evaluation assesses the proposal’s effectiveness, from a scalability and performance perspective, with good results.

Related External Link