Computing and Library Services - delivering an inspiring information environment

Dynamic Load Balancing on Multi-GPUs System for Big Data Processing

Zhang, Chaolong, Xu, Yuanping, Zhou, Jiliu, Xu, Zhijie, Lu, Li and Lu, Jun (2017) Dynamic Load Balancing on Multi-GPUs System for Big Data Processing. Proceedings of the 23rd International Conference on Automation & Computing, (University of Huddersfield, 7-8 September 2017). ISSN 9780701702618

PDF (IEEE ICAC’17 Conference Paper (EI Indexed)) - Accepted Version
Download (356kB) | Preview


The powerful parallel computing capability of modern GPU (Graphics Processing Unit) processors has attracted increasing attentions of researchers and engineers who had conducted a large number of GPU-based acceleration research projects. However, current single GPU based solutions are still incapable of fulfilling the real-time computational requirements from the latest big data applications. Thus, the multi-GPU solution has become a trend for many real-time application attempts. In those cases, the computational load balancing over the multiple GPU nodes is often the key bottleneck that needs to be further studied to ensure the best possible performance. The existing load balancing approaches are mainly based on the assumption that all GPUs in the same system provide equal computational performance, and had fallen short to address the situations from heterogeneous multi-GPU systems. This paper presents a novel dynamic load balancing model for heterogeneous multi-GPU systems based on the fuzzy neural network (FNN) framework. The devised model has been implemented and demonstrated in a case study for improving the computational performance of a two dimensional (2D) discrete wavelet transform (DWT). Experiment results show that this dynamic load balancing model has enabled a high computational throughput that can satisfy the real-time and accuracy requirements from many big data processing applications.

Item Type: Article
Additional Information: © 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Uncontrolled Keywords: Multi-GPU; Load balancing; Fuzzy neural network; DWT
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Q Science > QA Mathematics > QA76 Computer software
Schools: School of Computing and Engineering > High-Performance Intelligent Computing > Visualisation, Interaction and Vision
Related URLs:
Depositing User: Zhijie Xu
Date Deposited: 10 Oct 2017 08:07
Last Modified: 28 Aug 2021 15:31


Downloads per month over past year

Repository Staff Only: item control page

View Item View Item

University of Huddersfield, Queensgate, Huddersfield, HD1 3DH Copyright and Disclaimer All rights reserved ©