JCSE, vol. 16, no. 2, pp.105-112, June, 2022

DOI: http://dx.doi.org/10.5626/JCSE.2022.16.2.105

Regularized Convolutional Neural Network for Highly Effective Parallel Processing

Sang-Soo Park and Ki-Seok Chung
Department of Electronic Engineering, Hanyang University, Seoul, Korea

Abstract: Convolutional neural network (CNN) has been adopted in various areas. Using graphics processing unit (GPU), speed improvement can be achieved on CNN, and many studies have proposed such acceleration methods. However, parallelizing the CNN on GPU is not straightforward because there are irregular characteristics in generating output feature maps.in typical CNN models. In this paper, we propose a method that maximizes the utilization of GPU by modifying convolution combinations of a well-known CNN network, LeNet-5. Our regularized implementation on a heterogeneous system has achieved an improvement of up to 37.26 times in convolution and sub-sampling layers. Further, an energy consumption reduction of up to 26.40 times is achieved.

Keyword: Heterogenous system; GPGPU; Parallel processing; OCR; Diverse branch

Full Paper:   115 Downloads, 616 View