Volume 14 Number 8 (Aug. 2019)
Home > Archive > 2019 > Volume 14 Number 8 (Aug. 2019) >
JCP 2019 Vol.14(8): 541-556 ISSN: 1796-203X
doi: 10.17706/jcp.14.8.541-556

Efficient Mapping of CNNs onto Tightly Coupled Processor Arrays

Christian Heidorn, Michael Witterauf, Frank Hannig, Jürgen Teich
Hardware/Software Co-Design, Friedrich-Alexander University Erlangen-Nü rnberg, Germany.
Abstract—In this work, we show how to systematically map Convolutional Neural Networks (CNNs) onto Tightly Coupled Processor Arrays (TCPAs), a class of massively parallel accelerators for many computationally intensive tasks (e.g., from the digital signal and image processing domain). Contrary to previous approaches and implementations, we propose techniques for the layer-parallel execution of CNNs on processor arrays including the maximally overlapped processing of consecutive layers. This is achieved through layer fusion and loop unrolling to exploit the full pipelining potential of such massively parallel architectures for given CNNs. These transformations are also necessary to decrease the number of on-chip/off-chip data transfers. For CNNs, we present a calculus for achievable performance and memory requirements on TCPAs. Based on this calculus, it is shown how either throughput-maximal mappings can be determined for a given architecture. Alternatively, resource-minimized mappings to süstain a given throughput, e.g., number of frames per second, are systematically derived. The approach is evaluated for a CNN model for the MNIST benchmark on a processor array of size 4x4 including a comparison of the performance of the layer-parallel approach over layer-by-layer processing.

Index Terms—CNN accelerator, TCPA.

[PDF]

Cite: Christian Heidorn, Michael Witterauf, Frank Hannig, Jürgen Teich, "Efficient Mapping of CNNs onto Tightly Coupled Processor Arrays," Journal of Computers vol. 14, no. 8, pp. 541-556, 2019.

General Information

ISSN: 1796-203X
Abbreviated Title: J.Comput.
Frequency: Monthly
Editor-in-Chief: Prof. Liansheng Tan
Executive Editor: Ms. Nina Lee
Abstracting/ Indexing: DBLP, EBSCO,  ProQuest, INSPEC, ULRICH's Periodicals Directory, WorldCat, CNKI,etc
E-mail: jcp@iap.org
  • Nov 14, 2019 News!

    Vol 14, No 11 has been published with online version   [Click]

  • Dec 16, 2019 News!

    Vol 14, No 12 has been published with online version   [Click]

  • Sep 16, 2019 News!

    Vol 14, No 9 has been published with online version   [Click]

  • Aug 16, 2019 News!

    Vol 14, No 8 has been published with online version   [Click]

  • Jul 19, 2019 News!

    Vol 14, No 7 has been published with online version   [Click]

  • Read more>>