23/06/2021

DeepCuts: A Deep Learning Optimization Framework for Versatile GPU Workloads

Wookeun Jung, Thanh Tuan Dao, Jaejin Lee

Keywords: GPU, Deep Learning, Code Generation

Abstract Paper Code Similar Papers

Abstract: Widely used Deep Learning (DL) frameworks, such as TensorFlow, PyTorch, and MXNet, heavily rely on the NVIDIA cuDNN for performance. However, using cuDNN does not always give the best performance. One reason is that it is hard to handle every case of versatile DNN models and GPU architectures with a library that has a fixed implementation. Another reason is that cuDNN lacks kernel fusion functionality that gives a lot of chances to improve performance. In this paper, we propose a DL optimization framework for versatile GPU workloads, called DeepCuts. It considers both kernel implementation parameters and GPU architectures. It analyzes the DL workload, groups multiple DL operations into a single GPU kernel, and generates optimized GPU kernels considering kernel implementation parameters and GPU architecture parameters. The evaluation result with various DL workloads for inference and training indicates that DeepCuts outperforms cuDNN/cuBLAS-based implementations and the state-of-the-art DL optimization frameworks, such as TVM, TensorFlow XLA, and TensorRT.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38956263
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at PLDI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 15:00 
 0
 0
 0
 0
 20:00 
 0
 0
 0
 0
 5:17 
 0
 0
 0
 0
 3:16 
 0
 0
 0
 0
 20:10 
 0
 0
 0
 0
 23:04 
 0
 0
 0
 0
 12:14 
 0
 0
 0
 0
 13:21 
 0
 0
 1
 0
 3:23 
 0
 0
 0
 0
 5:27 
 0
 0
 0
 0
 15:30 
 0
 0
 0
 0
 4:48 
 0
 0
 0
 0
 16:30 
 0
 0
 0
 0
 12:48 
 0
 0
 0
 0
 18:06 
 0
 0
 0
 0
 0:50 
 0
 0
 0
 0
 3:28 
 0
 0
 0
 0
 11:00 
 0
 0
 0
 0
 3:32 
 0
 0
 0
 0
 15:47 
 0
 0
 0
 0
 2:57 
 0
 0
 0
 0
 4:14 
 0
 0
 0
 0
 4:52 
 1
 0
 0
 1
 14:32 
 0
 0
 0
 0
 12:53 
 0
 0
 0
 0
 11:59 
 0
 0
 0
 0
 19:36 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 3:16 
 0
 0
 0
 0
 14:11 
 0
 0
 0
 0
 19:14 
 0
 0
 0
 0
 21:49 
 0
 0
 0
 0
 14:38 
 0
 0
 0
 0
 4:57 
 0
 0
 0
 0
 5:05 
 0
 0
 0
 0
 4:52 
 0
 0
 0
 0
 5:09 
 0
 0
 0
 0
 3:34 
 0
 0
 0
 0
 2:56 
 0
 0
 0
 0
 0:50