30/11/2020

Towards Optimal Filter Pruning with Balanced Performance and Pruning Speed

Dong Li, Sitong Chen, Xudong Liu, Yunda Sun, Li Zhang

Keywords:

Abstract Paper Similar Papers

Abstract: Filter pruning has drawn more attention since resource constrained platform requires more compact model for deployment. However, current pruning methods suffer either from the inferior performance of one-shot methods, or the expensive time cost of iterative training methods. In this paper, we propose a balanced filter pruning method for both performance and pruning speed. Based on the filter importance criteria, our method is able to prune a layer with approximate layer-wise optimal pruning rate at preset loss variation. The network is pruned in the layer-wise way without the time consuming prune-retrain iteration. If a pre-defined pruning rate for the entire network is given, we also introduce a method to find the corresponding loss variation threshold with fast converging speed. Moreover, we propose the layer group pruning and channel selection mechanism for channel alignment in network with short connections. The proposed pruning method is widely applicable to common architectures and does not involve any additional training except the final fine-tuning. Comprehensive experiments show that our method outperforms many state-of-the-art approaches.

The video of this talk cannot be embedded. You can watch it here:
https://accv2020.github.io/miniconf/poster_617.html
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at ACCV 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 1:01 
 0
 0
 0
 1
 9:32 
 0
 0
 0
 0
 14:38 
 0
 0
 0
 0
 8:30 
 0
 0
 0
 0
 0:59 
 0
 0
 0
 0
 5:05 
 0
 0
 0
 0
 9:27 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 4:57 
 0
 0
 0
 0
 5:23 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 5:22 
 0
 0
 0
 0
 3:05 
 0
 0
 0
 0
 12:41 
 0
 0
 0
 0
 13:43 
 0
 0
 0
 0
 5:06 
 0
 0
 0
 0
 2:58 
 0
 0
 0
 1
 1:01 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 1
 6:22 
 0
 0
 0
 0
 4:40 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 20:02 
 0
 0
 0
 0
 12:05 
 0
 0
 0
 0
 6:58 
 0
 0
 0
 0
 5:45 
 0
 0
 0
 0
 4:52 
 0
 0
 0
 0
 6:15 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 12:53 
 0
 0
 0
 0
 5:10 
 0
 0
 0
 0
 0:57 
 0
 0
 0
 0
 13:23 
 0
 0
 0
 0
 5:30 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 2:50 
 1
 0
 0
 0
 14:01 
 0
 0
 0
 0
 10:07 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 6:45