02/02/2021

Teacher Guided Neural Architecture Search for Face Recognition

Xiaobo Wang

Keywords:

Abstract Paper Similar Papers

Abstract: Knowledge distillation is an effective tool to compress large pre-trained convolutional neural networks (CNNs) or their ensembles into models applicable to mobile and embedded devices. However, with expected flops or latency, existing methods are hand-crafted heuristics. They propose to pre-define the target student network for knowledge distillation, which may be sub-optimal because it requires much effort to explore a powerful student from the large design space. In this paper, we develop a novel teacher guided neural architecture search method to directly search for a student network with flexible channel and layer sizes. Specifically, we define the search space as the number of the channels/layers, which is sampled based on the probability distribution and is learned by minimizing the search objective of the student network. The maximum probability for the size in each distribution serves as the final searched width and depth of the target student network. Extensive experiments on a variety of face recognition benchmarks have demonstrated the superiority of our method over the state-of-the-art alternatives.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38947844
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 17:58 
 0
 0
 0
 0
 5:08 
 0
 0
 0
 0
 19:03 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 5:09 
 0
 0
 0
 0
 14:29 
 0
 0
 0
 0
 4:59 
 0
 0
 0
 0
 14:19 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 4:26 
 0
 0
 0
 0
 10:19 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 5:17 
 0
 0
 0
 0
 3:35 
 0
 0
 0
 0
 15:01 
 0
 0
 0
 0
 3:07 
 0
 0
 0
 0
 16:14 
 0
 0
 0
 0
 1:04 
 0
 0
 0
 0
 4:37 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 5:09 
 0
 0
 0
 0
 10:10 
 0
 0
 0
 0
 17:11 
 0
 0
 0
 0
 5:35 
 0
 0
 0
 0
 16:15 
 0
 0
 0
 0
 4:55 
 0
 0
 0
 0
 5:36 
 0
 0
 0
 0
 3:17 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 15:04 
 0
 0
 0
 0
 12:38 
 0
 0
 0
 0
 16:09 
 0
 0
 0
 0
 10:18 
 0
 0
 0
 0
 3:04 
 0
 0
 0
 0
 18:53 
 0
 0
 0
 0
 15:31 
 0
 0
 0
 0
 9:23 
 0
 0
 0
 1
 8:08 
 0
 0
 0
 0
 11:58 
 0
 0
 0
 0
 9:15