30/11/2020

Sketch-to-Art: Synthesizing Stylized Art Images From Sketches

Bingchen Liu, Kunpeng Song, Yizhe Zhu, Ahmed Elgammal

Keywords:

Abstract Paper Similar Papers

Abstract: We propose a new approach for synthesizing fully detailed art-stylized images from sketches. Given a sketch, with no semantic tagging, and a reference image of a specific style, the model can synthesize meaningful details with colors and textures. Based on the GAN framework, the model consists of three novel modules designed explicitly for better artistic style capturing and generation. To enforce the content faithfulness, we introduce the dual-masked mechanism which directly shapes the feature maps according to sketch. To capture more artistic style aspects, we design feature-map transformation for a better style consistency to the reference image. Finally, an inverse process of instance-normalization disentangles the style and content information and further improves the synthesis quality. Experiments demonstrate a significant qualitative and quantitative boost over baseline models based on previous state-of-the-art techniques, modified for the proposed task (17% better Frechet Inception distance and 18% better style classification score). Moreover, the lightweight design of the proposed modules enables the high-quality synthesis at 512 * 512 resolution.

The video of this talk cannot be embedded. You can watch it here:
https://accv2020.github.io/miniconf/poster_560.html
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at ACCV 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 14:42 
 0
 0
 0
 0
 3:20 
 0
 0
 0
 0
 3:49 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 9:21 
 0
 0
 0
 0
 10:53 
 0
 0
 0
 0
 18:07 
 0
 0
 0
 0
 18:15 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 7:47 
 0
 0
 0
 0
 12:42 
 0
 0
 0
 0
 9:20 
 0
 0
 0
 0
 9:09 
 0
 0
 0
 0
 6:47 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 5:11 
 0
 0
 0
 0
 17:44 
 0
 0
 0
 0
 3:20 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 12:29 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 0:56 
 0
 0
 0
 0
 0:59 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 4:51 
 0
 0
 0
 0
 11:04 
 0
 0
 0
 0
 3:01 
 0
 0
 0
 0
 2:56 
 0
 0
 0
 0
 13:00 
 0
 0
 0
 0
 11:15 
 0
 0
 0
 0
 6:47 
 0
 0
 0
 0
 4:34 
 0
 0
 0
 0
 3:49 
 0
 0
 0
 0
 5:01