Accepted by CVPR 2019

Typography with Decor: Intelligent Text Style Transfer

Wenjing Wang Jiaying Liu Shuai Yang Zongming Guo


Figure 1. Text effects transfer results produced by the proposed method, where both the basal text effects and the decorative elements can be transferred to the target text.

Abstract

Text effects transfer can dramatically make the text visually pleasing. In this paper, we present a novel framework to stylize the text with exquisite decor, which are ignored by the previous text stylization methods. Decorative elements pose a challenge to spontaneously handle basal text effects and decor, which are two different styles. To address this issue, our key idea is to learn to separate, transfer and recombine the decors and the basal text effect. A novel text effect transfer network is proposed to infer the styled version of the target text. The stylized text is finally embellished with decor where the placement of the decor is carefully determined by a novel structure-aware strategy. Furthermore, we propose a domain adaptation strategy for decor detection and a one-shot training strategy for text effects transfer, which greatly enhance the robustness of our network to new styles. We base our experiments on our collected topography dataset including 59,000 professionally styled text and demonstrate the superiority of our method over other state-of-the-art style transfer methods.

Framework


Figure 2. The proposed text style transfer framework. First, decorative elements are separated from the styled text. Then, text effects are transferred to the target text. Finally, the elements and the styled text are recomposed based on both the structure of the text and the spatial distribution of the decorative elements.

Dataset

Figure 3. An overview of our styled text dataset. The proposed dataset including 60 different kinds of text effects with 52 English letters of 19 fonts, totally 59k images.

Resources

Citation

@InProceedings{typography2019,
    author = {Wang, Wenjing and Liu, Jiaying and Yang, Shuai and Guo, Zongming},
    title = {Typography with Decor: Intelligent Text Style Transfer},
    booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
    month = {June},
    year = {2019}
}

Selected Results

Figure 4. Comparison with state-of-the-art methods on various text effects: (left-to-right) input example text effects, target text, Doodle [1], T-Effect [2], Our stylization results.

Reference

[1] Alex J Champandard. Semantic style transfer and turning two-bit doodles into fine artworks. arXiv preprint arXiv:1603.01768, 2016.

[2] ShuaiYang, JiayingLiu, ZhouhuiLian, and ZongmingGuo. Awesome typography: Statistics-based text effects transfer. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 7464–7473, 2017.