Proceedings: GI 2010

Crafting 3D faces using free form portrait sketching and plausible texture inference

Tanasai Sucontphunt, Borom Tunwattanapong, Zhigang Deng, Ulrich Neumann

Proceedings of Graphics Interface 2010: Ottawa, Ontario, Canada, 31 May - 2 June 2010, 209-216

  • BibTex

    @inproceedings{Sucontphunt:2010:,
    author = {Sucontphunt, Tanasai and Tunwattanapong, Borom and Deng, Zhigang and Neumann, Ulrich},
    title = {Crafting 3D faces using free form portrait sketching and plausible texture inference},
    booktitle = {Proceedings of Graphics Interface 2010},
    series = {GI 2010},
    year = {2010},
    issn = {0713-5424},
    isbn = {978-1-56881-712-5},
    location = {Ottawa, Ontario, Canada},
    pages = {209--216},
    numpages = {8},
    publisher = {Canadian Human-Computer Communications Society},
    address = {Toronto, Ontario, Canada},
    }

Abstract

In this paper we propose a sketch-based interface for drawing and generating a realistic 3D human face with texture. The free form sketch-based interface allows a user to intuitively draw a portrait as in traditional pencil sketching way. Then, the user's drawing is automatically reshaped to an accurate natural human facial shape with the guidance of a statistical description model, and an artistic-style portrait rendering technique is used to render the work-in-progress face sketch. Furthermore, with additional user-specified information, e.g., gender, ethnicity, and skin tone, a realistic face texture can be synthesized for the portrait through our probabilistic face texture inference model. Lastly, the textured portrait will be further used to construct a realistic 3D face model by the 3D morphable face model algorithm. Through our preliminary user evaluations, we found that with this system, even novice users were able to efficiently craft a sound 3D realistic face within three minutes.