Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

Generating 3D faces using multi-column graph convolutional networks

Li, Kun, Liu, Jingying, Lai, Yukun and Yang, Jingyu 2019. Generating 3D faces using multi-column graph convolutional networks. Computer Graphics Forum 38 (7)
Item availability restricted.

[img] PDF - Accepted Post-Print Version
Restricted to Repository staff only

Download (5MB)

Abstract

In this work, we introduce multi-column graph convolutional networks (MGCNs), a deep generative model for 3D mesh surfaces that effectively learns a non-linear facial representation. We perform spectral decomposition of meshes and apply convolutions directly in the frequency domain. Our network architecture involves multiple columns of graph convolutional networks (GCNs), namely large GCN (L-GCN), medium GCN (M-GCN) and small GCN (S-GCN), with different filter sizes to extract features at different scales. L-GCN is more useful to extract large-scale features, whereas S-GCN is effective for extracting subtle and fine-grained features, and M-GCN captures information in between. Therefore, to obtain a high-quality representation, we propose a selective fusion method that adaptively integrates these three kinds of information. Spatially non-local relationships are also exploited through a self-attention mechanism to further improve the representation ability in the latent vector space. Through extensive experiments, we demonstrate the superiority of our end-to-end framework in improving the accuracy of 3D face reconstruction. Moreover, with the help of variational inference, our model has excellent generating ability.

Item Type: Article
Date Type: Published Online
Status: In Press
Schools: Computer Science & Informatics
Additional Information: A special issue of Pacific Graphics 2019 paper that will be published in Computer Graphics Forum.
Publisher: Wiley
ISSN: 0167-7055
Date of First Compliant Deposit: 1 October 2019
Date of Acceptance: 26 August 2019
Last Modified: 18 Oct 2019 05:10
URI: http://orca-mwe.cf.ac.uk/id/eprint/125794

Actions (repository staff only)

Edit Item Edit Item

Downloads

Downloads per month over past year

View more statistics