Skip to yearly menu bar Skip to main content


Poster

Loc3Diff: Local Diffusion for 3D Human Head Synthesis and Editing

Yushi Lan · Feitong Tan · Qiangeng Xu · Di Qiu · Kyle Genova · Zeng Huang · Rohit Pandey · Sean Fanello · Thomas Funkhouser · Chen Change Loy · Yinda Zhang

[ ]
Fri 4 Oct 1:30 a.m. PDT — 3:30 a.m. PDT

Abstract:

We present a novel framework for generating photo-realistic 3D human head and subsequently manipulating and reposing them with remarkable flexibility. The proposed approach constructs an implicit representation of 3D human heads, anchored on a parametric face model. To enhance representational capabilities and encode spatial information, we represent semantic consistent head region by a local triplane, modulated by a 3D Gaussian. Additionally, we parameterize these tri-planes in a 2D UV space via a 3DMM, enabling effective utilization of the diffusion model for 3D head avatar generation. Our method facilitates the creation of diverse and realistic 3D human heads with flexible global and fine-grained region-based editing over facial structures, appearance and expressions. Extensive experiments demonstrate the effectiveness of our method.

Live content is unavailable. Log in and register to view live content