Skip to yearly menu bar Skip to main content


Poster

Vista3D: unravel the 3d darkside of a single image

Qiuhong Shen · Xingyi Yang · Michael Bi Mi · Xinchao Wang

Strong blind review: This paper was not made available on public preprint services during the review process Strong Double Blind
[ ]
Thu 3 Oct 1:30 a.m. PDT — 3:30 a.m. PDT

Abstract:

We embark on the age-old quest: unveiling the hidden dimensions of objects from mere glimpses of their visible parts. To address this,we present \textbf{Vista3D}, a framework that realizes swift and consistent 3D generation within a mere 5 minutes. At the heart of Vista3D lies a two-phase approach: the coarse phase and the fine phase. In the coarse phase, we rapidly generate initial geometry with Gaussian Splatting from a single image. In the fine phase, we extract a Signed Distance Function (SDF) directly from learned Gaussian Splatting, optimizing it with a differentiable isosurface representation. Furthermore, it elevates the quality of generation by using a disentangled representation with two independent implicit functions to capture both visible and obscured aspects of objects. Additionally, it harmonizes gradients from 2D diffusion prior with 3D-aware diffusion priors by angular diffusion prior composition. Through extensive evaluation, we demonstrate that Vista3D effectively sustains a balance between the consistency and diversity of the generated 3D objects. We will make all code and results publicly available.

Live content is unavailable. Log in and register to view live content