Existing sparse-view reconstruction models heavily rely on accurate known camera poses. However, deriving camera extrinsics and intrinsics from sparse-view images presents significant challenges. In this work, we present FreeSplatter, a highly scalable, feed-forward reconstruction framework capable of generating high-quality 3D Gaussians from uncalibrated sparse-view images and recovering their camera parameters in mere seconds. FreeSplatter is built upon a streamlined transformer architecture, comprising sequential self-attention blocks that facilitate information exchange among multi-view image tokens and decode them into pixel-wise 3D Gaussian primitives. The predicted Gaussian primitives are situated in a unified reference frame, allowing for high-fidelity 3D modeling and instant camera parameter estimation using off-the-shelf solvers. To cater to both object-centric and scene-level reconstruction, we train two model variants of FreeSplatter on extensive datasets. In both scenarios, FreeSplatter outperforms state-of-the-art baselines in terms of reconstruction quality and pose estimation accuracy. Furthermore, we showcase FreeSplatter's potential in enhancing the productivity of downstream applications, such as text/image-to-3D content creation.
Runs of TencentARC FreeSplatter on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About FreeSplatter huggingface.co Model
FreeSplatter huggingface.co is an AI model on huggingface.co that provides FreeSplatter's model effect (), which can be used instantly with this TencentARC FreeSplatter model. huggingface.co supports a free trial of the FreeSplatter model, and also provides paid use of the FreeSplatter. Support call FreeSplatter model through api, including Node.js, Python, http.
FreeSplatter huggingface.co is an online trial and call api platform, which integrates FreeSplatter's modeling effects, including api services, and provides a free online trial of FreeSplatter, you can try FreeSplatter online for free by clicking the link below.
TencentARC FreeSplatter online free url in huggingface.co:
FreeSplatter is an open source model from GitHub that offers a free installation service, and any user can find FreeSplatter on GitHub to install. At the same time, huggingface.co provides the effect of FreeSplatter install, users can directly use FreeSplatter installed effect in huggingface.co for debugging and trial. It also supports api for free installation.