TencentARC / NVComposer

huggingface.co
Total runs: 122
24-hour runs: 0
7-day runs: -5
30-day runs: -78
Model's Last Updated: Dezember 16 2024
image-to-3d

Introduction of NVComposer

Model Details of NVComposer

NVComposer

Abstract

Recent advancements in generative models have significantly improved novel view synthesis (NVS) from multi-view data. However, existing methods depend on external multi-view alignment processes, such as explicit pose estimation or pre-reconstruction, which limits their flexibility and accessibility, especially when alignment is unstable due to insufficient overlap or occlusions between views. In this paper, we propose NVComposer, a novel approach that eliminates the need for explicit external alignment. NVComposer enables the generative model to implicitly infer spatial and geometric relationships between multiple conditional views by introducing two key components: 1) an image-pose dual-stream diffusion model that simultaneously generates target novel views and condition camera poses, and 2) a geometry-aware feature alignment module that distills geometric priors from dense stereo models during training. Extensive experiments demonstrate that NVComposer achieves state-of-the-art performance in generative multi-view NVS tasks, removing the reliance on external alignment and thus improving model accessibility. Our approach shows substantial improvements in synthesis quality as the number of unposed input views increases, highlighting its potential for more flexible and accessible generative NVS systems.

Model

Download the model checkpoint using huggingface_hub (Version 0.1 as example):

from huggingface_hub import hf_hub_download

checkpoint_path = hf_hub_download(
    repo_id="TencentARC/NVComposer",
    filename="NVComposer-V0.1.ckpt"
)

The downloaded checkpoint file can be found at checkpoint_path .

Video

Watch the introduction video in our project page.

Demo

You can try the demo here .

Method

NVComposer contains 1) an image-pose dual-stream diffusion model that generates novel views while implicitly estimating camera poses for conditional images, and 2) a geometry-aware feature alignment adapter that uses geometric priors distilled from pretrained dense stereo models.

Code

We are currently finalizing the procedures for open-sourcing the code, and it should be made available within a few days.

Runs of TencentARC NVComposer on huggingface.co

122
Total runs
0
24-hour runs
-1
3-day runs
-5
7-day runs
-78
30-day runs

More Information About NVComposer huggingface.co Model

More NVComposer license Visit here:

https://choosealicense.com/licenses/other

NVComposer huggingface.co

NVComposer huggingface.co is an AI model on huggingface.co that provides NVComposer's model effect (), which can be used instantly with this TencentARC NVComposer model. huggingface.co supports a free trial of the NVComposer model, and also provides paid use of the NVComposer. Support call NVComposer model through api, including Node.js, Python, http.

TencentARC NVComposer online free

NVComposer huggingface.co is an online trial and call api platform, which integrates NVComposer's modeling effects, including api services, and provides a free online trial of NVComposer, you can try NVComposer online for free by clicking the link below.

TencentARC NVComposer online free url in huggingface.co:

https://huggingface.co/TencentARC/NVComposer

NVComposer install

NVComposer is an open source model from GitHub that offers a free installation service, and any user can find NVComposer on GitHub to install. At the same time, huggingface.co provides the effect of NVComposer install, users can directly use NVComposer installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

NVComposer install url in huggingface.co:

https://huggingface.co/TencentARC/NVComposer

Url of NVComposer

Provider of NVComposer huggingface.co

TencentARC
ORGANIZATIONS

Other API from TencentARC

huggingface.co

Create photos, paintings and avatars for anyone in any style within seconds.

Total runs: 35.2K
Run Growth: -43.4K
Growth Rate: -124.12%
Updated: Juli 22 2024
huggingface.co

Total runs: 114
Run Growth: 22
Growth Rate: 19.30%
Updated: November 29 2024
huggingface.co

Total runs: 19
Run Growth: 11
Growth Rate: 57.89%
Updated: Dezember 10 2024
huggingface.co

Total runs: 5
Run Growth: -1
Growth Rate: -20.00%
Updated: Dezember 30 2024
huggingface.co

Total runs: 5
Run Growth: -2
Growth Rate: -40.00%
Updated: Dezember 30 2024
huggingface.co

Total runs: 4
Run Growth: -6
Growth Rate: -150.00%
Updated: Dezember 30 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Juni 29 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: August 20 2023
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Dezember 16 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Dezember 20 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: August 28 2023
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Dezember 17 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: August 13 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: April 11 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Oktober 08 2022
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Januar 20 2024