Total runs:
2.8M
Run Growth:
654.6K
Growth Rate:
24.00%
stabilityai / stable-video-diffusion-img2vid-xt-1-1-tensorrt
Model's Last Updated: March 16 2024
image-to-video
Introduction of stable-video-diffusion-img2vid-xt-1-1-tensorrt
Model Details of stable-video-diffusion-img2vid-xt-1-1-tensorrt
Stable Video Diffusion 1.1 TensorRT
This repository hosts the TensorRT version of the Stable Video Diffusion (SVD) 1.1 Image-to-Video model.
Model Details
Please see Stable Video Diffusion (SVD) 1.1 Image-to-Video for the full model details.
This model is intended for research purposes only and should not be used in any way that violates Stability AI's Acceptable Use Policy .
Performance
SVD-XT 1.1 (25 frames, 25 steps)
| A100 80GB PCI | A100 80GB SXM | H100 80GB PCI | |
|---|---|---|---|
| VAE Encoder | 66.70 ms | 65.68 ms | 49.07 ms |
| CLIP | 105.41 ms | 53.20 ms | 91.32 ms |
| UNet x 25 | 30,367.73 ms | 27,489.88 ms | 19,102.98 ms |
| VAE Decoder | 4,663.63 ms | 4,544.12 ms | 3,382.62 ms |
| Total E2E | 35,258.38 ms | 32,166.41 ms | 22,644.73 ms |
Usage Example
- Clone TensorRT and this repo then launch NGC container
git clone https://github.com/rajeevsrao/TensorRT.git
cd TensorRT
git checkout release/svd
git lfs install
git clone https://huggingface.co/stabilityai/stable-video-diffusion-img2vid-xt-1-1-tensorrt
docker run --rm -it --gpus all -v $PWD:/workspace nvcr.io/nvidia/pytorch:23.12-py3 /bin/bash
- Install libraries and requirements
cd demo/Diffusion
python3 -m pip install --upgrade pip
pip3 install -r requirements.txt
python3 -m pip install --pre --upgrade --extra-index-url https://pypi.nvidia.com tensorrt
- Authenticate with huggingface
huggingface-cli login
- Perform TensorRT optimized inference:
python3 demo_img2vid.py \
--version svd-xt-1.1 \
--onnx-dir /workspace/stable-video-diffusion-img2vid-xt-1-1-tensorrt \
--engine-dir engine-svd-xt-1-1 \
--build-static-batch \
--use-cuda-graph \
--input-image https://www.hdcarwallpapers.com/walls/2018_chevrolet_camaro_zl1_nascar_race_car_2-HD.jpg
Runs of stabilityai stable-video-diffusion-img2vid-xt-1-1-tensorrt on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About stable-video-diffusion-img2vid-xt-1-1-tensorrt huggingface.co Model
Url of stable-video-diffusion-img2vid-xt-1-1-tensorrt
stable-video-diffusion-img2vid-xt-1-1-tensorrt huggingface.co Url
Provider of stable-video-diffusion-img2vid-xt-1-1-tensorrt huggingface.co
Other API from stabilityai
Updated: October 31 2023
Total runs:
1.2M
Run Growth:
495.9K
Growth Rate:
44.02%
Total runs:
1.0M
Run Growth:
78.0K
Growth Rate:
7.44%
Total runs:
873.3K
Run Growth:
652.5K
Growth Rate:
75.34%
Total runs:
476.8K
Run Growth:
135.9K
Growth Rate:
30.56%
Total runs:
394.6K
Run Growth:
233.0K
Growth Rate:
59.20%
Total runs:
277.2K
Run Growth:
-105.7K
Growth Rate:
-37.94%
Total runs:
257.7K
Run Growth:
63.8K
Growth Rate:
25.53%
Total runs:
251.5K
Run Growth:
-77.1K
Growth Rate:
-43.16%
Total runs:
181.2K
Run Growth:
47.7K
Growth Rate:
27.32%
Total runs:
136.9K
Run Growth:
67.5K
Growth Rate:
49.63%
Total runs:
136.8K
Run Growth:
3.4K
Growth Rate:
3.56%
Total runs:
123.5K
Run Growth:
-49.7K
Growth Rate:
-40.28%
Total runs:
121.5K
Run Growth:
-14.5K
Growth Rate:
-11.57%
Total runs:
108.2K
Run Growth:
74.2K
Growth Rate:
81.84%
Total runs:
88.1K
Run Growth:
-14.1K
Growth Rate:
-15.77%
Total runs:
48.0K
Run Growth:
-3.9K
Growth Rate:
-8.23%
Total runs:
42.9K
Run Growth:
37.7K
Growth Rate:
35.58%
Total runs:
34.9K
Run Growth:
3.5K
Growth Rate:
10.08%
Total runs:
29.7K
Run Growth:
960
Growth Rate:
3.31%
Total runs:
27.6K
Run Growth:
5.6K
Growth Rate:
20.48%
Total runs:
24.2K
Run Growth:
2.4K
Growth Rate:
9.78%
Total runs:
20.2K
Run Growth:
364
Growth Rate:
1.84%
Total runs:
19.5K
Run Growth:
13.0K
Growth Rate:
69.21%
Total runs:
16.8K
Run Growth:
8.6K
Growth Rate:
50.97%
Total runs:
16.5K
Run Growth:
5.6K
Growth Rate:
34.01%
Total runs:
11.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
11.4K
Run Growth:
2.6K
Growth Rate:
23.11%
Total runs:
9.3K
Run Growth:
284
Growth Rate:
3.11%
Total runs:
8.6K
Run Growth:
1.1K
Growth Rate:
13.70%
Total runs:
8.5K
Run Growth:
2.3K
Growth Rate:
27.99%
Total runs:
6.8K
Run Growth:
1.4K
Growth Rate:
21.46%
Total runs:
6.4K
Run Growth:
1.5K
Growth Rate:
22.97%
Total runs:
6.1K
Run Growth:
1.8K
Growth Rate:
29.69%
Total runs:
6.1K
Run Growth:
-18
Growth Rate:
-0.30%
Total runs:
4.6K
Run Growth:
-856
Growth Rate:
-18.65%
Total runs:
4.4K
Run Growth:
-896
Growth Rate:
-19.84%
Total runs:
4.2K
Run Growth:
1.7K
Growth Rate:
41.91%
Total runs:
2.5K
Run Growth:
1.2K
Growth Rate:
48.91%
Total runs:
2.5K
Run Growth:
913
Growth Rate:
37.93%
Total runs:
2.3K
Run Growth:
-448
Growth Rate:
-19.81%
Total runs:
2.0K
Run Growth:
628
Growth Rate:
32.71%
Total runs:
2.0K
Run Growth:
735
Growth Rate:
38.75%
Total runs:
2.0K
Run Growth:
-6.6K
Growth Rate:
-338.27%
Total runs:
1.7K
Run Growth:
893
Growth Rate:
53.93%
Total runs:
1.7K
Run Growth:
62
Growth Rate:
3.63%
Total runs:
1.6K
Run Growth:
-401
Growth Rate:
-26.11%
Total runs:
1.6K
Run Growth:
833
Growth Rate:
52.52%
Total runs:
1.4K
Run Growth:
491
Growth Rate:
35.25%
Total runs:
1.4K
Run Growth:
499
Growth Rate:
34.75%
Total runs:
1.4K
Run Growth:
751
Growth Rate:
52.37%
Total runs:
1.4K
Run Growth:
610
Growth Rate:
42.90%
Total runs:
1.2K
Run Growth:
527
Growth Rate:
46.55%
Total runs:
966
Run Growth:
360
Growth Rate:
38.50%
Total runs:
775
Run Growth:
0
Growth Rate:
0.00%
Total runs:
730
Run Growth:
636
Growth Rate:
87.12%
Total runs:
712
Run Growth:
92
Growth Rate:
100.00%
Total runs:
706
Run Growth:
429
Growth Rate:
60.76%
Total runs:
608
Run Growth:
63
Growth Rate:
10.36%
Total runs:
600
Run Growth:
0
Growth Rate:
0.00%
Total runs:
569
Run Growth:
0
Growth Rate:
0.00%
Total runs:
466
Run Growth:
271
Growth Rate:
100.00%
Total runs:
418
Run Growth:
410
Growth Rate:
92.76%
Total runs:
415
Run Growth:
256
Growth Rate:
61.69%
Total runs:
382
Run Growth:
88
Growth Rate:
23.04%
Total runs:
326
Run Growth:
-5.0K
Growth Rate:
-1533.44%
Total runs:
320
Run Growth:
-5
Growth Rate:
-1.56%
Total runs:
311
Run Growth:
-113
Growth Rate:
-42.16%
Total runs:
308
Run Growth:
342
Growth Rate:
93.44%
Total runs:
245
Run Growth:
-59
Growth Rate:
-24.08%
Total runs:
218
Run Growth:
-76
Growth Rate:
-34.86%
Total runs:
146
Run Growth:
41
Growth Rate:
28.08%
Total runs:
140
Run Growth:
-154
Growth Rate:
-110.00%
Total runs:
131
Run Growth:
274
Growth Rate:
100.00%
Total runs:
125
Run Growth:
-216
Growth Rate:
-180.00%
Total runs:
121
Run Growth:
90
Growth Rate:
74.38%
Total runs:
107
Run Growth:
55
Growth Rate:
50.93%
Total runs:
99
Run Growth:
-28
Growth Rate:
-42.42%
Total runs:
98
Run Growth:
48
Growth Rate:
100.00%
Total runs:
87
Run Growth:
25
Growth Rate:
100.00%
Total runs:
35
Run Growth:
8
Growth Rate:
22.86%
Total runs:
20
Run Growth:
-3
Growth Rate:
-15.00%
Total runs:
17
Run Growth:
1
Growth Rate:
5.88%
Total runs:
9
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
1
Growth Rate:
25.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%