TencentARC / PhotoMaker-V2
Model's Last Updated: 7월 22 2024
text-to-image
Introduction of PhotoMaker-V2
Model Details of PhotoMaker-V2
PhotoMaker V2 Model Card
Introduction
Users can input one or a few face photos, along with a text prompt, to receive a customized photo or painting within seconds (no training required!). Additionally, this model can be adapted to any base model based on SDXL or used in conjunction with other LoRA modules.
Realistic results
Stylization results
More results can be found in our project page
Model Details
It mainly contains two parts corresponding to two keys in loaded state dict:
-
id_encoderincludes finetuned OpenCLIP-ViT-H-14 and a few fuse layers. -
lora_weightsapplies to all attention layers in the UNet, and the rank is set to 64.
Usage
You can directly download the model in this repository. You also can download the model in python script:
from huggingface_hub import hf_hub_download
photomaker_ckpt = hf_hub_download(repo_id="TencentARC/PhotoMaker-V2", filename="photomaker-v2.bin", repo_type="model")
Then, please follow the instructions in our GitHub repository .
Limitations
- The model's customization performance degrades on Asian male faces.
- The model still struggles with accurately rendering human hands.
Bias
While the capabilities of image generation models are impressive, they can also reinforce or exacerbate social biases.
Citation
BibTeX:
@inproceedings{li2023photomaker,
title={PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding},
author={Li, Zhen and Cao, Mingdeng and Wang, Xintao and Qi, Zhongang and Cheng, Ming-Ming and Shan, Ying},
booktitle={IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
year={2024}
}
Runs of TencentARC PhotoMaker-V2 on huggingface.co
30.5K
Total runs
0
24-hour runs
-580
3-day runs
6.6K
7-day runs
6.6K
30-day runs
More Information About PhotoMaker-V2 huggingface.co Model
Url of PhotoMaker-V2
PhotoMaker-V2 huggingface.co Url
Provider of PhotoMaker-V2 huggingface.co
Other API from TencentARC
Create photos, paintings and avatars for anyone in any style within seconds.
Total runs:
35.0K
Run Growth:
-43.4K
Growth Rate:
-124.12%
Total runs:
9.8K
Run Growth:
134
Growth Rate:
1.37%
Total runs:
6.8K
Run Growth:
1.1K
Growth Rate:
16.29%
Total runs:
6.7K
Run Growth:
363
Growth Rate:
5.55%
Total runs:
5.9K
Run Growth:
1.0K
Growth Rate:
17.41%
Total runs:
5.3K
Run Growth:
1.4K
Growth Rate:
27.11%
Total runs:
4.3K
Run Growth:
38
Growth Rate:
0.89%
Total runs:
2.6K
Run Growth:
327
Growth Rate:
12.57%
Total runs:
2.4K
Run Growth:
57
Growth Rate:
2.32%
Total runs:
2.4K
Run Growth:
152
Growth Rate:
6.31%
Total runs:
2.2K
Run Growth:
743
Growth Rate:
34.30%
Total runs:
2.0K
Run Growth:
210
Growth Rate:
10.38%
Total runs:
220
Run Growth:
-181
Growth Rate:
-82.27%
Total runs:
153
Run Growth:
-542
Growth Rate:
-354.25%
Total runs:
57
Run Growth:
35
Growth Rate:
61.40%
Total runs:
51
Run Growth:
-18
Growth Rate:
-35.29%
Total runs:
50
Run Growth:
29
Growth Rate:
60.42%
Total runs:
41
Run Growth:
-103
Growth Rate:
-264.10%
Total runs:
39
Run Growth:
12
Growth Rate:
30.77%
Total runs:
33
Run Growth:
-78
Growth Rate:
-243.75%
Total runs:
27
Run Growth:
9
Growth Rate:
40.91%
Total runs:
24
Run Growth:
3
Growth Rate:
12.50%
Total runs:
19
Run Growth:
3
Growth Rate:
15.79%
Total runs:
18
Run Growth:
9
Growth Rate:
50.00%
Total runs:
12
Run Growth:
2
Growth Rate:
16.67%
Total runs:
12
Run Growth:
2
Growth Rate:
16.67%
Total runs:
12
Run Growth:
2
Growth Rate:
16.67%
Total runs:
9
Run Growth:
2
Growth Rate:
22.22%
Total runs:
7
Run Growth:
-5
Growth Rate:
-71.43%
Total runs:
6
Run Growth:
-2
Growth Rate:
-33.33%
Total runs:
5
Run Growth:
-2
Growth Rate:
-40.00%
Total runs:
5
Run Growth:
-6
Growth Rate:
-120.00%
Total runs:
4
Run Growth:
4
Growth Rate:
100.00%
Total runs:
4
Run Growth:
4
Growth Rate:
100.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%