TencentARC / PhotoMaker

Create photos, paintings and avatars for anyone in any style within seconds.

huggingface.co
Total runs: 78.4K
24-hour runs: 0
7-day runs: 871
30-day runs: 45.1K
Github
Model's Last Updated: July 22 2024
text-to-image

Introduction of PhotoMaker

Model Details of PhotoMaker

PhotoMaker Model Card

Introduction

Users can input one or a few face photos, along with a text prompt, to receive a customized photo or painting within seconds (no training required!). Additionally, this model can be adapted to any base model based on SDXL or used in conjunction with other LoRA modules.

Realistic results

image/jpeg

image/jpeg

Stylization results

image/jpeg

image/jpeg

More results can be found in our project page

Model Details

It mainly contains two parts corresponding to two keys in loaded state dict:

  1. id_encoder includes finetuned OpenCLIP-ViT-H-14 and a few fuse layers.

  2. lora_weights applies to all attention layers in the UNet, and the rank is set to 64.

Usage

You can directly download the model in this repository. You also can download the model in python script:

from huggingface_hub import hf_hub_download
photomaker_ckpt = hf_hub_download(repo_id="TencentARC/PhotoMaker", filename="photomaker-v1.bin", repo_type="model")

Then, please follow the instructions in our GitHub repository .

Limitations
  • The model's customization performance degrades on Asian male faces.
  • The model still struggles with accurately rendering human hands.
Bias

While the capabilities of image generation models are impressive, they can also reinforce or exacerbate social biases.

Citation

BibTeX:

@inproceedings{li2023photomaker,
  title={PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding},
  author={Li, Zhen and Cao, Mingdeng and Wang, Xintao and Qi, Zhongang and Cheng, Ming-Ming and Shan, Ying},
  booktitle={IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
  year={2024}
}

Runs of TencentARC PhotoMaker on huggingface.co

78.4K
Total runs
0
24-hour runs
1.5K
3-day runs
871
7-day runs
45.1K
30-day runs

More Information About PhotoMaker huggingface.co Model

More PhotoMaker license Visit here:

https://choosealicense.com/licenses/apache-2.0

PhotoMaker huggingface.co

PhotoMaker huggingface.co is an AI model on huggingface.co that provides PhotoMaker's model effect (Create photos, paintings and avatars for anyone in any style within seconds.), which can be used instantly with this TencentARC PhotoMaker model. huggingface.co supports a free trial of the PhotoMaker model, and also provides paid use of the PhotoMaker. Support call PhotoMaker model through api, including Node.js, Python, http.

TencentARC PhotoMaker online free

PhotoMaker huggingface.co is an online trial and call api platform, which integrates PhotoMaker's modeling effects, including api services, and provides a free online trial of PhotoMaker, you can try PhotoMaker online for free by clicking the link below.

TencentARC PhotoMaker online free url in huggingface.co:

https://huggingface.co/TencentARC/PhotoMaker

PhotoMaker install

PhotoMaker is an open source model from GitHub that offers a free installation service, and any user can find PhotoMaker on GitHub to install. At the same time, huggingface.co provides the effect of PhotoMaker install, users can directly use PhotoMaker installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

PhotoMaker install url in huggingface.co:

https://huggingface.co/TencentARC/PhotoMaker

PhotoMaker install url in github:

https://github.com/datakami-models/PhotoMaker

Url of PhotoMaker

Provider of PhotoMaker huggingface.co

Other API from TencentARC

huggingface.co

Total runs: 218
Run Growth: 125
Growth Rate: 100.00%
Updated: December 16 2024
huggingface.co

Total runs: 92
Run Growth: -30
Growth Rate: -16.85%
Updated: November 29 2024
huggingface.co

Total runs: 6
Run Growth: 7
Growth Rate: 100.00%
Updated: December 10 2024
huggingface.co

Total runs: 6
Run Growth: 0
Growth Rate: 0.00%
Updated: December 30 2024
huggingface.co

Total runs: 3
Run Growth: 0
Growth Rate: 0.00%
Updated: December 30 2024
huggingface.co

Total runs: 2
Run Growth: 0
Growth Rate: 0.00%
Updated: December 30 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: June 29 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: December 23 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: August 20 2023
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: December 16 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: December 20 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: August 28 2023
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: December 17 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: August 13 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: April 11 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: October 08 2022
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: January 20 2024