TencentARC / t2iadapter_canny_sd15v2

huggingface.co
Total runs: 2.4K
24-hour runs: 0
7-day runs: -40
30-day runs: 152
Model's Last Updated: Julio 31 2023
image-to-image

Introduction of t2iadapter_canny_sd15v2

Model Details of t2iadapter_canny_sd15v2

T2I Adapter - Canny

T2I Adapter is a network providing additional conditioning to stable diffusion. Each t2i checkpoint takes a different type of conditioning as input and is used with a specific base stable diffusion checkpoint.

This checkpoint provides conditioning on canny edge's for the stable diffusion 1.5 checkpoint.

Model Details
  • Developed by: T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models

  • Model type: Diffusion-based text-to-image generation model

  • Language(s): English

  • License: Apache 2.0

  • Resources for more information: GitHub Repository , Paper .

  • Cite as:

    @misc{ title={T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models}, author={Chong Mou, Xintao Wang, Liangbin Xie, Yanze Wu, Jian Zhang, Zhongang Qi, Ying Shan, Xiaohu Qie}, year={2023}, eprint={2302.08453}, archivePrefix={arXiv}, primaryClass={cs.CV} }

Checkpoints
Model Name Control Image Overview Control Image Example Generated Image Example
TencentARC/t2iadapter_color_sd14v1
Trained with spatial color palette
A image with 8x8 color palette.
TencentARC/t2iadapter_canny_sd14v1
Trained with canny edge detection
A monochrome image with white edges on a black background.
TencentARC/t2iadapter_sketch_sd14v1
Trained with PidiNet edge detection
A hand-drawn monochrome image with white outlines on a black background.
TencentARC/t2iadapter_depth_sd14v1
Trained with Midas depth estimation
A grayscale image with black representing deep areas and white representing shallow areas.
TencentARC/t2iadapter_openpose_sd14v1
Trained with OpenPose bone image
A OpenPose bone image.
TencentARC/t2iadapter_keypose_sd14v1
Trained with mmpose skeleton image
A mmpose skeleton image.
TencentARC/t2iadapter_seg_sd14v1
Trained with semantic segmentation
An custom segmentation protocol image.
TencentARC/t2iadapter_canny_sd15v2
TencentARC/t2iadapter_depth_sd15v2
TencentARC/t2iadapter_sketch_sd15v2
TencentARC/t2iadapter_zoedepth_sd15v1
Example
  1. Dependencies
pip install diffusers transformers opencv-contrib-python
  1. Run code:
import cv2
from PIL import Image
import torch
import numpy as np
from diffusers import T2IAdapter, StableDiffusionAdapterPipeline

image = Image.open('./images/canny_input.png')
image = np.array(image)

low_threshold = 100
high_threshold = 200

image = cv2.Canny(image, low_threshold, high_threshold)
image = Image.fromarray(image)

image.save('./images/canny.png')

adapter = T2IAdapter.from_pretrained("TencentARC/t2iadapter_canny_sd15v2", torch_dtype=torch.float16)
pipe = StableDiffusionAdapterPipeline.from_pretrained(
    "runwayml/stable-diffusion-v1-5",
    adapter=adapter,
    torch_dtype=torch.float16,
)
pipe.to("cuda")

generator = torch.manual_seed(0)

out_image = pipe(
    "a rabbit wearing glasses",
    image=image,
    generator=generator,
).images[0]

out_image.save('./images/canny_out.png')

canny_input canny canny_out

Runs of TencentARC t2iadapter_canny_sd15v2 on huggingface.co

2.4K
Total runs
0
24-hour runs
-72
3-day runs
-40
7-day runs
152
30-day runs

More Information About t2iadapter_canny_sd15v2 huggingface.co Model

More t2iadapter_canny_sd15v2 license Visit here:

https://choosealicense.com/licenses/apache-2.0

t2iadapter_canny_sd15v2 huggingface.co

t2iadapter_canny_sd15v2 huggingface.co is an AI model on huggingface.co that provides t2iadapter_canny_sd15v2's model effect (), which can be used instantly with this TencentARC t2iadapter_canny_sd15v2 model. huggingface.co supports a free trial of the t2iadapter_canny_sd15v2 model, and also provides paid use of the t2iadapter_canny_sd15v2. Support call t2iadapter_canny_sd15v2 model through api, including Node.js, Python, http.

t2iadapter_canny_sd15v2 huggingface.co Url

https://huggingface.co/TencentARC/t2iadapter_canny_sd15v2

TencentARC t2iadapter_canny_sd15v2 online free

t2iadapter_canny_sd15v2 huggingface.co is an online trial and call api platform, which integrates t2iadapter_canny_sd15v2's modeling effects, including api services, and provides a free online trial of t2iadapter_canny_sd15v2, you can try t2iadapter_canny_sd15v2 online for free by clicking the link below.

TencentARC t2iadapter_canny_sd15v2 online free url in huggingface.co:

https://huggingface.co/TencentARC/t2iadapter_canny_sd15v2

t2iadapter_canny_sd15v2 install

t2iadapter_canny_sd15v2 is an open source model from GitHub that offers a free installation service, and any user can find t2iadapter_canny_sd15v2 on GitHub to install. At the same time, huggingface.co provides the effect of t2iadapter_canny_sd15v2 install, users can directly use t2iadapter_canny_sd15v2 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

t2iadapter_canny_sd15v2 install url in huggingface.co:

https://huggingface.co/TencentARC/t2iadapter_canny_sd15v2

Url of t2iadapter_canny_sd15v2

t2iadapter_canny_sd15v2 huggingface.co Url

Provider of t2iadapter_canny_sd15v2 huggingface.co

TencentARC
ORGANIZATIONS

Other API from TencentARC

huggingface.co

Create photos, paintings and avatars for anyone in any style within seconds.

Total runs: 35.0K
Run Growth: -43.4K
Growth Rate: -124.12%
Updated: Julio 22 2024
huggingface.co

Total runs: 140
Run Growth: -78
Growth Rate: -55.71%
Updated: Diciembre 16 2024
huggingface.co

Total runs: 114
Run Growth: 22
Growth Rate: 19.30%
Updated: Noviembre 29 2024
huggingface.co

Total runs: 19
Run Growth: 11
Growth Rate: 57.89%
Updated: Diciembre 10 2024
huggingface.co

Total runs: 5
Run Growth: -1
Growth Rate: -20.00%
Updated: Diciembre 30 2024
huggingface.co

Total runs: 5
Run Growth: -2
Growth Rate: -40.00%
Updated: Diciembre 30 2024
huggingface.co

Total runs: 4
Run Growth: -6
Growth Rate: -150.00%
Updated: Diciembre 30 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Junio 29 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Agosto 20 2023
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Diciembre 16 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Agosto 28 2023
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Diciembre 20 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Agosto 13 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Diciembre 17 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Abril 11 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Octubre 08 2022
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Enero 20 2024