Total runs:
2.6M
Run Growth:
403.9K
Growth Rate:
15.56%
stabilityai / control-lora
Model's Last Updated: August 19 2023
text-to-image
Introduction of control-lora
Model Details of control-lora
Control-LoRA Model Card
Introduction
By adding low-rank parameter efficient fine tuning to ControlNet, we introduce Control-LoRAs . This approach offers a more efficient and compact method to bring model control to a wider variety of consumer GPUs.
For each model below, you'll find:
-
Rank 256
files (reducing the original
4.7GBControlNet models down to~738MBControl-LoRA models) and experimental -
Rank 128
files (reducing to model down to
~377MB)
Each Control-LoRA has been trained on a diverse range of image concepts and aspect ratios.
MiDaS and ClipDrop Depth
This Control-LoRA utilizes a grayscale depth map for guided generation.
Depth estimation is an image processing technique that determines the distance of objects in a scene, providing a depth map that highlights variations in proximity.
The model was trained on the depth results of
MiDaS dpt_beit_large_512
.
It was further finetuned on the
Portrait Depth Estimation
model available in the
ClipDrop API by Stability AI
.
Canny Edge
Canny Edge Detection is an image processing technique that identifies abrupt changes in intensity to highlight edges in an image.
This Control-LoRA uses the edges from an image to generate the final image.
Photograph and Sketch Colorizer
These two Control-LoRAs can be used to colorize images.
Recolor is designed to colorize black and white photographs.
Sketch
is designed to color in drawings input as a white-on-black image (either hand-drawn, or created with a
pidi
edge model).
Revision
Revision is a novel approach of using images to prompt SDXL.
It uses pooled CLIP embeddings to produce images conceptually similar to the input. It can be used either in addition, or to replace text prompts.
Revision also includes a blending function for combining multiple image or text concepts, as either positive or negative prompts.
Inference
Control-LoRAs have been implemented into ComfyUI and StableSwarmUI
Basic ComfyUI workflows (using the base model only) are available in this HF repo. Custom nodes from Stability are available here .
Recolor example on ComfyUI:
Canny edge on StableSwarmUI:
Runs of stabilityai control-lora on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About control-lora huggingface.co Model
Url of control-lora
control-lora huggingface.co Url
Provider of control-lora huggingface.co
Other API from stabilityai
Updated: October 31 2023
Total runs:
1.1M
Run Growth:
92.8K
Growth Rate:
8.65%
Total runs:
990.9K
Run Growth:
320.8K
Growth Rate:
32.37%
Total runs:
817.4K
Run Growth:
531.8K
Growth Rate:
65.06%
Total runs:
371.2K
Run Growth:
209.5K
Growth Rate:
56.44%
Total runs:
272.7K
Run Growth:
-251.6K
Growth Rate:
-92.25%
Total runs:
257.8K
Run Growth:
69.3K
Growth Rate:
26.90%
Total runs:
237.9K
Run Growth:
-77.1K
Growth Rate:
-43.16%
Total runs:
143.2K
Run Growth:
10.6K
Growth Rate:
7.42%
Total runs:
129.9K
Run Growth:
60.3K
Growth Rate:
46.43%
Total runs:
129.6K
Run Growth:
3.4K
Growth Rate:
3.56%
Total runs:
123.0K
Run Growth:
-102.1K
Growth Rate:
-83.70%
Total runs:
96.4K
Run Growth:
-13.0K
Growth Rate:
-13.45%
Total runs:
54.2K
Run Growth:
37.7K
Growth Rate:
35.58%
Total runs:
42.8K
Run Growth:
-10.0K
Growth Rate:
-23.41%
Total runs:
34.8K
Run Growth:
2.3K
Growth Rate:
6.72%
Total runs:
31.5K
Run Growth:
11.7K
Growth Rate:
37.11%
Total runs:
27.0K
Run Growth:
4.0K
Growth Rate:
14.64%
Total runs:
26.7K
Run Growth:
-13.3K
Growth Rate:
-49.93%
Total runs:
24.8K
Run Growth:
2.0K
Growth Rate:
8.00%
Total runs:
18.8K
Run Growth:
-1.7K
Growth Rate:
-8.99%
Total runs:
17.7K
Run Growth:
10.4K
Growth Rate:
58.39%
Total runs:
17.0K
Run Growth:
10.5K
Growth Rate:
61.45%
Total runs:
16.8K
Run Growth:
5.7K
Growth Rate:
33.81%
Total runs:
10.9K
Run Growth:
2.2K
Growth Rate:
20.66%
Total runs:
10.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8.4K
Run Growth:
1.7K
Growth Rate:
19.99%
Total runs:
8.3K
Run Growth:
-932
Growth Rate:
-11.24%
Total runs:
8.3K
Run Growth:
-845
Growth Rate:
-10.23%
Total runs:
6.5K
Run Growth:
1.2K
Growth Rate:
19.07%
Total runs:
5.9K
Run Growth:
931
Growth Rate:
15.73%
Total runs:
5.5K
Run Growth:
-2.2K
Growth Rate:
-40.81%
Total runs:
5.3K
Run Growth:
681
Growth Rate:
12.89%
Total runs:
4.8K
Run Growth:
-1.0K
Growth Rate:
-21.39%
Total runs:
4.6K
Run Growth:
-1.4K
Growth Rate:
-30.44%
Total runs:
3.6K
Run Growth:
1.3K
Growth Rate:
35.71%
Total runs:
2.3K
Run Growth:
-682
Growth Rate:
-30.16%
Total runs:
2.0K
Run Growth:
642
Growth Rate:
31.72%
Total runs:
2.0K
Run Growth:
240
Growth Rate:
12.02%
Total runs:
2.0K
Run Growth:
-6.5K
Growth Rate:
-330.39%
Total runs:
1.7K
Run Growth:
250
Growth Rate:
15.04%
Total runs:
1.6K
Run Growth:
250
Growth Rate:
15.22%
Total runs:
1.6K
Run Growth:
-118
Growth Rate:
-7.56%
Total runs:
1.4K
Run Growth:
-529
Growth Rate:
-37.23%
Total runs:
1.3K
Run Growth:
448
Growth Rate:
34.51%
Total runs:
1.3K
Run Growth:
425
Growth Rate:
32.77%
Total runs:
1.2K
Run Growth:
325
Growth Rate:
27.13%
Total runs:
1.2K
Run Growth:
430
Growth Rate:
36.44%
Total runs:
1.2K
Run Growth:
88
Growth Rate:
7.59%
Total runs:
1.1K
Run Growth:
72
Growth Rate:
6.47%
Total runs:
1.1K
Run Growth:
505
Growth Rate:
46.46%
Total runs:
844
Run Growth:
158
Growth Rate:
18.72%
Total runs:
743
Run Growth:
0
Growth Rate:
0.00%
Total runs:
706
Run Growth:
482
Growth Rate:
68.27%
Total runs:
698
Run Growth:
277
Growth Rate:
39.68%
Total runs:
690
Run Growth:
92
Growth Rate:
100.00%
Total runs:
600
Run Growth:
490
Growth Rate:
81.67%
Total runs:
600
Run Growth:
0
Growth Rate:
0.00%
Total runs:
569
Run Growth:
0
Growth Rate:
0.00%
Total runs:
559
Run Growth:
57
Growth Rate:
10.20%
Total runs:
454
Run Growth:
271
Growth Rate:
100.00%
Total runs:
392
Run Growth:
59
Growth Rate:
15.05%
Total runs:
376
Run Growth:
201
Growth Rate:
53.46%
Total runs:
350
Run Growth:
342
Growth Rate:
93.44%
Total runs:
332
Run Growth:
-20
Growth Rate:
-6.02%
Total runs:
320
Run Growth:
410
Growth Rate:
92.76%
Total runs:
306
Run Growth:
274
Growth Rate:
100.00%
Total runs:
270
Run Growth:
-5.2K
Growth Rate:
-1917.04%
Total runs:
238
Run Growth:
-227
Growth Rate:
-95.38%
Total runs:
220
Run Growth:
-97
Growth Rate:
-44.09%
Total runs:
207
Run Growth:
-187
Growth Rate:
-90.34%
Total runs:
150
Run Growth:
48
Growth Rate:
100.00%
Total runs:
140
Run Growth:
31
Growth Rate:
22.14%
Total runs:
125
Run Growth:
-267
Growth Rate:
-213.60%
Total runs:
114
Run Growth:
-297
Growth Rate:
-260.53%
Total runs:
112
Run Growth:
79
Growth Rate:
70.54%
Total runs:
94
Run Growth:
26
Growth Rate:
27.66%
Total runs:
73
Run Growth:
25
Growth Rate:
100.00%
Total runs:
66
Run Growth:
-30
Growth Rate:
-45.45%
Total runs:
37
Run Growth:
-32
Growth Rate:
-86.49%
Total runs:
22
Run Growth:
-21
Growth Rate:
-95.45%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
-14
Growth Rate:
-280.00%
Total runs:
5
Run Growth:
4
Growth Rate:
80.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%