Total runs:
1.9M
Run Growth:
677.9K
Growth Rate:
36.38%
Salesforce / instructblip-flan-t5-xxl
Model's Last Updated: February 03 2025
image-text-to-text
Introduction of instructblip-flan-t5-xxl
Model Details of instructblip-flan-t5-xxl
InstructBLIP model
InstructBLIP model using Flan-T5-xxl as language model. InstructBLIP was introduced in the paper InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning by Dai et al.
Disclaimer: The team releasing InstructBLIP did not write a model card for this model so this model card has been written by the Hugging Face team.
Model description
InstructBLIP is a visual instruction tuned version of BLIP-2 . Refer to the paper for details.
Intended uses & limitations
Usage is as follows:
from transformers import InstructBlipProcessor, InstructBlipForConditionalGeneration
import torch
from PIL import Image
import requests
model = InstructBlipForConditionalGeneration.from_pretrained("Salesforce/instructblip-flan-t5-xxl")
processor = InstructBlipProcessor.from_pretrained("Salesforce/instructblip-flan-t5-xxl")
device = "cuda" if torch.cuda.is_available() else "cpu"
model.to(device)
url = "https://raw.githubusercontent.com/salesforce/LAVIS/main/docs/_static/Confusing-Pictures.jpg"
image = Image.open(requests.get(url, stream=True).raw).convert("RGB")
prompt = "What is unusual about this image?"
inputs = processor(images=image, text=prompt, return_tensors="pt").to(device)
outputs = model.generate(
**inputs,
do_sample=False,
num_beams=5,
max_length=256,
min_length=1,
top_p=0.9,
repetition_penalty=1.5,
length_penalty=1.0,
temperature=1,
)
generated_text = processor.batch_decode(outputs, skip_special_tokens=True)[0].strip()
print(generated_text)
How to use
For code examples, we refer to the documentation .
Runs of Salesforce instructblip-flan-t5-xxl on huggingface.co
1.0K
Total runs
0
24-hour runs
67
3-day runs
39
7-day runs
279
30-day runs
More Information About instructblip-flan-t5-xxl huggingface.co Model
Url of instructblip-flan-t5-xxl
instructblip-flan-t5-xxl huggingface.co Url
Provider of instructblip-flan-t5-xxl huggingface.co
Other API from Salesforce
Updated: February 03 2025
Total runs:
945.5K
Run Growth:
-285.1K
Growth Rate:
-28.54%
Total runs:
873.8K
Run Growth:
865.6K
Growth Rate:
99.03%
Total runs:
354.0K
Run Growth:
92.9K
Growth Rate:
29.74%
Total runs:
320.3K
Run Growth:
44.2K
Growth Rate:
13.81%
Total runs:
254.3K
Run Growth:
22.1K
Growth Rate:
8.71%
Total runs:
240.8K
Run Growth:
37.5K
Growth Rate:
93.70%
Total runs:
190.0K
Run Growth:
-79.5K
Growth Rate:
-43.15%
Total runs:
184.6K
Run Growth:
60.5K
Growth Rate:
33.01%
Total runs:
111.1K
Run Growth:
48.5K
Growth Rate:
43.75%
Total runs:
84.3K
Run Growth:
48.2K
Growth Rate:
57.69%
Total runs:
60.2K
Run Growth:
9.3K
Growth Rate:
15.48%
Total runs:
54.1K
Run Growth:
-2.5K
Growth Rate:
-4.71%
Total runs:
51.1K
Run Growth:
23.7K
Growth Rate:
46.31%
Total runs:
41.1K
Run Growth:
11.9K
Growth Rate:
88.03%
Total runs:
32.1K
Run Growth:
4.5K
Growth Rate:
13.31%
Total runs:
31.1K
Run Growth:
14.3K
Growth Rate:
44.47%
Total runs:
27.5K
Run Growth:
9.1K
Growth Rate:
33.09%
Total runs:
24.5K
Run Growth:
-18.6K
Growth Rate:
-75.38%
Total runs:
24.4K
Run Growth:
11.7K
Growth Rate:
47.90%
Total runs:
24.4K
Run Growth:
-1.1K
Growth Rate:
-4.29%
Total runs:
20.6K
Run Growth:
6.4K
Growth Rate:
31.37%
Total runs:
18.1K
Run Growth:
-32.5K
Growth Rate:
-186.62%
Total runs:
15.9K
Run Growth:
-19.5K
Growth Rate:
-124.18%
Total runs:
12.2K
Run Growth:
5.4K
Growth Rate:
51.43%
Total runs:
11.2K
Run Growth:
2.1K
Growth Rate:
24.10%
Total runs:
8.6K
Run Growth:
2.5K
Growth Rate:
29.20%
Total runs:
7.9K
Run Growth:
3.9K
Growth Rate:
48.38%
Total runs:
7.3K
Run Growth:
516
Growth Rate:
5.91%
Total runs:
6.5K
Run Growth:
-4.8K
Growth Rate:
-75.30%
Total runs:
5.3K
Run Growth:
-1.4K
Growth Rate:
-27.10%
Total runs:
5.3K
Run Growth:
1.6K
Growth Rate:
29.04%
Total runs:
3.8K
Run Growth:
1.1K
Growth Rate:
28.73%
Total runs:
2.9K
Run Growth:
434
Growth Rate:
14.84%
Total runs:
2.9K
Run Growth:
2.2K
Growth Rate:
88.51%
Total runs:
2.9K
Run Growth:
2.4K
Growth Rate:
82.62%
Total runs:
2.7K
Run Growth:
1.4K
Growth Rate:
52.55%
Total runs:
2.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.6K
Run Growth:
-12
Growth Rate:
-0.47%
Total runs:
2.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.5K
Run Growth:
866
Growth Rate:
35.46%
Total runs:
2.4K
Run Growth:
-18.9K
Growth Rate:
-3039.81%
Total runs:
2.4K
Run Growth:
1.5K
Growth Rate:
63.98%
Total runs:
1.9K
Run Growth:
1.6K
Growth Rate:
83.45%
Total runs:
1.9K
Run Growth:
702
Growth Rate:
37.62%
Total runs:
1.8K
Run Growth:
-3.1K
Growth Rate:
-182.79%
Total runs:
1.8K
Run Growth:
586
Growth Rate:
34.53%
Total runs:
1.6K
Run Growth:
-3.1K
Growth Rate:
-198.53%
Total runs:
1.6K
Run Growth:
918
Growth Rate:
60.75%
Total runs:
1.5K
Run Growth:
1.2K
Growth Rate:
75.13%
Total runs:
1.5K
Run Growth:
1.5K
Growth Rate:
97.82%
Total runs:
1.5K
Run Growth:
571
Growth Rate:
40.61%
Total runs:
1.4K
Run Growth:
783
Growth Rate:
56.62%
Total runs:
1.3K
Run Growth:
-77
Growth Rate:
-6.13%
Total runs:
1.2K
Run Growth:
123
Growth Rate:
10.01%
Total runs:
978
Run Growth:
560
Growth Rate:
57.61%
Total runs:
904
Run Growth:
135
Growth Rate:
14.82%
Total runs:
820
Run Growth:
240
Growth Rate:
29.67%
Total runs:
814
Run Growth:
443
Growth Rate:
55.79%
Total runs:
782
Run Growth:
222
Growth Rate:
28.61%
Total runs:
744
Run Growth:
546
Growth Rate:
74.90%
Total runs:
727
Run Growth:
-2.0K
Growth Rate:
-275.17%
Total runs:
596
Run Growth:
0
Growth Rate:
0.00%
Total runs:
484
Run Growth:
221
Growth Rate:
49.44%
Total runs:
456
Run Growth:
143
Growth Rate:
31.29%
Total runs:
425
Run Growth:
158
Growth Rate:
33.26%
Total runs:
301
Run Growth:
154
Growth Rate:
64.17%
Total runs:
282
Run Growth:
60
Growth Rate:
24.10%
Total runs:
263
Run Growth:
-149
Growth Rate:
-56.02%
Total runs:
237
Run Growth:
168
Growth Rate:
83.58%
Total runs:
191
Run Growth:
-121
Growth Rate:
-61.42%
Total runs:
189
Run Growth:
-198
Growth Rate:
-113.14%
Total runs:
187
Run Growth:
-21
Growth Rate:
-10.10%
Total runs:
180
Run Growth:
-8.8K
Growth Rate:
-4720.97%
Total runs:
168
Run Growth:
163
Growth Rate:
97.02%
Total runs:
165
Run Growth:
163
Growth Rate:
98.79%
Total runs:
165
Run Growth:
143
Growth Rate:
86.67%
Total runs:
165
Run Growth:
158
Growth Rate:
95.76%
Total runs:
164
Run Growth:
160
Growth Rate:
97.56%
Total runs:
163
Run Growth:
147
Growth Rate:
90.18%
Total runs:
162
Run Growth:
154
Growth Rate:
95.06%
Total runs:
161
Run Growth:
154
Growth Rate:
95.65%
Total runs:
160
Run Growth:
-521
Growth Rate:
-333.97%
Total runs:
159
Run Growth:
151
Growth Rate:
94.97%
Total runs:
159
Run Growth:
154
Growth Rate:
96.86%
Total runs:
158
Run Growth:
152
Growth Rate:
96.20%
Total runs:
157
Run Growth:
152
Growth Rate:
96.82%
Total runs:
151
Run Growth:
-73
Growth Rate:
-54.07%
Total runs:
144
Run Growth:
-337
Growth Rate:
-245.99%
Total runs:
142
Run Growth:
-163
Growth Rate:
-111.64%
Total runs:
133
Run Growth:
-47
Growth Rate:
-36.72%
Total runs:
124
Run Growth:
93
Growth Rate:
76.86%
Total runs:
117
Run Growth:
112
Growth Rate:
95.73%
Total runs:
115
Run Growth:
-146
Growth Rate:
-129.20%