Total runs:
1.9M
Run Growth:
412.8K
Growth Rate:
22.46%
Salesforce / instructblip-flan-t5-xl
Model's Last Updated: November 22 2024
image-text-to-text
Introduction of instructblip-flan-t5-xl
Model Details of instructblip-flan-t5-xl
InstructBLIP model
InstructBLIP model using Flan-T5-xl as language model. InstructBLIP was introduced in the paper InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning by Dai et al.
Disclaimer: The team releasing InstructBLIP did not write a model card for this model so this model card has been written by the Hugging Face team.
Model description
InstructBLIP is a visual instruction tuned version of BLIP-2 . Refer to the paper for details.
Intended uses & limitations
Usage is as follows:
from transformers import InstructBlipProcessor, InstructBlipForConditionalGeneration
import torch
from PIL import Image
import requests
model = InstructBlipForConditionalGeneration.from_pretrained("Salesforce/instructblip-flan-t5-xl")
processor = InstructBlipProcessor.from_pretrained("Salesforce/instructblip-flan-t5-xl")
device = "cuda" if torch.cuda.is_available() else "cpu"
model.to(device)
url = "https://raw.githubusercontent.com/salesforce/LAVIS/main/docs/_static/Confusing-Pictures.jpg"
image = Image.open(requests.get(url, stream=True).raw).convert("RGB")
prompt = "What is unusual about this image?"
inputs = processor(images=image, text=prompt, return_tensors="pt").to(device)
outputs = model.generate(
**inputs,
do_sample=False,
num_beams=5,
max_length=256,
min_length=1,
top_p=0.9,
repetition_penalty=1.5,
length_penalty=1.0,
temperature=1,
)
generated_text = processor.batch_decode(outputs, skip_special_tokens=True)[0].strip()
print(generated_text)
How to use
For code examples, we refer to the documentation .
Runs of Salesforce instructblip-flan-t5-xl on huggingface.co
8.7K
Total runs
0
24-hour runs
352
3-day runs
1.3K
7-day runs
523
30-day runs
More Information About instructblip-flan-t5-xl huggingface.co Model
Url of instructblip-flan-t5-xl
instructblip-flan-t5-xl huggingface.co Url
Provider of instructblip-flan-t5-xl huggingface.co
Other API from Salesforce
Updated: August 01 2023
Total runs:
1.1M
Run Growth:
-446.5K
Growth Rate:
-41.14%
Total runs:
874.4K
Run Growth:
865.1K
Growth Rate:
98.94%
Total runs:
311.0K
Run Growth:
11.2K
Growth Rate:
3.69%
Total runs:
288.6K
Run Growth:
60.8K
Growth Rate:
21.22%
Total runs:
251.0K
Run Growth:
12.0K
Growth Rate:
4.79%
Total runs:
191.3K
Run Growth:
37.5K
Growth Rate:
93.70%
Total runs:
183.4K
Run Growth:
57.4K
Growth Rate:
31.63%
Total runs:
175.9K
Run Growth:
-132.0K
Growth Rate:
-75.80%
Total runs:
102.2K
Run Growth:
10.8K
Growth Rate:
10.81%
Total runs:
82.9K
Run Growth:
40.1K
Growth Rate:
48.73%
Total runs:
64.8K
Run Growth:
15.7K
Growth Rate:
24.20%
Total runs:
52.3K
Run Growth:
18.5K
Growth Rate:
35.17%
Total runs:
50.9K
Run Growth:
-11.8K
Growth Rate:
-23.15%
Total runs:
37.7K
Run Growth:
-16.9K
Growth Rate:
-44.71%
Total runs:
36.7K
Run Growth:
-7.6K
Growth Rate:
-20.74%
Total runs:
34.8K
Run Growth:
11.9K
Growth Rate:
88.03%
Total runs:
31.5K
Run Growth:
9.2K
Growth Rate:
29.48%
Total runs:
29.2K
Run Growth:
2.6K
Growth Rate:
9.05%
Total runs:
26.8K
Run Growth:
92
Growth Rate:
0.35%
Total runs:
26.5K
Run Growth:
2.8K
Growth Rate:
10.86%
Total runs:
24.2K
Run Growth:
7.4K
Growth Rate:
30.42%
Total runs:
24.0K
Run Growth:
-8.5K
Growth Rate:
-27.47%
Total runs:
21.7K
Run Growth:
8.6K
Growth Rate:
40.16%
Total runs:
18.7K
Run Growth:
12.6K
Growth Rate:
67.34%
Total runs:
9.3K
Run Growth:
3.9K
Growth Rate:
41.14%
Total runs:
8.3K
Run Growth:
-2.2K
Growth Rate:
-26.94%
Total runs:
8.0K
Run Growth:
4.0K
Growth Rate:
49.67%
Total runs:
6.9K
Run Growth:
-256
Growth Rate:
-3.78%
Total runs:
6.6K
Run Growth:
-10.5K
Growth Rate:
-158.00%
Total runs:
5.1K
Run Growth:
-2.7K
Growth Rate:
-55.25%
Total runs:
4.1K
Run Growth:
-72
Growth Rate:
-1.78%
Total runs:
4.0K
Run Growth:
757
Growth Rate:
19.74%
Total runs:
3.0K
Run Growth:
-111
Growth Rate:
-3.78%
Total runs:
3.0K
Run Growth:
2.6K
Growth Rate:
86.37%
Total runs:
2.8K
Run Growth:
1.1K
Growth Rate:
43.03%
Total runs:
2.6K
Run Growth:
-161
Growth Rate:
-6.23%
Total runs:
2.4K
Run Growth:
720
Growth Rate:
29.85%
Total runs:
2.2K
Run Growth:
1.2K
Growth Rate:
56.19%
Total runs:
2.2K
Run Growth:
1.9K
Growth Rate:
85.53%
Total runs:
2.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.8K
Run Growth:
-3.2K
Growth Rate:
-178.52%
Total runs:
1.8K
Run Growth:
1.4K
Growth Rate:
79.61%
Total runs:
1.7K
Run Growth:
231
Growth Rate:
14.54%
Total runs:
1.5K
Run Growth:
-3.2K
Growth Rate:
-211.50%
Total runs:
1.5K
Run Growth:
1.1K
Growth Rate:
74.34%
Total runs:
1.5K
Run Growth:
1.4K
Growth Rate:
95.48%
Total runs:
1.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.5K
Run Growth:
258
Growth Rate:
18.49%
Total runs:
1.3K
Run Growth:
-23
Growth Rate:
-1.82%
Total runs:
1.3K
Run Growth:
601
Growth Rate:
48.47%
Total runs:
1.3K
Run Growth:
-338
Growth Rate:
-25.00%
Total runs:
1.3K
Run Growth:
211
Growth Rate:
17.69%
Total runs:
1.2K
Run Growth:
357
Growth Rate:
32.10%
Total runs:
1.2K
Run Growth:
18
Growth Rate:
1.72%
Total runs:
1.1K
Run Growth:
-1.4K
Growth Rate:
-126.91%
Total runs:
934
Run Growth:
-58
Growth Rate:
-6.37%
Total runs:
860
Run Growth:
353
Growth Rate:
40.67%
Total runs:
850
Run Growth:
144
Growth Rate:
16.96%
Total runs:
795
Run Growth:
422
Growth Rate:
53.83%
Total runs:
653
Run Growth:
465
Growth Rate:
71.98%
Total runs:
628
Run Growth:
-33
Growth Rate:
-5.51%
Total runs:
545
Run Growth:
0
Growth Rate:
0.00%
Total runs:
494
Run Growth:
121
Growth Rate:
24.49%
Total runs:
447
Run Growth:
-151
Growth Rate:
-34.01%
Total runs:
393
Run Growth:
140
Growth Rate:
35.90%
Total runs:
253
Run Growth:
-398
Growth Rate:
-163.11%
Total runs:
229
Run Growth:
-138
Growth Rate:
-75.82%
Total runs:
196
Run Growth:
-44
Growth Rate:
-22.00%
Total runs:
190
Run Growth:
58
Growth Rate:
31.18%
Total runs:
189
Run Growth:
-183
Growth Rate:
-83.94%
Total runs:
165
Run Growth:
-243
Growth Rate:
-149.08%
Total runs:
164
Run Growth:
-542
Growth Rate:
-328.48%
Total runs:
144
Run Growth:
-293
Growth Rate:
-207.80%
Total runs:
131
Run Growth:
109
Growth Rate:
83.21%
Total runs:
123
Run Growth:
-365
Growth Rate:
-304.17%
Total runs:
117
Run Growth:
86
Growth Rate:
74.14%
Total runs:
116
Run Growth:
-100
Growth Rate:
-90.09%
Total runs:
114
Run Growth:
-8.9K
Growth Rate:
-7812.28%
Total runs:
113
Run Growth:
106
Growth Rate:
93.81%
Total runs:
109
Run Growth:
93
Growth Rate:
86.92%
Total runs:
108
Run Growth:
-270
Growth Rate:
-259.62%
Total runs:
108
Run Growth:
-188
Growth Rate:
-202.15%
Total runs:
108
Run Growth:
0
Growth Rate:
0.00%
Total runs:
104
Run Growth:
96
Growth Rate:
91.43%
Total runs:
103
Run Growth:
89
Growth Rate:
84.76%
Total runs:
95
Run Growth:
-94
Growth Rate:
-103.30%
Total runs:
85
Run Growth:
-202
Growth Rate:
-237.65%
Total runs:
78
Run Growth:
-126
Growth Rate:
-161.54%
Total runs:
72
Run Growth:
5
Growth Rate:
6.85%
Total runs:
56
Run Growth:
-101
Growth Rate:
-202.00%
Total runs:
55
Run Growth:
26
Growth Rate:
47.27%