Total runs:
1.9M
Run Growth:
441.8K
Growth Rate:
23.80%
Salesforce / instructblip-vicuna-7b
Model's Last Updated: November 22 2024
image-text-to-text
Introduction of instructblip-vicuna-7b
Model Details of instructblip-vicuna-7b
InstructBLIP model
InstructBLIP model using Vicuna-7b as language model. InstructBLIP was introduced in the paper InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning by Dai et al.
Disclaimer: The team releasing InstructBLIP did not write a model card for this model so this model card has been written by the Hugging Face team.
Model description
InstructBLIP is a visual instruction tuned version of BLIP-2 . Refer to the paper for details.
Intended uses & limitations
Usage is as follows:
from transformers import InstructBlipProcessor, InstructBlipForConditionalGeneration
import torch
from PIL import Image
import requests
model = InstructBlipForConditionalGeneration.from_pretrained("Salesforce/instructblip-vicuna-7b")
processor = InstructBlipProcessor.from_pretrained("Salesforce/instructblip-vicuna-7b")
device = "cuda" if torch.cuda.is_available() else "cpu"
model.to(device)
url = "https://raw.githubusercontent.com/salesforce/LAVIS/main/docs/_static/Confusing-Pictures.jpg"
image = Image.open(requests.get(url, stream=True).raw).convert("RGB")
prompt = "What is unusual about this image?"
inputs = processor(images=image, text=prompt, return_tensors="pt").to(device)
outputs = model.generate(
**inputs,
do_sample=False,
num_beams=5,
max_length=256,
min_length=1,
top_p=0.9,
repetition_penalty=1.5,
length_penalty=1.0,
temperature=1,
)
generated_text = processor.batch_decode(outputs, skip_special_tokens=True)[0].strip()
print(generated_text)
How to use
For code examples, we refer to the documentation .
Runs of Salesforce instructblip-vicuna-7b on huggingface.co
251.0K
Total runs
0
24-hour runs
-1.3K
3-day runs
6.4K
7-day runs
12.0K
30-day runs
More Information About instructblip-vicuna-7b huggingface.co Model
Url of instructblip-vicuna-7b
instructblip-vicuna-7b huggingface.co Url
Provider of instructblip-vicuna-7b huggingface.co
Other API from Salesforce
Updated: August 01 2023
Total runs:
1.1M
Run Growth:
-427.8K
Growth Rate:
-39.97%
Total runs:
874.4K
Run Growth:
865.1K
Growth Rate:
98.94%
Total runs:
311.0K
Run Growth:
25.4K
Growth Rate:
8.17%
Total runs:
288.6K
Run Growth:
64.1K
Growth Rate:
22.21%
Total runs:
191.3K
Run Growth:
37.5K
Growth Rate:
93.70%
Total runs:
183.4K
Run Growth:
57.4K
Growth Rate:
31.63%
Total runs:
175.9K
Run Growth:
-122.8K
Growth Rate:
-69.78%
Total runs:
102.2K
Run Growth:
10.8K
Growth Rate:
10.81%
Total runs:
82.9K
Run Growth:
40.1K
Growth Rate:
48.73%
Total runs:
64.8K
Run Growth:
15.7K
Growth Rate:
24.20%
Total runs:
52.3K
Run Growth:
19.9K
Growth Rate:
37.99%
Total runs:
50.9K
Run Growth:
-9.5K
Growth Rate:
-18.73%
Total runs:
37.7K
Run Growth:
-16.3K
Growth Rate:
-43.20%
Total runs:
36.7K
Run Growth:
-7.2K
Growth Rate:
-19.63%
Total runs:
34.8K
Run Growth:
11.9K
Growth Rate:
88.03%
Total runs:
31.5K
Run Growth:
9.9K
Growth Rate:
31.31%
Total runs:
29.2K
Run Growth:
2.6K
Growth Rate:
9.05%
Total runs:
26.8K
Run Growth:
2.4K
Growth Rate:
8.95%
Total runs:
26.5K
Run Growth:
2.8K
Growth Rate:
10.86%
Total runs:
24.2K
Run Growth:
7.4K
Growth Rate:
30.51%
Total runs:
24.0K
Run Growth:
-20.0K
Growth Rate:
-83.47%
Total runs:
21.7K
Run Growth:
8.6K
Growth Rate:
40.16%
Total runs:
18.7K
Run Growth:
12.6K
Growth Rate:
67.34%
Total runs:
9.3K
Run Growth:
3.9K
Growth Rate:
41.14%
Total runs:
8.7K
Run Growth:
892
Growth Rate:
10.20%
Total runs:
8.3K
Run Growth:
-2.0K
Growth Rate:
-24.66%
Total runs:
8.0K
Run Growth:
4.0K
Growth Rate:
49.67%
Total runs:
6.9K
Run Growth:
-256
Growth Rate:
-3.78%
Total runs:
6.6K
Run Growth:
-10.5K
Growth Rate:
-158.00%
Total runs:
5.1K
Run Growth:
-2.1K
Growth Rate:
-42.00%
Total runs:
4.1K
Run Growth:
-72
Growth Rate:
-1.78%
Total runs:
4.0K
Run Growth:
757
Growth Rate:
19.74%
Total runs:
3.0K
Run Growth:
-111
Growth Rate:
-3.78%
Total runs:
3.0K
Run Growth:
2.6K
Growth Rate:
86.37%
Total runs:
2.8K
Run Growth:
1.1K
Growth Rate:
43.03%
Total runs:
2.6K
Run Growth:
-161
Growth Rate:
-6.23%
Total runs:
2.4K
Run Growth:
720
Growth Rate:
29.85%
Total runs:
2.2K
Run Growth:
1.2K
Growth Rate:
56.19%
Total runs:
2.2K
Run Growth:
1.9K
Growth Rate:
85.53%
Total runs:
2.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.8K
Run Growth:
-3.2K
Growth Rate:
-172.48%
Total runs:
1.8K
Run Growth:
1.4K
Growth Rate:
80.74%
Total runs:
1.7K
Run Growth:
423
Growth Rate:
25.62%
Total runs:
1.5K
Run Growth:
-3.1K
Growth Rate:
-204.05%
Total runs:
1.5K
Run Growth:
1.2K
Growth Rate:
76.13%
Total runs:
1.5K
Run Growth:
1.4K
Growth Rate:
95.48%
Total runs:
1.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.5K
Run Growth:
346
Growth Rate:
23.38%
Total runs:
1.3K
Run Growth:
-23
Growth Rate:
-1.82%
Total runs:
1.3K
Run Growth:
687
Growth Rate:
52.72%
Total runs:
1.3K
Run Growth:
-193
Growth Rate:
-14.97%
Total runs:
1.3K
Run Growth:
286
Growth Rate:
22.88%
Total runs:
1.2K
Run Growth:
472
Growth Rate:
40.14%
Total runs:
1.2K
Run Growth:
18
Growth Rate:
1.72%
Total runs:
1.1K
Run Growth:
-1.4K
Growth Rate:
-126.91%
Total runs:
934
Run Growth:
-14
Growth Rate:
-1.50%
Total runs:
860
Run Growth:
341
Growth Rate:
39.65%
Total runs:
850
Run Growth:
144
Growth Rate:
16.96%
Total runs:
795
Run Growth:
455
Growth Rate:
57.23%
Total runs:
653
Run Growth:
465
Growth Rate:
71.98%
Total runs:
628
Run Growth:
-33
Growth Rate:
-5.51%
Total runs:
545
Run Growth:
0
Growth Rate:
0.00%
Total runs:
494
Run Growth:
130
Growth Rate:
26.32%
Total runs:
447
Run Growth:
-105
Growth Rate:
-23.49%
Total runs:
393
Run Growth:
140
Growth Rate:
35.90%
Total runs:
253
Run Growth:
-398
Growth Rate:
-163.11%
Total runs:
229
Run Growth:
-138
Growth Rate:
-75.82%
Total runs:
196
Run Growth:
-44
Growth Rate:
-22.00%
Total runs:
190
Run Growth:
58
Growth Rate:
31.18%
Total runs:
189
Run Growth:
-223
Growth Rate:
-117.99%
Total runs:
165
Run Growth:
-243
Growth Rate:
-149.08%
Total runs:
164
Run Growth:
-547
Growth Rate:
-333.54%
Total runs:
144
Run Growth:
-293
Growth Rate:
-207.80%
Total runs:
131
Run Growth:
109
Growth Rate:
83.21%
Total runs:
123
Run Growth:
-360
Growth Rate:
-292.68%
Total runs:
117
Run Growth:
86
Growth Rate:
74.14%
Total runs:
116
Run Growth:
-100
Growth Rate:
-90.09%
Total runs:
114
Run Growth:
-8.9K
Growth Rate:
-7800.88%
Total runs:
113
Run Growth:
106
Growth Rate:
93.81%
Total runs:
109
Run Growth:
93
Growth Rate:
86.92%
Total runs:
108
Run Growth:
-270
Growth Rate:
-259.62%
Total runs:
108
Run Growth:
-188
Growth Rate:
-202.15%
Total runs:
108
Run Growth:
0
Growth Rate:
0.00%
Total runs:
104
Run Growth:
96
Growth Rate:
91.43%
Total runs:
103
Run Growth:
89
Growth Rate:
84.76%
Total runs:
95
Run Growth:
-94
Growth Rate:
-103.30%
Total runs:
85
Run Growth:
-202
Growth Rate:
-237.65%
Total runs:
78
Run Growth:
-126
Growth Rate:
-161.54%
Total runs:
72
Run Growth:
5
Growth Rate:
6.85%
Total runs:
56
Run Growth:
-89
Growth Rate:
-158.93%
Total runs:
55
Run Growth:
26
Growth Rate:
47.27%