Total runs:
6.0M
Run Growth:
852.8K
Growth Rate:
14.30%
BAAI / AquilaChat2-7B
Model's Last Updated: August 15 2024
text-generation
Introduction of AquilaChat2-7B
Model Details of AquilaChat2-7B
English | 简体中文
We opensource our Aquila2 series, now including Aquila2 , the base language models, namely Aquila2-7B and Aquila2-34B , as well as AquilaChat2 , the chat models, namely AquilaChat2-7B and AquilaChat2-34B , as well as the long-text chat models, namely AquilaChat2-7B-16k and AquilaChat2-34B-16k
The additional details of the Aquila model will be presented in the official technical report. Please stay tuned for updates on official channels.
Quick Start AquilaChat2-7B（Chat model）
1. Inference
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
from transformers import BitsAndBytesConfig
device = torch.device("cuda:0")
model_info = "BAAI/AquilaChat2-7B"
tokenizer = AutoTokenizer.from_pretrained(model_info, trust_remote_code=True)
quantization_config=BitsAndBytesConfig(
load_in_4bit=True,
bnb_4bit_use_double_quant=True,
bnb_4bit_quant_type="nf4",
bnb_4bit_compute_dtype=torch.bfloat16,
)
model = AutoModelForCausalLM.from_pretrained(model_info, trust_remote_code=True, torch_dtype=torch.float16,
# quantization_config=quantization_config, # Uncomment this line for 4bit quantization
)
model.eval()
model.to(device)
text = "请给出10个要到北京旅游的理由。"
from predict import predict
out = predict(model, text, tokenizer=tokenizer, max_gen_len=200, top_p=0.95,
seed=1234, topk=100, temperature=0.9, sft=True, device=device,
model_name="AquilaChat2-7B")
print(out)
License
Aquila2 series open-source model is licensed under BAAI Aquila Model Licence Agreement
Runs of BAAI AquilaChat2-7B on huggingface.co
4.9K
Total runs
-30
24-hour runs
138
3-day runs
243
7-day runs
116
30-day runs
More Information About AquilaChat2-7B huggingface.co Model
Url of AquilaChat2-7B
AquilaChat2-7B huggingface.co Url
Provider of AquilaChat2-7B huggingface.co
Other API from BAAI
Updated: February 22 2024
Total runs:
2.2M
Run Growth:
-2.2M
Growth Rate:
-99.23%
Total runs:
1.6M
Run Growth:
-447.1K
Growth Rate:
-27.49%
Total runs:
1.1M
Run Growth:
178.6K
Growth Rate:
16.18%
Total runs:
1.0M
Run Growth:
-135.8K
Growth Rate:
-13.11%
Total runs:
1.0M
Run Growth:
438.9K
Growth Rate:
43.76%
Total runs:
802.0K
Run Growth:
-6.6K
Growth Rate:
-0.83%
Total runs:
781.8K
Run Growth:
111.7K
Growth Rate:
14.29%
Total runs:
137.3K
Run Growth:
61.6K
Growth Rate:
44.88%
Total runs:
126.6K
Run Growth:
-6.2K
Growth Rate:
-4.92%
Total runs:
24.9K
Run Growth:
-2.1K
Growth Rate:
-8.35%
Total runs:
14.2K
Run Growth:
3.9K
Growth Rate:
27.07%
Total runs:
7.9K
Run Growth:
-11.1K
Growth Rate:
-84.72%
Total runs:
7.6K
Run Growth:
-2.4K
Growth Rate:
-31.26%
Total runs:
7.3K
Run Growth:
-1.8K
Growth Rate:
-24.22%
Total runs:
6.0K
Run Growth:
-1.4K
Growth Rate:
-23.79%
Total runs:
5.2K
Run Growth:
-2.0K
Growth Rate:
-37.54%
Total runs:
5.2K
Run Growth:
-2.0K
Growth Rate:
-38.22%
Total runs:
5.1K
Run Growth:
-2.0K
Growth Rate:
-38.19%
Total runs:
4.8K
Run Growth:
2.1K
Growth Rate:
45.97%
Total runs:
4.5K
Run Growth:
-8.6K
Growth Rate:
-193.53%
Total runs:
3.9K
Run Growth:
686
Growth Rate:
17.68%
Total runs:
3.5K
Run Growth:
-1.6K
Growth Rate:
-45.22%
Total runs:
3.4K
Run Growth:
-1.7K
Growth Rate:
-50.19%
Total runs:
2.6K
Run Growth:
196
Growth Rate:
7.14%
Total runs:
1.8K
Run Growth:
90
Growth Rate:
4.99%
Total runs:
1.2K
Run Growth:
950
Growth Rate:
80.65%
Total runs:
827
Run Growth:
25
Growth Rate:
86.21%
Total runs:
664
Run Growth:
0
Growth Rate:
0.00%
Total runs:
644
Run Growth:
0
Growth Rate:
0.00%
Total runs:
530
Run Growth:
-633
Growth Rate:
-29.46%
Total runs:
414
Run Growth:
70
Growth Rate:
16.91%
Total runs:
374
Run Growth:
-236
Growth Rate:
-63.10%
Total runs:
274
Run Growth:
-343
Growth Rate:
-125.18%
Total runs:
193
Run Growth:
27
Growth Rate:
14.59%
Total runs:
142
Run Growth:
-288
Growth Rate:
-202.82%
Total runs:
108
Run Growth:
82
Growth Rate:
75.93%
Total runs:
107
Run Growth:
-95
Growth Rate:
-150.79%
Total runs:
66
Run Growth:
11
Growth Rate:
17.74%
Total runs:
40
Run Growth:
3
Growth Rate:
100.00%
Total runs:
37
Run Growth:
3
Growth Rate:
100.00%
Total runs:
36
Run Growth:
-10.2K
Growth Rate:
-28375.00%
Total runs:
25
Run Growth:
-44
Growth Rate:
-176.00%
Total runs:
24
Run Growth:
-440
Growth Rate:
-427.18%
Total runs:
21
Run Growth:
1
Growth Rate:
100.00%
Total runs:
18
Run Growth:
-23
Growth Rate:
-127.78%