Total runs:
6.0M
Run Growth:
1.1M
Growth Rate:
17.75%
BAAI / AquilaChat2-7B-16K
Model's Last Updated: January 10 2024
text-generation
Introduction of AquilaChat2-7B-16K
Model Details of AquilaChat2-7B-16K
English | 简体中文
We opensource our Aquila2 series, now including Aquila2 , the base language models, namely Aquila2-7B and Aquila2-34B , as well as AquilaChat2 , the chat models, namely AquilaChat2-7B and AquilaChat2-34B , as well as the long-text chat models, namely AquilaChat2-7B-16k and AquilaChat2-34B-16k
The additional details of the Aquila model will be presented in the official technical report. Please stay tuned for updates on official channels.
Quick Start AquilaChat2-7B-16K（Chat model）
1. Inference
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
from transformers import BitsAndBytesConfig
device = torch.device("cuda:0")
model_info = "BAAI/AquilaChat2-7B-16K"
tokenizer = AutoTokenizer.from_pretrained(model_info, trust_remote_code=True)
quantization_config=BitsAndBytesConfig(
load_in_4bit=True,
bnb_4bit_use_double_quant=True,
bnb_4bit_quant_type="nf4",
bnb_4bit_compute_dtype=torch.bfloat16,
)
model = AutoModelForCausalLM.from_pretrained(model_info, trust_remote_code=True, torch_dtype=torch.float16,
# quantization_config=quantization_config, # Uncomment this line for 4bit quantization
)
model.eval()
model.to(device)
text = "请给出10个要到北京旅游的理由。"
from predict import predict
out = predict(model, text, tokenizer=tokenizer, max_gen_len=200, top_p=0.95,
seed=1234, topk=100, temperature=0.9, sft=True, device=device,
model_name="AquilaChat2-7B-16K")
print(out)
License
Aquila2 series open-source model is licensed under BAAI Aquila Model Licence Agreement
Runs of BAAI AquilaChat2-7B-16K on huggingface.co
39
Total runs
0
24-hour runs
0
3-day runs
-3
7-day runs
0
30-day runs
More Information About AquilaChat2-7B-16K huggingface.co Model
Url of AquilaChat2-7B-16K
AquilaChat2-7B-16K huggingface.co Url
Provider of AquilaChat2-7B-16K huggingface.co
Other API from BAAI
Updated: February 22 2024
Total runs:
2.1M
Run Growth:
-2.2M
Growth Rate:
-103.34%
Total runs:
1.6M
Run Growth:
-338.7K
Growth Rate:
-20.91%
Total runs:
1.1M
Run Growth:
283.1K
Growth Rate:
25.27%
Total runs:
1.0M
Run Growth:
600.8K
Growth Rate:
59.08%
Total runs:
997.2K
Run Growth:
-144.0K
Growth Rate:
-14.26%
Total runs:
813.2K
Run Growth:
22.7K
Growth Rate:
2.80%
Total runs:
795.3K
Run Growth:
129.1K
Growth Rate:
16.23%
Total runs:
138.9K
Run Growth:
57.2K
Growth Rate:
41.20%
Total runs:
128.3K
Run Growth:
-1.3K
Growth Rate:
-1.04%
Total runs:
24.1K
Run Growth:
-1.9K
Growth Rate:
-7.86%
Total runs:
13.0K
Run Growth:
2.7K
Growth Rate:
20.80%
Total runs:
7.8K
Run Growth:
-11.1K
Growth Rate:
-84.72%
Total runs:
7.5K
Run Growth:
-1.4K
Growth Rate:
-18.72%
Total runs:
7.1K
Run Growth:
-2.6K
Growth Rate:
-37.13%
Total runs:
6.2K
Run Growth:
-976
Growth Rate:
-15.72%
Total runs:
5.3K
Run Growth:
-1.7K
Growth Rate:
-32.43%
Total runs:
5.3K
Run Growth:
-1.6K
Growth Rate:
-31.16%
Total runs:
5.2K
Run Growth:
-1.6K
Growth Rate:
-31.05%
Total runs:
5.0K
Run Growth:
2.4K
Growth Rate:
49.44%
Total runs:
4.4K
Run Growth:
-6.6K
Growth Rate:
-147.63%
Total runs:
4.1K
Run Growth:
907
Growth Rate:
22.37%
Total runs:
3.6K
Run Growth:
-1.3K
Growth Rate:
-34.91%
Total runs:
3.5K
Run Growth:
-1.4K
Growth Rate:
-40.03%
Total runs:
2.7K
Run Growth:
196
Growth Rate:
7.14%
Total runs:
1.8K
Run Growth:
248
Growth Rate:
13.75%
Total runs:
1.2K
Run Growth:
973
Growth Rate:
82.18%
Total runs:
962
Run Growth:
25
Growth Rate:
86.21%
Total runs:
664
Run Growth:
0
Growth Rate:
0.00%
Total runs:
644
Run Growth:
0
Growth Rate:
0.00%
Total runs:
505
Run Growth:
-633
Growth Rate:
-29.46%
Total runs:
425
Run Growth:
95
Growth Rate:
22.35%
Total runs:
310
Run Growth:
-351
Growth Rate:
-113.23%
Total runs:
193
Run Growth:
35
Growth Rate:
18.13%
Total runs:
141
Run Growth:
-247
Growth Rate:
-175.18%
Total runs:
107
Run Growth:
81
Growth Rate:
75.70%
Total runs:
94
Run Growth:
-95
Growth Rate:
-150.79%
Total runs:
57
Run Growth:
11
Growth Rate:
17.74%
Total runs:
40
Run Growth:
3
Growth Rate:
100.00%
Total runs:
35
Run Growth:
3
Growth Rate:
100.00%
Total runs:
32
Run Growth:
-10.2K
Growth Rate:
-31943.75%
Total runs:
25
Run Growth:
-45
Growth Rate:
-180.00%
Total runs:
23
Run Growth:
-440
Growth Rate:
-427.18%
Total runs:
22
Run Growth:
1
Growth Rate:
100.00%
Total runs:
17
Run Growth:
-21
Growth Rate:
-123.53%