Total runs:
6.0M
Run Growth:
1.1M
Growth Rate:
17.75%
BAAI / AquilaChat2-34B-16K
Model's Last Updated: August 15 2024
text-generation
Introduction of AquilaChat2-34B-16K
Model Details of AquilaChat2-34B-16K
English | 简体中文
We opensource our Aquila2 series, now including Aquila2 , the base language models, namely Aquila2-7B and Aquila2-34B , as well as AquilaChat2 , the chat models, namely AquilaChat2-7B and AquilaChat2-34B , as well as the long-text chat models, namely AquilaChat2-7B-16k and AquilaChat2-34B-16k
2023.10.25 🔥 AquilaChat2-34B-16K v1.2 is based on the previous AquilaChat2-34B-16K . The AquilaChat2-34B-16K-V1.2 has significantly improved long-text synthesis capabilities compared to the V1 version, approaching the level of GPT-3.5-16K. Additionally, the V1.2 version incorporates more conventional instruction fine-tuning corpora, enhancing its performance in non-long-text scenarios compared to the V1 version.
The additional details of the Aquila model will be presented in the official technical report. Please stay tuned for updates on official channels.
Quick Start AquilaChat2-34B-16K（Chat model）
1. Inference
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
device = torch.device("cuda:0")
model_info = "BAAI/AquilaChat2-34B-16k"
tokenizer = AutoTokenizer.from_pretrained(model_info, trust_remote_code=True)
quantization_config=BitsAndBytesConfig(
load_in_4bit=True,
bnb_4bit_use_double_quant=True,
bnb_4bit_quant_type="nf4",
bnb_4bit_compute_dtype=torch.bfloat16,
)
model = AutoModelForCausalLM.from_pretrained(model_info, trust_remote_code=True, torch_dtype=torch.bfloat16,
# quantization_config=quantization_config, # Uncomment this line for 4bit quantization
)
model.eval()
model.to(device)
text = "请给出10个要到北京旅游的理由。"
from predict import predict
out = predict(model, text, tokenizer=tokenizer, max_gen_len=200, top_p=0.9,
seed=123, topk=15, temperature=1.0, sft=True, device=device,
model_name="AquilaChat2-34B-16K")
print(out)
License
Aquila2 series open-source model is licensed under BAAI Aquila Model Licence Agreement
Runs of BAAI AquilaChat2-34B-16K on huggingface.co
141
Total runs
-3
24-hour runs
-2
3-day runs
-44
7-day runs
-247
30-day runs
More Information About AquilaChat2-34B-16K huggingface.co Model
Url of AquilaChat2-34B-16K
AquilaChat2-34B-16K huggingface.co Url
Provider of AquilaChat2-34B-16K huggingface.co
Other API from BAAI
Updated: February 22 2024
Total runs:
2.1M
Run Growth:
-2.2M
Growth Rate:
-103.34%
Total runs:
1.6M
Run Growth:
-338.7K
Growth Rate:
-20.91%
Total runs:
1.1M
Run Growth:
283.1K
Growth Rate:
25.27%
Total runs:
1.0M
Run Growth:
600.8K
Growth Rate:
59.08%
Total runs:
997.2K
Run Growth:
-144.0K
Growth Rate:
-14.26%
Total runs:
813.2K
Run Growth:
22.7K
Growth Rate:
2.80%
Total runs:
795.3K
Run Growth:
129.1K
Growth Rate:
16.23%
Total runs:
138.9K
Run Growth:
57.2K
Growth Rate:
41.20%
Total runs:
128.3K
Run Growth:
-1.3K
Growth Rate:
-1.04%
Total runs:
24.1K
Run Growth:
-1.9K
Growth Rate:
-7.86%
Total runs:
13.0K
Run Growth:
2.7K
Growth Rate:
20.80%
Total runs:
7.8K
Run Growth:
-11.1K
Growth Rate:
-84.72%
Total runs:
7.5K
Run Growth:
-1.4K
Growth Rate:
-18.72%
Total runs:
7.1K
Run Growth:
-2.6K
Growth Rate:
-37.13%
Total runs:
6.2K
Run Growth:
-976
Growth Rate:
-15.72%
Total runs:
5.3K
Run Growth:
-1.7K
Growth Rate:
-32.43%
Total runs:
5.3K
Run Growth:
-1.6K
Growth Rate:
-31.16%
Total runs:
5.2K
Run Growth:
-1.6K
Growth Rate:
-31.05%
Total runs:
5.0K
Run Growth:
2.4K
Growth Rate:
49.44%
Total runs:
4.4K
Run Growth:
-6.6K
Growth Rate:
-147.63%
Total runs:
4.1K
Run Growth:
907
Growth Rate:
22.37%
Total runs:
3.6K
Run Growth:
-1.3K
Growth Rate:
-34.91%
Total runs:
3.5K
Run Growth:
-1.4K
Growth Rate:
-40.03%
Total runs:
2.7K
Run Growth:
196
Growth Rate:
7.14%
Total runs:
1.8K
Run Growth:
248
Growth Rate:
13.75%
Total runs:
1.2K
Run Growth:
973
Growth Rate:
82.18%
Total runs:
962
Run Growth:
25
Growth Rate:
86.21%
Total runs:
664
Run Growth:
0
Growth Rate:
0.00%
Total runs:
644
Run Growth:
0
Growth Rate:
0.00%
Total runs:
505
Run Growth:
-633
Growth Rate:
-29.46%
Total runs:
425
Run Growth:
95
Growth Rate:
22.35%
Total runs:
310
Run Growth:
-351
Growth Rate:
-113.23%
Total runs:
193
Run Growth:
35
Growth Rate:
18.13%
Total runs:
107
Run Growth:
81
Growth Rate:
75.70%
Total runs:
94
Run Growth:
-95
Growth Rate:
-150.79%
Total runs:
57
Run Growth:
11
Growth Rate:
17.74%
Total runs:
40
Run Growth:
3
Growth Rate:
100.00%
Total runs:
35
Run Growth:
3
Growth Rate:
100.00%
Total runs:
32
Run Growth:
-10.2K
Growth Rate:
-31943.75%
Total runs:
25
Run Growth:
-45
Growth Rate:
-180.00%
Total runs:
23
Run Growth:
-440
Growth Rate:
-427.18%
Total runs:
22
Run Growth:
1
Growth Rate:
100.00%
Total runs:
17
Run Growth:
-21
Growth Rate:
-123.53%