Total runs:
6.0M
Run Growth:
1.1M
Growth Rate:
17.75%
BAAI / AquilaChat2-34B
Model's Last Updated: August 15 2024
text-generation
Introduction of AquilaChat2-34B
Model Details of AquilaChat2-34B
English | 简体中文
We opensource our Aquila2 series, now including Aquila2 , the base language models, namely Aquila2-7B and Aquila2-34B , as well as AquilaChat2 , the chat models, namely AquilaChat2-7B and AquilaChat2-34B , as well as the long-text chat models, namely AquilaChat2-7B-16k and AquilaChat2-34B-16k
2023.10.25 🔥 AquilaChat2-34B v1.2 is based on the previous AquilaChat2-34B . The AquilaChat2-34B model is close to or exceeds the level of GPT3.5 in the subjective evaluation of 8 secondary ability dimensions.
The additional details of the Aquila model will be presented in the official technical report. Please stay tuned for updates on official channels.
Note
We have discovered a data leakage problem with the GSM8K test data in the pre-training task dataset. Therefore, the evaluation results of GSM8K have been removed from the evaluation results.
Upon thorough investigation and analysis, it was found that the data leakage occurred in the mathematical dataset A (over 2 million samples), recommended by a team we have collaborated with multiple times. This dataset includes the untreated GSM8K test set (1319 samples). The team only performed routine de-duplication and quality checks but did not conduct an extra filtering check for the presence of the GSM8K test data, resulting in this oversight.
Our team has always strictly adhered to the principle that training data should not include test data. Taking this lesson from the error caused by not thoroughly checking the source of external data, we have investigated all 2 trillion tokens of data for various test datasets, including WTM22（en-zh), CLUEWSC, Winograd, HellaSwag, OpenBookQA, PIQA, ARC-e, BUSTSM, BoolQ, TruthfulQA, RAFT, ChID, EPRSTMT, TNEWS, OCNLI, SEM-Chinese, MMLU, C-Eval, CMMLU, CSL and HumanEval.
Quick Start AquilaChat2-34B（Chat model）
1. Inference
from transformers import AutoTokenizer, AutoModelForCausalLM
from transformers import BitsAndBytesConfig
import torch
device = torch.device("cuda:0")
model_info = "BAAI/AquilaChat2-34B"
tokenizer = AutoTokenizer.from_pretrained(model_info, trust_remote_code=True)
quantization_config=BitsAndBytesConfig(
load_in_4bit=True,
bnb_4bit_use_double_quant=True,
bnb_4bit_quant_type="nf4",
bnb_4bit_compute_dtype=torch.bfloat16,
)
model = AutoModelForCausalLM.from_pretrained(model_info, trust_remote_code=True, torch_dtype=torch.bfloat16,
# quantization_config=quantization_config, # Uncomment this line for 4bit quantization
)
model.eval()
model.to(device)
text = "请给出10个要到北京旅游的理由。"
from predict import predict
out = predict(model, text, tokenizer=tokenizer, max_gen_len=200, top_p=0.9,
seed=123, topk=15, temperature=1.0, sft=True, device=device,
model_name="AquilaChat2-34B")
print(out)
License
Aquila2 series open-source model is licensed under BAAI Aquila Model Licence Agreement
Runs of BAAI AquilaChat2-34B on huggingface.co
155
Total runs
3
24-hour runs
13
3-day runs
-21
7-day runs
-194
30-day runs
More Information About AquilaChat2-34B huggingface.co Model
Url of AquilaChat2-34B
AquilaChat2-34B huggingface.co Url
Provider of AquilaChat2-34B huggingface.co
Other API from BAAI
Updated: February 22 2024
Total runs:
2.1M
Run Growth:
-2.2M
Growth Rate:
-103.34%
Total runs:
1.6M
Run Growth:
-338.7K
Growth Rate:
-20.91%
Total runs:
1.1M
Run Growth:
283.1K
Growth Rate:
25.27%
Total runs:
1.0M
Run Growth:
600.8K
Growth Rate:
59.08%
Total runs:
997.2K
Run Growth:
-144.0K
Growth Rate:
-14.26%
Total runs:
813.2K
Run Growth:
22.7K
Growth Rate:
2.80%
Total runs:
795.3K
Run Growth:
129.1K
Growth Rate:
16.23%
Total runs:
138.9K
Run Growth:
57.2K
Growth Rate:
41.20%
Total runs:
128.3K
Run Growth:
-1.3K
Growth Rate:
-1.04%
Total runs:
24.1K
Run Growth:
-1.9K
Growth Rate:
-7.86%
Total runs:
13.0K
Run Growth:
2.7K
Growth Rate:
20.80%
Total runs:
7.7K
Run Growth:
-11.1K
Growth Rate:
-84.72%
Total runs:
7.5K
Run Growth:
-1.4K
Growth Rate:
-18.72%
Total runs:
7.1K
Run Growth:
-2.6K
Growth Rate:
-37.13%
Total runs:
6.2K
Run Growth:
-976
Growth Rate:
-15.72%
Total runs:
5.3K
Run Growth:
-1.7K
Growth Rate:
-32.43%
Total runs:
5.3K
Run Growth:
-1.6K
Growth Rate:
-31.16%
Total runs:
5.2K
Run Growth:
-1.6K
Growth Rate:
-31.05%
Total runs:
5.0K
Run Growth:
2.4K
Growth Rate:
49.44%
Total runs:
4.4K
Run Growth:
-6.6K
Growth Rate:
-147.63%
Total runs:
4.1K
Run Growth:
907
Growth Rate:
22.37%
Total runs:
3.6K
Run Growth:
-1.3K
Growth Rate:
-34.91%
Total runs:
3.5K
Run Growth:
-1.4K
Growth Rate:
-40.03%
Total runs:
2.7K
Run Growth:
196
Growth Rate:
7.14%
Total runs:
1.8K
Run Growth:
248
Growth Rate:
13.75%
Total runs:
1.2K
Run Growth:
973
Growth Rate:
82.18%
Total runs:
962
Run Growth:
25
Growth Rate:
86.21%
Total runs:
664
Run Growth:
0
Growth Rate:
0.00%
Total runs:
644
Run Growth:
0
Growth Rate:
0.00%
Total runs:
505
Run Growth:
-633
Growth Rate:
-29.46%
Total runs:
425
Run Growth:
95
Growth Rate:
22.35%
Total runs:
310
Run Growth:
-351
Growth Rate:
-113.23%
Total runs:
193
Run Growth:
35
Growth Rate:
18.13%
Total runs:
141
Run Growth:
-247
Growth Rate:
-175.18%
Total runs:
107
Run Growth:
81
Growth Rate:
75.70%
Total runs:
94
Run Growth:
-95
Growth Rate:
-150.79%
Total runs:
57
Run Growth:
11
Growth Rate:
17.74%
Total runs:
40
Run Growth:
3
Growth Rate:
100.00%
Total runs:
35
Run Growth:
3
Growth Rate:
100.00%
Total runs:
32
Run Growth:
-10.2K
Growth Rate:
-31943.75%
Total runs:
25
Run Growth:
-45
Growth Rate:
-180.00%
Total runs:
23
Run Growth:
-440
Growth Rate:
-427.18%
Total runs:
22
Run Growth:
1
Growth Rate:
100.00%
Total runs:
17
Run Growth:
-21
Growth Rate:
-123.53%