hfl / chinese-llama-2-7b-16k-gguf

huggingface.co
Total runs: 184
24-hour runs: 8
7-day runs: 24
30-day runs: -151
Model's Last Updated: January 24 2024

Introduction of chinese-llama-2-7b-16k-gguf

Model Details of chinese-llama-2-7b-16k-gguf

Chinese-LLaMA-2-7B-16K-GGUF

This repository contains the GGUF-v3 models (llama.cpp compatible) for Chinese-LLaMA-2-7B-16K .

Performance

Metric: PPL, lower is better

Quant original imatrix ( -im )
Q2_K 11.5580 +/- 0.23848 12.3757 +/- 0.26048
Q3_K 9.8263 +/- 0.20663 9.7124 +/- 0.20569
Q4_0 9.6558 +/- 0.20657 -
Q4_K 9.5590 +/- 0.20460 9.4945 +/- 0.20337
Q5_0 9.2767 +/- 0.19835 -
Q5_K 9.4303 +/- 0.20305 9.4275 +/- 0.20291
Q6_K 9.4046 +/- 0.20272 9.4106 +/- 0.20284
Q8_0 9.2145 +/- 0.19943 -
F16 9.4045 +/- 0.20289 -

The model with -im suffix is generated with important matrix, which has generally better performance (not always though).

Others

For Hugging Face version, please see: https://huggingface.co/hfl/chinese-llama-2-7b-16k

Please refer to https://github.com/ymcui/Chinese-LLaMA-Alpaca-2/ for more details.

Runs of hfl chinese-llama-2-7b-16k-gguf on huggingface.co

184
Total runs
8
24-hour runs
13
3-day runs
24
7-day runs
-151
30-day runs

More Information About chinese-llama-2-7b-16k-gguf huggingface.co Model

More chinese-llama-2-7b-16k-gguf license Visit here:

https://choosealicense.com/licenses/apache-2.0

chinese-llama-2-7b-16k-gguf huggingface.co

chinese-llama-2-7b-16k-gguf huggingface.co is an AI model on huggingface.co that provides chinese-llama-2-7b-16k-gguf's model effect (), which can be used instantly with this hfl chinese-llama-2-7b-16k-gguf model. huggingface.co supports a free trial of the chinese-llama-2-7b-16k-gguf model, and also provides paid use of the chinese-llama-2-7b-16k-gguf. Support call chinese-llama-2-7b-16k-gguf model through api, including Node.js, Python, http.

chinese-llama-2-7b-16k-gguf huggingface.co Url

https://huggingface.co/hfl/chinese-llama-2-7b-16k-gguf

hfl chinese-llama-2-7b-16k-gguf online free

chinese-llama-2-7b-16k-gguf huggingface.co is an online trial and call api platform, which integrates chinese-llama-2-7b-16k-gguf's modeling effects, including api services, and provides a free online trial of chinese-llama-2-7b-16k-gguf, you can try chinese-llama-2-7b-16k-gguf online for free by clicking the link below.

hfl chinese-llama-2-7b-16k-gguf online free url in huggingface.co:

https://huggingface.co/hfl/chinese-llama-2-7b-16k-gguf

chinese-llama-2-7b-16k-gguf install

chinese-llama-2-7b-16k-gguf is an open source model from GitHub that offers a free installation service, and any user can find chinese-llama-2-7b-16k-gguf on GitHub to install. At the same time, huggingface.co provides the effect of chinese-llama-2-7b-16k-gguf install, users can directly use chinese-llama-2-7b-16k-gguf installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

chinese-llama-2-7b-16k-gguf install url in huggingface.co:

https://huggingface.co/hfl/chinese-llama-2-7b-16k-gguf

Url of chinese-llama-2-7b-16k-gguf

chinese-llama-2-7b-16k-gguf huggingface.co Url

Provider of chinese-llama-2-7b-16k-gguf huggingface.co

hfl
ORGANIZATIONS

Other API from hfl

huggingface.co

Total runs: 49.8K
Run Growth: 14.5K
Growth Rate: 29.16%
Updated: May 19 2021
huggingface.co

Total runs: 4.3K
Run Growth: 407
Growth Rate: 9.55%
Updated: May 19 2021
huggingface.co

Total runs: 1.1K
Run Growth: 213
Growth Rate: 19.70%
Updated: March 05 2024
huggingface.co

Total runs: 358
Run Growth: -406
Growth Rate: -113.41%
Updated: November 15 2022
huggingface.co

Total runs: 256
Run Growth: -100
Growth Rate: -39.06%
Updated: May 19 2021
huggingface.co

Total runs: 150
Run Growth: 30
Growth Rate: 20.00%
Updated: January 24 2022
huggingface.co

Total runs: 136
Run Growth: 82
Growth Rate: 60.29%
Updated: February 24 2022
huggingface.co

Total runs: 102
Run Growth: 61
Growth Rate: 59.80%
Updated: February 24 2022
huggingface.co

Total runs: 79
Run Growth: -58
Growth Rate: -73.42%
Updated: November 15 2022
huggingface.co

Total runs: 53
Run Growth: -41
Growth Rate: -77.36%
Updated: November 17 2022
huggingface.co

Total runs: 32
Run Growth: -356
Growth Rate: -1112.50%
Updated: May 19 2021
huggingface.co

Total runs: 24
Run Growth: 5
Growth Rate: 20.83%
Updated: February 21 2022
huggingface.co

Total runs: 22
Run Growth: 12
Growth Rate: 54.55%
Updated: March 09 2023
huggingface.co

Total runs: 17
Run Growth: -16
Growth Rate: -94.12%
Updated: January 24 2022
huggingface.co

Total runs: 17
Run Growth: -15
Growth Rate: -88.24%
Updated: November 15 2022
huggingface.co

Total runs: 12
Run Growth: -42
Growth Rate: -350.00%
Updated: January 24 2022
huggingface.co

Total runs: 8
Run Growth: 2
Growth Rate: 25.00%
Updated: March 09 2023
huggingface.co

Total runs: 7
Run Growth: -9
Growth Rate: -128.57%
Updated: May 19 2021
huggingface.co

Total runs: 7
Run Growth: -2
Growth Rate: -28.57%
Updated: March 09 2023