hfl / chinese-llama-2-7b-16k-gguf

huggingface.co
Total runs: 171
24-hour runs: 2
7-day runs: -2
30-day runs: -172
Model's Last Updated: January 24 2024

Introduction of chinese-llama-2-7b-16k-gguf

Model Details of chinese-llama-2-7b-16k-gguf

Chinese-LLaMA-2-7B-16K-GGUF

This repository contains the GGUF-v3 models (llama.cpp compatible) for Chinese-LLaMA-2-7B-16K .

Performance

Metric: PPL, lower is better

Quant original imatrix ( -im )
Q2_K 11.5580 +/- 0.23848 12.3757 +/- 0.26048
Q3_K 9.8263 +/- 0.20663 9.7124 +/- 0.20569
Q4_0 9.6558 +/- 0.20657 -
Q4_K 9.5590 +/- 0.20460 9.4945 +/- 0.20337
Q5_0 9.2767 +/- 0.19835 -
Q5_K 9.4303 +/- 0.20305 9.4275 +/- 0.20291
Q6_K 9.4046 +/- 0.20272 9.4106 +/- 0.20284
Q8_0 9.2145 +/- 0.19943 -
F16 9.4045 +/- 0.20289 -

The model with -im suffix is generated with important matrix, which has generally better performance (not always though).

Others

For Hugging Face version, please see: https://huggingface.co/hfl/chinese-llama-2-7b-16k

Please refer to https://github.com/ymcui/Chinese-LLaMA-Alpaca-2/ for more details.

Runs of hfl chinese-llama-2-7b-16k-gguf on huggingface.co

171
Total runs
2
24-hour runs
5
3-day runs
-2
7-day runs
-172
30-day runs

More Information About chinese-llama-2-7b-16k-gguf huggingface.co Model

More chinese-llama-2-7b-16k-gguf license Visit here:

https://choosealicense.com/licenses/apache-2.0

chinese-llama-2-7b-16k-gguf huggingface.co

chinese-llama-2-7b-16k-gguf huggingface.co is an AI model on huggingface.co that provides chinese-llama-2-7b-16k-gguf's model effect (), which can be used instantly with this hfl chinese-llama-2-7b-16k-gguf model. huggingface.co supports a free trial of the chinese-llama-2-7b-16k-gguf model, and also provides paid use of the chinese-llama-2-7b-16k-gguf. Support call chinese-llama-2-7b-16k-gguf model through api, including Node.js, Python, http.

chinese-llama-2-7b-16k-gguf huggingface.co Url

https://huggingface.co/hfl/chinese-llama-2-7b-16k-gguf

hfl chinese-llama-2-7b-16k-gguf online free

chinese-llama-2-7b-16k-gguf huggingface.co is an online trial and call api platform, which integrates chinese-llama-2-7b-16k-gguf's modeling effects, including api services, and provides a free online trial of chinese-llama-2-7b-16k-gguf, you can try chinese-llama-2-7b-16k-gguf online for free by clicking the link below.

hfl chinese-llama-2-7b-16k-gguf online free url in huggingface.co:

https://huggingface.co/hfl/chinese-llama-2-7b-16k-gguf

chinese-llama-2-7b-16k-gguf install

chinese-llama-2-7b-16k-gguf is an open source model from GitHub that offers a free installation service, and any user can find chinese-llama-2-7b-16k-gguf on GitHub to install. At the same time, huggingface.co provides the effect of chinese-llama-2-7b-16k-gguf install, users can directly use chinese-llama-2-7b-16k-gguf installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

chinese-llama-2-7b-16k-gguf install url in huggingface.co:

https://huggingface.co/hfl/chinese-llama-2-7b-16k-gguf

Url of chinese-llama-2-7b-16k-gguf

chinese-llama-2-7b-16k-gguf huggingface.co Url

Provider of chinese-llama-2-7b-16k-gguf huggingface.co

hfl
ORGANIZATIONS

Other API from hfl

huggingface.co

Total runs: 49.6K
Run Growth: 14.1K
Growth Rate: 28.95%
Updated: May 20 2021
huggingface.co

Total runs: 4.3K
Run Growth: 278
Growth Rate: 6.40%
Updated: May 20 2021
huggingface.co

Total runs: 986
Run Growth: -48
Growth Rate: -5.11%
Updated: March 05 2024
huggingface.co

Total runs: 361
Run Growth: -417
Growth Rate: -120.52%
Updated: November 15 2022
huggingface.co

Total runs: 254
Run Growth: -131
Growth Rate: -50.38%
Updated: May 20 2021
huggingface.co

Total runs: 151
Run Growth: 32
Growth Rate: 21.19%
Updated: January 24 2022
huggingface.co

Total runs: 134
Run Growth: 71
Growth Rate: 52.99%
Updated: February 24 2022
huggingface.co

Total runs: 90
Run Growth: -226
Growth Rate: -221.57%
Updated: May 20 2021
huggingface.co

Total runs: 81
Run Growth: 11
Growth Rate: 9.32%
Updated: November 15 2022
huggingface.co

Total runs: 53
Run Growth: -51
Growth Rate: -92.73%
Updated: November 17 2022
huggingface.co

Total runs: 26
Run Growth: 7
Growth Rate: 26.92%
Updated: February 21 2022
huggingface.co

Total runs: 20
Run Growth: -10
Growth Rate: -50.00%
Updated: January 24 2022
huggingface.co

Total runs: 19
Run Growth: -10
Growth Rate: -52.63%
Updated: November 15 2022
huggingface.co

Total runs: 13
Run Growth: -40
Growth Rate: -307.69%
Updated: January 24 2022
huggingface.co

Total runs: 7
Run Growth: -1
Growth Rate: -20.00%
Updated: March 09 2023
huggingface.co

Total runs: 7
Run Growth: -6
Growth Rate: -66.67%
Updated: May 20 2021
huggingface.co

Total runs: 7
Run Growth: 0
Growth Rate: 0.00%
Updated: March 09 2023