hfl / chinese-llama-2-7b-64k-gguf

huggingface.co
Total runs: 207
24-hour runs: 0
7-day runs: -3
30-day runs: 71
Model's Last Updated: January 24 2024

Introduction of chinese-llama-2-7b-64k-gguf

Model Details of chinese-llama-2-7b-64k-gguf

Chinese-LLaMA-2-7B-64K

This repository contains GGUF-v3 version (llama.cpp compatible) of Chinese-LLaMA-2-7B-64K , which is tuned on Chinese-LLaMA-2-7B with YaRN method .

Performance

Metric: PPL, lower is better

Quant original imatrix ( -im )
Q2_K 11.5424 +/- 0.24106 12.1599 +/- 0.26050
Q3_K 10.0152 +/- 0.21296 9.9269 +/- 0.21335
Q4_0 9.7500 +/- 0.20872 -
Q4_K 9.7687 +/- 0.21133 9.7239 +/- 0.20999
Q5_0 9.4647 +/- 0.20280 -
Q5_K 9.6229 +/- 0.20829 9.5673 +/- 0.20675
Q6_K 9.5996 +/- 0.20816 9.5753 +/- 0.20734
Q8_0 9.4078 +/- 0.20378 -
F16 9.5750 +/- 0.20735 -

The model with -im suffix is generated with important matrix, which has generally better performance (not always though).

Others

For full model in HuggingFace format, please see: https://huggingface.co/hfl/chinese-llama-2-7b-64k

Please refer to https://github.com/ymcui/Chinese-LLaMA-Alpaca-2/ for more details.

Runs of hfl chinese-llama-2-7b-64k-gguf on huggingface.co

207
Total runs
0
24-hour runs
9
3-day runs
-3
7-day runs
71
30-day runs

More Information About chinese-llama-2-7b-64k-gguf huggingface.co Model

More chinese-llama-2-7b-64k-gguf license Visit here:

https://choosealicense.com/licenses/apache-2.0

chinese-llama-2-7b-64k-gguf huggingface.co

chinese-llama-2-7b-64k-gguf huggingface.co is an AI model on huggingface.co that provides chinese-llama-2-7b-64k-gguf's model effect (), which can be used instantly with this hfl chinese-llama-2-7b-64k-gguf model. huggingface.co supports a free trial of the chinese-llama-2-7b-64k-gguf model, and also provides paid use of the chinese-llama-2-7b-64k-gguf. Support call chinese-llama-2-7b-64k-gguf model through api, including Node.js, Python, http.

chinese-llama-2-7b-64k-gguf huggingface.co Url

https://huggingface.co/hfl/chinese-llama-2-7b-64k-gguf

hfl chinese-llama-2-7b-64k-gguf online free

chinese-llama-2-7b-64k-gguf huggingface.co is an online trial and call api platform, which integrates chinese-llama-2-7b-64k-gguf's modeling effects, including api services, and provides a free online trial of chinese-llama-2-7b-64k-gguf, you can try chinese-llama-2-7b-64k-gguf online for free by clicking the link below.

hfl chinese-llama-2-7b-64k-gguf online free url in huggingface.co:

https://huggingface.co/hfl/chinese-llama-2-7b-64k-gguf

chinese-llama-2-7b-64k-gguf install

chinese-llama-2-7b-64k-gguf is an open source model from GitHub that offers a free installation service, and any user can find chinese-llama-2-7b-64k-gguf on GitHub to install. At the same time, huggingface.co provides the effect of chinese-llama-2-7b-64k-gguf install, users can directly use chinese-llama-2-7b-64k-gguf installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

chinese-llama-2-7b-64k-gguf install url in huggingface.co:

https://huggingface.co/hfl/chinese-llama-2-7b-64k-gguf

Url of chinese-llama-2-7b-64k-gguf

chinese-llama-2-7b-64k-gguf huggingface.co Url

Provider of chinese-llama-2-7b-64k-gguf huggingface.co

hfl
ORGANIZATIONS

Other API from hfl

huggingface.co

Total runs: 49.6K
Run Growth: 14.4K
Growth Rate: 29.04%
Updated: May 19 2021
huggingface.co

Total runs: 4.2K
Run Growth: 185
Growth Rate: 4.34%
Updated: May 19 2021
huggingface.co

Total runs: 986
Run Growth: 35
Growth Rate: 3.55%
Updated: March 05 2024
huggingface.co

Total runs: 361
Run Growth: -407
Growth Rate: -112.74%
Updated: November 15 2022
huggingface.co

Total runs: 254
Run Growth: -138
Growth Rate: -54.33%
Updated: May 19 2021
huggingface.co

Total runs: 151
Run Growth: 32
Growth Rate: 21.19%
Updated: January 24 2022
huggingface.co

Total runs: 134
Run Growth: 74
Growth Rate: 55.22%
Updated: February 24 2022
huggingface.co

Total runs: 81
Run Growth: -63
Growth Rate: -77.78%
Updated: November 15 2022
huggingface.co

Total runs: 59
Run Growth: -264
Growth Rate: -293.33%
Updated: May 19 2021
huggingface.co

Total runs: 53
Run Growth: -48
Growth Rate: -90.57%
Updated: November 17 2022
huggingface.co

Total runs: 25
Run Growth: 8
Growth Rate: 30.77%
Updated: February 21 2022
huggingface.co

Total runs: 20
Run Growth: -10
Growth Rate: -50.00%
Updated: January 24 2022
huggingface.co

Total runs: 19
Run Growth: -10
Growth Rate: -52.63%
Updated: November 15 2022
huggingface.co

Total runs: 13
Run Growth: -39
Growth Rate: -300.00%
Updated: January 24 2022
huggingface.co

Total runs: 7
Run Growth: 1
Growth Rate: 14.29%
Updated: March 09 2023
huggingface.co

Total runs: 7
Run Growth: -10
Growth Rate: -142.86%
Updated: May 19 2021
huggingface.co

Total runs: 7
Run Growth: 1
Growth Rate: 14.29%
Updated: March 09 2023