hfl / chinese-alpaca-2-1.3b-rlhf-gguf

huggingface.co
Total runs: 356
24-hour runs: 0
7-day runs: 38
30-day runs: 197
Model's Last Updated: January 24 2024

Introduction of chinese-alpaca-2-1.3b-rlhf-gguf

Model Details of chinese-alpaca-2-1.3b-rlhf-gguf

Chinese-Alpaca-2-1.3B-RLHF-GGUF

This repository contains GGUF-v3 version (llama.cpp compatible) of Chinese-Alpaca-2-1.3B-RLHF , which is tuned on Chinese-Alpaca-2-1.3B with RLHF using DeepSpeed-Chat.

The optimal context length is 1K for this model. Specify -c 1024 when using with llama.cpp

Performance

Metric: PPL, lower is better

Quant original imatrix ( -im )
Q2_K 20.1066 +/- 0.29236 18.8209 +/- 0.27561
Q3_K 16.9214 +/- 0.26133 16.5729 +/- 0.25706
Q4_0 15.8056 +/- 0.23749 -
Q4_K 16.1579 +/- 0.25064 15.7746 +/- 0.24476
Q5_0 15.4528 +/- 0.23911 -
Q5_K 15.3198 +/- 0.23627 15.4791 +/- 0.23959
Q6_K 15.3718 +/- 0.23764 15.2572 +/- 0.23549
Q8_0 15.3302 +/- 0.23727 -
F16 15.3291 +/- 0.23728 -

The model with -im suffix is generated with important matrix, which has generally better performance (not always though).

Others

For full model in HuggingFace format, please see: https://huggingface.co/hfl/chinese-alpaca-2-1.3b-rlhf

Please refer to https://github.com/ymcui/Chinese-LLaMA-Alpaca-2/ for more details.

Runs of hfl chinese-alpaca-2-1.3b-rlhf-gguf on huggingface.co

356
Total runs
0
24-hour runs
-11
3-day runs
38
7-day runs
197
30-day runs

More Information About chinese-alpaca-2-1.3b-rlhf-gguf huggingface.co Model

More chinese-alpaca-2-1.3b-rlhf-gguf license Visit here:

https://choosealicense.com/licenses/apache-2.0

chinese-alpaca-2-1.3b-rlhf-gguf huggingface.co

chinese-alpaca-2-1.3b-rlhf-gguf huggingface.co is an AI model on huggingface.co that provides chinese-alpaca-2-1.3b-rlhf-gguf's model effect (), which can be used instantly with this hfl chinese-alpaca-2-1.3b-rlhf-gguf model. huggingface.co supports a free trial of the chinese-alpaca-2-1.3b-rlhf-gguf model, and also provides paid use of the chinese-alpaca-2-1.3b-rlhf-gguf. Support call chinese-alpaca-2-1.3b-rlhf-gguf model through api, including Node.js, Python, http.

chinese-alpaca-2-1.3b-rlhf-gguf huggingface.co Url

https://huggingface.co/hfl/chinese-alpaca-2-1.3b-rlhf-gguf

hfl chinese-alpaca-2-1.3b-rlhf-gguf online free

chinese-alpaca-2-1.3b-rlhf-gguf huggingface.co is an online trial and call api platform, which integrates chinese-alpaca-2-1.3b-rlhf-gguf's modeling effects, including api services, and provides a free online trial of chinese-alpaca-2-1.3b-rlhf-gguf, you can try chinese-alpaca-2-1.3b-rlhf-gguf online for free by clicking the link below.

hfl chinese-alpaca-2-1.3b-rlhf-gguf online free url in huggingface.co:

https://huggingface.co/hfl/chinese-alpaca-2-1.3b-rlhf-gguf

chinese-alpaca-2-1.3b-rlhf-gguf install

chinese-alpaca-2-1.3b-rlhf-gguf is an open source model from GitHub that offers a free installation service, and any user can find chinese-alpaca-2-1.3b-rlhf-gguf on GitHub to install. At the same time, huggingface.co provides the effect of chinese-alpaca-2-1.3b-rlhf-gguf install, users can directly use chinese-alpaca-2-1.3b-rlhf-gguf installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

chinese-alpaca-2-1.3b-rlhf-gguf install url in huggingface.co:

https://huggingface.co/hfl/chinese-alpaca-2-1.3b-rlhf-gguf

Url of chinese-alpaca-2-1.3b-rlhf-gguf

chinese-alpaca-2-1.3b-rlhf-gguf huggingface.co Url

Provider of chinese-alpaca-2-1.3b-rlhf-gguf huggingface.co

hfl
ORGANIZATIONS

Other API from hfl

huggingface.co

Total runs: 52.3K
Run Growth: 16.5K
Growth Rate: 31.67%
Updated: May 20 2021
huggingface.co

Total runs: 4.1K
Run Growth: 284
Growth Rate: 6.90%
Updated: May 20 2021
huggingface.co

Total runs: 1.2K
Run Growth: 386
Growth Rate: 31.64%
Updated: March 05 2024
huggingface.co

Total runs: 352
Run Growth: -376
Growth Rate: -106.82%
Updated: November 15 2022
huggingface.co

Total runs: 222
Run Growth: -122
Growth Rate: -53.28%
Updated: May 20 2021
huggingface.co

Total runs: 147
Run Growth: 26
Growth Rate: 17.69%
Updated: January 24 2022
huggingface.co

Total runs: 131
Run Growth: 70
Growth Rate: 53.03%
Updated: February 24 2022
huggingface.co

Total runs: 116
Run Growth: 68
Growth Rate: 64.76%
Updated: February 24 2022
huggingface.co

Total runs: 75
Run Growth: -64
Growth Rate: -85.33%
Updated: November 15 2022
huggingface.co

Total runs: 69
Run Growth: 61
Growth Rate: 87.14%
Updated: March 09 2023
huggingface.co

Total runs: 54
Run Growth: 52
Growth Rate: 96.30%
Updated: March 09 2023
huggingface.co

Total runs: 48
Run Growth: 43
Growth Rate: 89.58%
Updated: March 09 2023
huggingface.co

Total runs: 40
Run Growth: -58
Growth Rate: -145.00%
Updated: November 17 2022
huggingface.co

Total runs: 22
Run Growth: -318
Growth Rate: -1514.29%
Updated: May 20 2021
huggingface.co

Total runs: 17
Run Growth: -14
Growth Rate: -82.35%
Updated: January 24 2022
huggingface.co

Total runs: 15
Run Growth: -15
Growth Rate: -100.00%
Updated: November 15 2022
huggingface.co

Total runs: 14
Run Growth: -13
Growth Rate: -92.86%
Updated: February 21 2022
huggingface.co

Total runs: 6
Run Growth: -12
Growth Rate: -200.00%
Updated: May 20 2021
huggingface.co

Total runs: 5
Run Growth: -51
Growth Rate: -1020.00%
Updated: January 24 2022