ISTA-DASLab / Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

huggingface.co
Total runs: 464
24-hour runs: -4
7-day runs: -50
30-day runs: 146
Model's Last Updated: 2024年5月14日
text-generation

Introduction of Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

Model Details of Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

Official AQLM quantization of meta-llama/Meta-Llama-3-70B-Instruct .

For this quantization, we used 1 codebook of 16 bits.

Results (measured with lm_eval==4.0 ):

Model Quantization MMLU (5-shot) ArcC ArcE Hellaswag Winogrande PiQA Model size, Gb
meta-llama/Meta-Llama-3-70B - 0.7980 0.6160 0.8624 0.6367 0.8183 0.7632 141.2
1x16 0.7587 0.4863 0.7668 0.6159 0.7481 0.7537 21.9

Runs of ISTA-DASLab Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 on huggingface.co

464
Total runs
-4
24-hour runs
7
3-day runs
-50
7-day runs
146
30-day runs

More Information About Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 huggingface.co Model

Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 huggingface.co

Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 huggingface.co is an AI model on huggingface.co that provides Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16's model effect (), which can be used instantly with this ISTA-DASLab Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 model. huggingface.co supports a free trial of the Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 model, and also provides paid use of the Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16. Support call Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 model through api, including Node.js, Python, http.

Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 huggingface.co Url

https://huggingface.co/ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

ISTA-DASLab Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 online free

Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 huggingface.co is an online trial and call api platform, which integrates Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16's modeling effects, including api services, and provides a free online trial of Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16, you can try Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 online for free by clicking the link below.

ISTA-DASLab Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 online free url in huggingface.co:

https://huggingface.co/ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 install

Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 is an open source model from GitHub that offers a free installation service, and any user can find Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 on GitHub to install. At the same time, huggingface.co provides the effect of Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 install, users can directly use Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 install url in huggingface.co:

https://huggingface.co/ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

Url of Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 huggingface.co Url

Provider of Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 huggingface.co

ISTA-DASLab
ORGANIZATIONS

Other API from ISTA-DASLab