ISTA-DASLab / Mistral-7B-v0.1-AQLM-2Bit-1x16-hf

huggingface.co
Total runs: 105
24-hour runs: -12
7-day runs: -14
30-day runs: -97
Model's Last Updated: März 12 2024
text-generation

Introduction of Mistral-7B-v0.1-AQLM-2Bit-1x16-hf

Model Details of Mistral-7B-v0.1-AQLM-2Bit-1x16-hf

Official AQLM quantization of Mistral-7B-v0.1 .

For this quantization, we used 1 codebook of 16 bits.

Results (0-shot acc ):

Model Quantization WinoGrande PiQA HellaSwag ArcE ArcC Model size, Gb
Mistral-7B-v0.1 None 0.7364 0.8047 0.6115 0.7887 0.4923 14.5
1x16 0.6914 0.7845 0.5745 0.7504 0.4420 2.51

To learn more about the inference, as well as the information on how to quantize models yourself, please refer to the official GitHub repo .

Runs of ISTA-DASLab Mistral-7B-v0.1-AQLM-2Bit-1x16-hf on huggingface.co

105
Total runs
-12
24-hour runs
-53
3-day runs
-14
7-day runs
-97
30-day runs

More Information About Mistral-7B-v0.1-AQLM-2Bit-1x16-hf huggingface.co Model

Mistral-7B-v0.1-AQLM-2Bit-1x16-hf huggingface.co

Mistral-7B-v0.1-AQLM-2Bit-1x16-hf huggingface.co is an AI model on huggingface.co that provides Mistral-7B-v0.1-AQLM-2Bit-1x16-hf's model effect (), which can be used instantly with this ISTA-DASLab Mistral-7B-v0.1-AQLM-2Bit-1x16-hf model. huggingface.co supports a free trial of the Mistral-7B-v0.1-AQLM-2Bit-1x16-hf model, and also provides paid use of the Mistral-7B-v0.1-AQLM-2Bit-1x16-hf. Support call Mistral-7B-v0.1-AQLM-2Bit-1x16-hf model through api, including Node.js, Python, http.

Mistral-7B-v0.1-AQLM-2Bit-1x16-hf huggingface.co Url

https://huggingface.co/ISTA-DASLab/Mistral-7B-v0.1-AQLM-2Bit-1x16-hf

ISTA-DASLab Mistral-7B-v0.1-AQLM-2Bit-1x16-hf online free

Mistral-7B-v0.1-AQLM-2Bit-1x16-hf huggingface.co is an online trial and call api platform, which integrates Mistral-7B-v0.1-AQLM-2Bit-1x16-hf's modeling effects, including api services, and provides a free online trial of Mistral-7B-v0.1-AQLM-2Bit-1x16-hf, you can try Mistral-7B-v0.1-AQLM-2Bit-1x16-hf online for free by clicking the link below.

ISTA-DASLab Mistral-7B-v0.1-AQLM-2Bit-1x16-hf online free url in huggingface.co:

https://huggingface.co/ISTA-DASLab/Mistral-7B-v0.1-AQLM-2Bit-1x16-hf

Mistral-7B-v0.1-AQLM-2Bit-1x16-hf install

Mistral-7B-v0.1-AQLM-2Bit-1x16-hf is an open source model from GitHub that offers a free installation service, and any user can find Mistral-7B-v0.1-AQLM-2Bit-1x16-hf on GitHub to install. At the same time, huggingface.co provides the effect of Mistral-7B-v0.1-AQLM-2Bit-1x16-hf install, users can directly use Mistral-7B-v0.1-AQLM-2Bit-1x16-hf installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Mistral-7B-v0.1-AQLM-2Bit-1x16-hf install url in huggingface.co:

https://huggingface.co/ISTA-DASLab/Mistral-7B-v0.1-AQLM-2Bit-1x16-hf

Url of Mistral-7B-v0.1-AQLM-2Bit-1x16-hf

Mistral-7B-v0.1-AQLM-2Bit-1x16-hf huggingface.co Url

Provider of Mistral-7B-v0.1-AQLM-2Bit-1x16-hf huggingface.co

ISTA-DASLab
ORGANIZATIONS

Other API from ISTA-DASLab