ISTA-DASLab / Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

huggingface.co
Total runs: 76
24-hour runs: -22
7-day runs: -52
30-day runs: -98
Model's Last Updated: February 27 2024
text-generation

Introduction of Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Model Details of Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Official AQLM quantization of mistralai/Mixtral-8x7B-Instruct-v0.1 .

For this quantization, we used 1 codebook of 16 bits.

Selected evaluation results for this model:

Model AQLM scheme WinoGrande PiQA HellaSwag ArcE ArcC Model size, Gb Hub link
Mixtral-8x7B-Instruct-v0.1 (THIS) 1x16 0.7593 0.8043 0.6179 0.7768 0.4793 12.6 Link

To learn more about the inference, as well as the information on how to quantize models yourself, please refer to the official GitHub repo .

Runs of ISTA-DASLab Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf on huggingface.co

76
Total runs
-22
24-hour runs
-35
3-day runs
-52
7-day runs
-98
30-day runs

More Information About Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf huggingface.co Model

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf huggingface.co

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf huggingface.co is an AI model on huggingface.co that provides Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf's model effect (), which can be used instantly with this ISTA-DASLab Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf model. huggingface.co supports a free trial of the Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf model, and also provides paid use of the Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf. Support call Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf model through api, including Node.js, Python, http.

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf huggingface.co Url

https://huggingface.co/ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

ISTA-DASLab Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf online free

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf huggingface.co is an online trial and call api platform, which integrates Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf's modeling effects, including api services, and provides a free online trial of Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf, you can try Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf online for free by clicking the link below.

ISTA-DASLab Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf online free url in huggingface.co:

https://huggingface.co/ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf install

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf is an open source model from GitHub that offers a free installation service, and any user can find Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf on GitHub to install. At the same time, huggingface.co provides the effect of Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf install, users can directly use Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf install url in huggingface.co:

https://huggingface.co/ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Url of Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf huggingface.co Url

Provider of Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf huggingface.co

ISTA-DASLab
ORGANIZATIONS

Other API from ISTA-DASLab