MaziyarPanahi / WizardLM-2-8x22B-GGUF

huggingface.co
Total runs: 56.5K
24-hour runs: -5
7-day runs: 12.4K
30-day runs: 25.9K
Model's Last Updated: April 17 2024
text-generation

Introduction of WizardLM-2-8x22B-GGUF

Model Details of WizardLM-2-8x22B-GGUF

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Description

MaziyarPanahi/WizardLM-2-8x22B-GGUF contains GGUF format model files for microsoft/WizardLM-2-8x22B .

How to download

You can download only the quants you need instead of cloning the entire repository as follows:

huggingface-cli download MaziyarPanahi/WizardLM-2-8x22B-GGUF --local-dir . --include '*Q2_K*gguf'

On Windows:

huggingface-cli download MaziyarPanahi/WizardLM-2-8x22B-GGUF --local-dir . --include *Q4_K_S*gguf
Load sharded model

llama_load_model_from_file will detect the number of files and will load additional tensors from the rest of files.

llama.cpp/main -m WizardLM-2-8x22B.Q2_K-00001-of-00005.gguf -p "Building a website can be done in 10 simple steps:\nStep 1:" -n 1024 -e
Prompt template
{system_prompt}
USER: {prompt}
ASSISTANT: </s>

or

A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, 
detailed, and polite answers to the user's questions. USER: Hi ASSISTANT: Hello.</s>
USER: {prompt} ASSISTANT: </s>......

Runs of MaziyarPanahi WizardLM-2-8x22B-GGUF on huggingface.co

56.5K
Total runs
-5
24-hour runs
-6
3-day runs
12.4K
7-day runs
25.9K
30-day runs

More Information About WizardLM-2-8x22B-GGUF huggingface.co Model

More WizardLM-2-8x22B-GGUF license Visit here:

https://choosealicense.com/licenses/apache-2.0

WizardLM-2-8x22B-GGUF huggingface.co

WizardLM-2-8x22B-GGUF huggingface.co is an AI model on huggingface.co that provides WizardLM-2-8x22B-GGUF's model effect (), which can be used instantly with this MaziyarPanahi WizardLM-2-8x22B-GGUF model. huggingface.co supports a free trial of the WizardLM-2-8x22B-GGUF model, and also provides paid use of the WizardLM-2-8x22B-GGUF. Support call WizardLM-2-8x22B-GGUF model through api, including Node.js, Python, http.

WizardLM-2-8x22B-GGUF huggingface.co Url

https://huggingface.co/MaziyarPanahi/WizardLM-2-8x22B-GGUF

MaziyarPanahi WizardLM-2-8x22B-GGUF online free

WizardLM-2-8x22B-GGUF huggingface.co is an online trial and call api platform, which integrates WizardLM-2-8x22B-GGUF's modeling effects, including api services, and provides a free online trial of WizardLM-2-8x22B-GGUF, you can try WizardLM-2-8x22B-GGUF online for free by clicking the link below.

MaziyarPanahi WizardLM-2-8x22B-GGUF online free url in huggingface.co:

https://huggingface.co/MaziyarPanahi/WizardLM-2-8x22B-GGUF

WizardLM-2-8x22B-GGUF install

WizardLM-2-8x22B-GGUF is an open source model from GitHub that offers a free installation service, and any user can find WizardLM-2-8x22B-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of WizardLM-2-8x22B-GGUF install, users can directly use WizardLM-2-8x22B-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

WizardLM-2-8x22B-GGUF install url in huggingface.co:

https://huggingface.co/MaziyarPanahi/WizardLM-2-8x22B-GGUF

Url of WizardLM-2-8x22B-GGUF

WizardLM-2-8x22B-GGUF huggingface.co Url

Provider of WizardLM-2-8x22B-GGUF huggingface.co

MaziyarPanahi
ORGANIZATIONS

Other API from MaziyarPanahi