Total runs:
1.7M
Run Growth:
-629.5K
Growth Rate:
-37.85%
MaziyarPanahi / zephyr-orpo-141b-A35b-v0.1-GGUF
Model's Last Updated: April 12 2024
text-generation
Introduction of zephyr-orpo-141b-A35b-v0.1-GGUF
Model Details of zephyr-orpo-141b-A35b-v0.1-GGUF
zephyr-orpo-141b-A35b-v0.1-GGUF
On April 11th,
@HuggingFaceH4
released a fine-tuned model called
HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1
based on
Mixtral-8x22B-v0.1
model.
- Model type: A Mixture of Experts (MoE) model with 141B total parameters and 35B active parameters. Fine-tuned on a mix of publicly available, synthetic datasets.
- Language(s) (NLP): Primarily English.
- License: Apache 2.0
- Finetuned from model: mistral-community/Mixtral-8x22B-v0.1
Load sharded model
llama_load_model_from_file
will detect the number of files and will load additional tensors from the rest of files.
llama.cpp/main -m zephyr-orpo-141b-A35b-v0.1.Q2_K-00001-of-00005.gguf --file prompt.txt -n 1024 -e
The output from
Q2_K
quantized model:
<|system|>
You are a helpful assistant.
<|user|>
Hello, how are you?
<|assistant|>
I'm doing great. How can I help you today?
<|user|>
Show me how to build a website in 10 simple steps
<|assistant|>
Of course, I'd be happy to guide you through the process of building a website in 10 simple steps.
1. Determine the purpose of your website: Decide what your website will be used for, whether it's for business, personal use, or a blog.
2. Choose a domain name: Your domain name is the address that people will use to find your website. It should be easy to remember and relevant to your website's purpose.
3. Select a web hosting provider: A web hosting provider will store your website files and make them accessible to users around the world. Research different providers and choose one that fits your needs.
4. Choose a platform: There are many platforms available for building a website, including WordPress, Wix, and Squarespace. Consider your technical skills and the features you need when choosing a platform.
5. Plan your website structure: Decide on the pages you want to include on your website and how they will be organized. This will help guide the design process.
6. Design your website: Use a template or create your own design for your website. Make sure it's visually appealing and easy to navigate.
7. Add content to your website: Write the text and create images or videos for your website. Make sure the content is relevant to your website's purpose and engaging for users.
8. Optimize your website for search engines: Make sure your website is easy to find by using keywords in your content and metadata. This will help your website rank higher in search engine results.
9. Test your website: Test your website to make sure everything is working properly and that there are no broken links or errors.
10. Launch your website: Once everything is working properly, it's time to launch your website. Share the link with your audience and start promoting your website.
I hope this guide helps you build a successful website. Let me know if you have any questions. [end of text]
llama_print_timings: load time = 11670.53 ms
llama_print_timings: sample time = 16.30 ms / 422 runs ( 0.04 ms per token, 25894.34 tokens per second)
llama_print_timings: prompt eval time = 5084.73 ms / 78 tokens ( 65.19 ms per token, 15.34 tokens per second)
llama_print_timings: eval time = 279055.53 ms / 421 runs ( 662.84 ms per token, 1.51 tokens per second)
llama_print_timings: total time = 284314.00 ms / 499 tokens
Log end
What's inside the
prompt.txt
:
<|system|>
You are a helpful assistant.</s>
<|user|>
Hello, how are you?</s>
<|assistant|>
I'm doing great. How can I help you today?</s>
<|user|>
Show me how to build a website in 10 simple steps</s>
<|assistant|>
Runs of MaziyarPanahi zephyr-orpo-141b-A35b-v0.1-GGUF on huggingface.co
55.1K
Total runs
0
24-hour runs
7.8K
3-day runs
12.4K
7-day runs
25.5K
30-day runs
More Information About zephyr-orpo-141b-A35b-v0.1-GGUF huggingface.co Model
Url of zephyr-orpo-141b-A35b-v0.1-GGUF
zephyr-orpo-141b-A35b-v0.1-GGUF huggingface.co Url
Provider of zephyr-orpo-141b-A35b-v0.1-GGUF huggingface.co
Other API from MaziyarPanahi
Updated: April 23 2024
Total runs:
1.6M
Run Growth:
-650.0K
Growth Rate:
-39.46%
Total runs:
1.6M
Run Growth:
-657.1K
Growth Rate:
-40.59%
Total runs:
1.6M
Run Growth:
-696.7K
Growth Rate:
-44.65%
Total runs:
1.5M
Run Growth:
-724.6K
Growth Rate:
-46.75%
Total runs:
1.5M
Run Growth:
-694.9K
Growth Rate:
-45.09%
Total runs:
1.5M
Run Growth:
-702.5K
Growth Rate:
-45.91%
Total runs:
1.5M
Run Growth:
1.5M
Growth Rate:
99.96%
Total runs:
1.5M
Run Growth:
-702.5K
Growth Rate:
-46.12%
Total runs:
1.5M
Run Growth:
83.1K
Growth Rate:
4.28%
Total runs:
1.5M
Run Growth:
410.4K
Growth Rate:
21.06%
Total runs:
1.5M
Run Growth:
-702.5K
Growth Rate:
-46.38%
Total runs:
1.5M
Run Growth:
116.0K
Growth Rate:
5.94%
Total runs:
1.5M
Run Growth:
97.5K
Growth Rate:
5.00%
Total runs:
1.5M
Run Growth:
-709.4K
Growth Rate:
-47.08%
Total runs:
1.5M
Run Growth:
-712.0K
Growth Rate:
-47.27%
Total runs:
1.5M
Run Growth:
107.2K
Growth Rate:
5.53%
Total runs:
1.5M
Run Growth:
407.7K
Growth Rate:
21.02%
Total runs:
1.5M
Run Growth:
-710.9K
Growth Rate:
-47.28%
Total runs:
1.5M
Run Growth:
-712.5K
Growth Rate:
-47.40%
Total runs:
1.5M
Run Growth:
-712.6K
Growth Rate:
-47.42%
Total runs:
1.5M
Run Growth:
-712.5K
Growth Rate:
-47.42%
Total runs:
1.3M
Run Growth:
1.3M
Growth Rate:
93.83%
Total runs:
1.3M
Run Growth:
1.2M
Growth Rate:
97.55%
Total runs:
1.1M
Run Growth:
591.4K
Growth Rate:
100.00%
Total runs:
1.0M
Run Growth:
90.8K
Growth Rate:
4.64%
Total runs:
1.0M
Run Growth:
1.3M
Growth Rate:
100.00%
Total runs:
399.2K
Run Growth:
297.9K
Growth Rate:
100.00%
Total runs:
280.3K
Run Growth:
-18
Growth Rate:
-17.82%
Total runs:
202.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
111.8K
Run Growth:
52.2K
Growth Rate:
46.64%
Total runs:
111.5K
Run Growth:
49.7K
Growth Rate:
44.59%
Total runs:
109.7K
Run Growth:
-64.9K
Growth Rate:
-91.68%
Total runs:
77.8K
Run Growth:
8.0K
Growth Rate:
28.58%
Total runs:
56.5K
Run Growth:
26.0K
Growth Rate:
45.99%
Total runs:
56.3K
Run Growth:
567.9K
Growth Rate:
100.00%
Total runs:
55.8K
Run Growth:
24.9K
Growth Rate:
44.60%
Total runs:
55.6K
Run Growth:
26.2K
Growth Rate:
47.07%
Total runs:
37.1K
Run Growth:
36.2K
Growth Rate:
97.68%
Total runs:
33.0K
Run Growth:
14.5K
Growth Rate:
43.97%
Total runs:
33.0K
Run Growth:
14.3K
Growth Rate:
43.22%
Total runs:
33.0K
Run Growth:
14.2K
Growth Rate:
43.21%
Total runs:
33.0K
Run Growth:
14.2K
Growth Rate:
43.10%
Total runs:
33.0K
Run Growth:
14.2K
Growth Rate:
43.20%
Total runs:
32.7K
Run Growth:
13.9K
Growth Rate:
42.57%
Total runs:
32.7K
Run Growth:
13.9K
Growth Rate:
42.57%
Total runs:
28.2K
Run Growth:
12.1K
Growth Rate:
43.06%
Total runs:
7.2K
Run Growth:
-555
Growth Rate:
-7.68%
Total runs:
6.2K
Run Growth:
-1.6K
Growth Rate:
-26.57%
Total runs:
6.0K
Run Growth:
470
Growth Rate:
7.84%
Total runs:
5.9K
Run Growth:
-1.6K
Growth Rate:
-27.16%
Total runs:
5.4K
Run Growth:
-1.9K
Growth Rate:
-35.48%
Total runs:
5.3K
Run Growth:
-27
Growth Rate:
-0.51%
Total runs:
5.3K
Run Growth:
282
Growth Rate:
5.34%
Total runs:
5.1K
Run Growth:
-1.8K
Growth Rate:
-35.28%
Total runs:
5.1K
Run Growth:
-2.1K
Growth Rate:
-42.31%
Total runs:
4.0K
Run Growth:
-1.6K
Growth Rate:
-39.81%
Total runs:
3.9K
Run Growth:
341
Growth Rate:
8.36%
Total runs:
3.0K
Run Growth:
2.1K
Growth Rate:
71.76%
Total runs:
3.0K
Run Growth:
2.2K
Growth Rate:
72.29%
Total runs:
2.9K
Run Growth:
2.7K
Growth Rate:
98.49%
Total runs:
2.9K
Run Growth:
2.1K
Growth Rate:
72.23%
Total runs:
2.9K
Run Growth:
2.7K
Growth Rate:
98.55%
Total runs:
2.9K
Run Growth:
2.1K
Growth Rate:
72.41%
Total runs:
2.8K
Run Growth:
195
Growth Rate:
6.25%
Total runs:
2.7K
Run Growth:
29
Growth Rate:
1.03%
Total runs:
2.7K
Run Growth:
1.1K
Growth Rate:
42.29%
Total runs:
2.7K
Run Growth:
-137
Growth Rate:
-5.09%
Total runs:
2.7K
Run Growth:
-155
Growth Rate:
-5.79%
Total runs:
2.6K
Run Growth:
113
Growth Rate:
4.28%
Total runs:
2.6K
Run Growth:
365
Growth Rate:
12.73%
Total runs:
2.6K
Run Growth:
227
Growth Rate:
8.33%
Total runs:
1.9K
Run Growth:
1.1K
Growth Rate:
99.44%
Total runs:
1.6K
Run Growth:
4.3K
Growth Rate:
86.44%
Total runs:
1.3K
Run Growth:
666
Growth Rate:
52.03%
Total runs:
1.2K
Run Growth:
484
Growth Rate:
39.61%
Total runs:
1.2K
Run Growth:
545
Growth Rate:
44.89%
Total runs:
1.1K
Run Growth:
-126
Growth Rate:
-11.20%
Total runs:
884
Run Growth:
692
Growth Rate:
78.28%
Total runs:
738
Run Growth:
697
Growth Rate:
94.44%
Total runs:
646
Run Growth:
79
Growth Rate:
12.23%
Total runs:
623
Run Growth:
197
Growth Rate:
31.62%
Total runs:
584
Run Growth:
546
Growth Rate:
93.49%
Total runs:
576
Run Growth:
513
Growth Rate:
89.06%
Total runs:
516
Run Growth:
0
Growth Rate:
0.00%
Total runs:
492
Run Growth:
0
Growth Rate:
0.00%
Total runs:
480
Run Growth:
175
Growth Rate:
36.46%
Total runs:
478
Run Growth:
121
Growth Rate:
25.31%
Total runs:
408
Run Growth:
330
Growth Rate:
80.88%
Total runs:
390
Run Growth:
-93
Growth Rate:
-23.85%
Total runs:
385
Run Growth:
54
Growth Rate:
14.03%
Total runs:
384
Run Growth:
238
Growth Rate:
61.98%
Total runs:
380
Run Growth:
-98
Growth Rate:
-25.79%
Total runs:
376
Run Growth:
340
Growth Rate:
90.43%
Total runs:
357
Run Growth:
158
Growth Rate:
100.00%
Total runs:
356
Run Growth:
0
Growth Rate:
0.00%
Total runs:
352
Run Growth:
133
Growth Rate:
100.00%
Total runs:
350
Run Growth:
47
Growth Rate:
13.43%
Total runs:
327
Run Growth:
298
Growth Rate:
91.13%
Total runs:
325
Run Growth:
279
Growth Rate:
85.85%