Total runs:
1.7M
Run Growth:
-702.5K
Growth Rate:
-42.07%
MaziyarPanahi / Llama-3-13B-Instruct-v0.1
Model's Last Updated: April 20 2024
text-generation
Introduction of Llama-3-13B-Instruct-v0.1
Model Details of Llama-3-13B-Instruct-v0.1
Llama-3-13B-Instruct-v0.1
This model is a self-merge of
meta-llama/Meta-Llama-3-8B-Instruct
model.
How to use
You can use this model by using
MaziyarPanahi/Llama-3-13B-Instruct-v0.1
as the model name in Hugging Face's
transformers library.
from transformers import AutoModelForCausalLM, AutoTokenizer, TextStreamer
from transformers import pipeline
import torch
model_id = "MaziyarPanahi/Llama-3-13B-Instruct-v0.1"
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.float16,
device_map="auto",
trust_remote_code=True,
# attn_implementation="flash_attention_2"
)
tokenizer = AutoTokenizer.from_pretrained(
model_id,
trust_remote_code=True
)
streamer = TextStreamer(tokenizer)
pipeline = pipeline(
"text-generation",
model=model,
tokenizer=tokenizer,
model_kwargs={"torch_dtype": torch.bfloat16},
streamer=streamer
)
# Then you can use the pipeline to generate text.
messages = [
{"role": "system", "content": "You are a pirate chatbot who always responds in pirate speak!"},
{"role": "user", "content": "Who are you?"},
]
prompt = tokenizer.apply_chat_template(
messages,
tokenize=False,
add_generation_prompt=True
)
terminators = [
tokenizer.eos_token_id,
tokenizer.convert_tokens_to_ids("<|eot_id|>")
]
outputs = pipeline(
prompt,
max_new_tokens=256,
eos_token_id=terminators,
do_sample=True,
temperature=0.6,
top_p=0.95,
)
print(outputs[0]["generated_text"][len(prompt):])
Prompt template
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
You are a helpful assistant.<|eot_id|><|start_header_id|>user<|end_header_id|>
what's 25-4*2+3<|eot_id|><|start_header_id|>assistant<|end_header_id|>
To evaluate this expression, we need to follow the order of operations (PEMDAS):
1. First, multiply 4 and 2: 4*2 = 8
2. Then, subtract 8 from 25: 25 - 8 = 17
3. Finally, add 3: 17 + 3 = 20
So, 25-4*2+3 = 20!<|eot_id|>
To evaluate this expression, we need to follow the order of operations (PEMDAS):
1. First, multiply 4 and 2: 4*2 = 8
2. Then, subtract 8 from 25: 25 - 8 = 17
3. Finally, add 3: 17 + 3 = 20
So, 25-4*2+3 = 20!
Runs of MaziyarPanahi Llama-3-13B-Instruct-v0.1 on huggingface.co
61
Total runs
-2
24-hour runs
-5
3-day runs
-53
7-day runs
-262
30-day runs
More Information About Llama-3-13B-Instruct-v0.1 huggingface.co Model
Url of Llama-3-13B-Instruct-v0.1
Llama-3-13B-Instruct-v0.1 huggingface.co Url
Provider of Llama-3-13B-Instruct-v0.1 huggingface.co
Other API from MaziyarPanahi
Updated: April 23 2024
Total runs:
1.7M
Run Growth:
-720.0K
Growth Rate:
-43.47%
Total runs:
1.6M
Run Growth:
-726.7K
Growth Rate:
-44.69%
Total runs:
1.6M
Run Growth:
-792.6K
Growth Rate:
-50.85%
Total runs:
1.6M
Run Growth:
-760.1K
Growth Rate:
-48.95%
Total runs:
1.5M
Run Growth:
-771.3K
Growth Rate:
-50.11%
Total runs:
1.5M
Run Growth:
-773.2K
Growth Rate:
-50.53%
Total runs:
1.5M
Run Growth:
83.1K
Growth Rate:
4.28%
Total runs:
1.5M
Run Growth:
410.4K
Growth Rate:
21.06%
Total runs:
1.5M
Run Growth:
-773.1K
Growth Rate:
-50.83%
Total runs:
1.5M
Run Growth:
-740.1K
Growth Rate:
-47.22%
Total runs:
1.5M
Run Growth:
-782.5K
Growth Rate:
-51.74%
Total runs:
1.5M
Run Growth:
407.7K
Growth Rate:
21.02%
Total runs:
1.5M
Run Growth:
-781.2K
Growth Rate:
-51.73%
Total runs:
1.5M
Run Growth:
-782.8K
Growth Rate:
-51.86%
Total runs:
1.5M
Run Growth:
-782.9K
Growth Rate:
-51.88%
Total runs:
1.5M
Run Growth:
-792.9K
Growth Rate:
-52.88%
Total runs:
1.5M
Run Growth:
116.0K
Growth Rate:
5.94%
Total runs:
1.5M
Run Growth:
97.5K
Growth Rate:
5.00%
Total runs:
1.5M
Run Growth:
107.2K
Growth Rate:
5.53%
Total runs:
1.5M
Run Growth:
-764.0K
Growth Rate:
-50.84%
Total runs:
1.4M
Run Growth:
1.3M
Growth Rate:
94.05%
Total runs:
1.3M
Run Growth:
1.3M
Growth Rate:
97.62%
Total runs:
1.1M
Run Growth:
591.4K
Growth Rate:
100.00%
Total runs:
1.0M
Run Growth:
90.8K
Growth Rate:
4.64%
Total runs:
1.0M
Run Growth:
1.3M
Growth Rate:
100.00%
Total runs:
395.2K
Run Growth:
297.9K
Growth Rate:
100.00%
Total runs:
301.1K
Run Growth:
-18
Growth Rate:
-17.82%
Total runs:
202.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
111.9K
Run Growth:
52.4K
Growth Rate:
46.85%
Total runs:
111.2K
Run Growth:
49.4K
Growth Rate:
44.47%
Total runs:
109.7K
Run Growth:
-64.9K
Growth Rate:
-91.68%
Total runs:
76.7K
Run Growth:
8.0K
Growth Rate:
28.58%
Total runs:
56.5K
Run Growth:
25.9K
Growth Rate:
45.83%
Total runs:
55.8K
Run Growth:
24.9K
Growth Rate:
44.60%
Total runs:
55.6K
Run Growth:
26.2K
Growth Rate:
47.16%
Total runs:
55.2K
Run Growth:
25.6K
Growth Rate:
46.44%
Total runs:
44.8K
Run Growth:
567.9K
Growth Rate:
100.00%
Total runs:
37.0K
Run Growth:
36.0K
Growth Rate:
97.37%
Total runs:
33.0K
Run Growth:
14.3K
Growth Rate:
43.43%
Total runs:
33.0K
Run Growth:
14.1K
Growth Rate:
42.80%
Total runs:
33.0K
Run Growth:
14.1K
Growth Rate:
42.78%
Total runs:
33.0K
Run Growth:
14.1K
Growth Rate:
42.65%
Total runs:
32.9K
Run Growth:
14.1K
Growth Rate:
42.76%
Total runs:
32.8K
Run Growth:
14.1K
Growth Rate:
42.87%
Total runs:
32.8K
Run Growth:
14.1K
Growth Rate:
42.87%
Total runs:
28.2K
Run Growth:
12.1K
Growth Rate:
43.09%
Total runs:
7.2K
Run Growth:
-570
Growth Rate:
-7.94%
Total runs:
6.1K
Run Growth:
642
Growth Rate:
10.46%
Total runs:
6.1K
Run Growth:
-1.6K
Growth Rate:
-26.10%
Total runs:
5.7K
Run Growth:
-1.7K
Growth Rate:
-30.45%
Total runs:
5.3K
Run Growth:
319
Growth Rate:
5.99%
Total runs:
5.3K
Run Growth:
39
Growth Rate:
0.73%
Total runs:
5.2K
Run Growth:
-2.1K
Growth Rate:
-39.60%
Total runs:
5.0K
Run Growth:
-1.9K
Growth Rate:
-38.11%
Total runs:
4.9K
Run Growth:
-2.2K
Growth Rate:
-44.52%
Total runs:
4.0K
Run Growth:
-1.5K
Growth Rate:
-38.63%
Total runs:
4.0K
Run Growth:
341
Growth Rate:
8.36%
Total runs:
3.0K
Run Growth:
2.1K
Growth Rate:
71.76%
Total runs:
3.0K
Run Growth:
2.7K
Growth Rate:
98.49%
Total runs:
2.9K
Run Growth:
2.2K
Growth Rate:
72.29%
Total runs:
2.9K
Run Growth:
2.1K
Growth Rate:
72.23%
Total runs:
2.9K
Run Growth:
2.7K
Growth Rate:
98.55%
Total runs:
2.9K
Run Growth:
2.1K
Growth Rate:
72.41%
Total runs:
2.8K
Run Growth:
195
Growth Rate:
6.25%
Total runs:
2.8K
Run Growth:
29
Growth Rate:
1.03%
Total runs:
2.7K
Run Growth:
-71
Growth Rate:
-2.61%
Total runs:
2.7K
Run Growth:
1.2K
Growth Rate:
43.02%
Total runs:
2.7K
Run Growth:
-86
Growth Rate:
-3.19%
Total runs:
2.7K
Run Growth:
142
Growth Rate:
5.33%
Total runs:
2.7K
Run Growth:
365
Growth Rate:
12.73%
Total runs:
2.6K
Run Growth:
227
Growth Rate:
8.33%
Total runs:
1.9K
Run Growth:
1.1K
Growth Rate:
99.44%
Total runs:
1.6K
Run Growth:
4.3K
Growth Rate:
86.44%
Total runs:
1.4K
Run Growth:
193
Growth Rate:
13.98%
Total runs:
1.4K
Run Growth:
697
Growth Rate:
51.44%
Total runs:
1.3K
Run Growth:
506
Growth Rate:
39.56%
Total runs:
1.1K
Run Growth:
402
Growth Rate:
35.26%
Total runs:
890
Run Growth:
708
Growth Rate:
79.55%
Total runs:
729
Run Growth:
684
Growth Rate:
93.83%
Total runs:
628
Run Growth:
212
Growth Rate:
33.76%
Total runs:
621
Run Growth:
362
Growth Rate:
58.29%
Total runs:
591
Run Growth:
-26
Growth Rate:
-4.40%
Total runs:
587
Run Growth:
547
Growth Rate:
93.19%
Total runs:
576
Run Growth:
1.5M
Growth Rate:
99.96%
Total runs:
576
Run Growth:
520
Growth Rate:
90.28%
Total runs:
537
Run Growth:
0
Growth Rate:
0.00%
Total runs:
504
Run Growth:
0
Growth Rate:
0.00%
Total runs:
489
Run Growth:
144
Growth Rate:
29.45%
Total runs:
461
Run Growth:
173
Growth Rate:
37.53%
Total runs:
418
Run Growth:
-34
Growth Rate:
-8.13%
Total runs:
398
Run Growth:
2.1K
Growth Rate:
74.89%
Total runs:
398
Run Growth:
-1.2K
Growth Rate:
-1532.91%
Total runs:
387
Run Growth:
272
Growth Rate:
70.28%
Total runs:
381
Run Growth:
-103
Growth Rate:
-27.03%
Total runs:
376
Run Growth:
342
Growth Rate:
90.96%
Total runs:
376
Run Growth:
284
Growth Rate:
74.35%
Total runs:
376
Run Growth:
0
Growth Rate:
0.00%
Total runs:
374
Run Growth:
92
Growth Rate:
24.60%
Total runs:
355
Run Growth:
158
Growth Rate:
100.00%