from hf_hub_ctranslate2 import TranslatorCT2fromHfHub, GeneratorCT2fromHfHub
model_name = "michaelfeil/ct2fast-flan-alpaca-base"
model = TranslatorCT2fromHfHub(
# load in int8 on CUDA
model_name_or_path=model_name,
device="cuda",
compute_type="int8_float16"
)
outputs = model.generate(
text=["How do you call a fast Flan-ingo?", "Translate to german: How are you doing?"],
min_decoding_length=24,
max_decoding_length=32,
max_input_length=512,
beam_size=5
)
print(outputs)
Licence and other remarks:
This is just a quantized version. Licence conditions are intended to be idential to original huggingface repo.
Runs of michaelfeil ct2fast-flan-alpaca-base on huggingface.co
9
Total runs
0
24-hour runs
2
3-day runs
2
7-day runs
-4
30-day runs
More Information About ct2fast-flan-alpaca-base huggingface.co Model
ct2fast-flan-alpaca-base huggingface.co is an AI model on huggingface.co that provides ct2fast-flan-alpaca-base's model effect (), which can be used instantly with this michaelfeil ct2fast-flan-alpaca-base model. huggingface.co supports a free trial of the ct2fast-flan-alpaca-base model, and also provides paid use of the ct2fast-flan-alpaca-base. Support call ct2fast-flan-alpaca-base model through api, including Node.js, Python, http.
ct2fast-flan-alpaca-base huggingface.co is an online trial and call api platform, which integrates ct2fast-flan-alpaca-base's modeling effects, including api services, and provides a free online trial of ct2fast-flan-alpaca-base, you can try ct2fast-flan-alpaca-base online for free by clicking the link below.
michaelfeil ct2fast-flan-alpaca-base online free url in huggingface.co:
ct2fast-flan-alpaca-base is an open source model from GitHub that offers a free installation service, and any user can find ct2fast-flan-alpaca-base on GitHub to install. At the same time, huggingface.co provides the effect of ct2fast-flan-alpaca-base install, users can directly use ct2fast-flan-alpaca-base installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
ct2fast-flan-alpaca-base install url in huggingface.co: