TL;DR:
We introduce SEED-Story, a MLLM capable of generating multimodal
long stories consists of rich and coherent narrative texts, along with images that are consistent in characters and
style. We also release the StoryStream Dataset for build this model.
Model Weights
We release the pretrained Tokenizer, the pretrained De-Tokenizer, the pre-trained foundation model
SEED-X-pretrained
,
the StoryStream instruction-tuned MLLM
SEED-Story-George
, and the StoryStream tuned De-Tokenizer in
Detokenizer-George
Please download the checkpoints and save them under the folder
./pretrained
.
You also need to download
stable-diffusion-xl-base-1.0
and
Qwen-VL-Chat
, and save them under the folder
./pretrained
. Please use the following script to extract the weights of visual encoder in Qwen-VL-Chat.
python3 src/tools/reload_qwen_vit.py
Citation
If you find the work helpful, please consider citing:
@article{yang2024seedstory,
title={SEED-Story: Multimodal Long Story Generation with Large Language Model},
author={Shuai Yang and Yuying Ge and Yang Li and Yukang Chen and Yixiao Ge and Ying Shan and Yingcong Chen},
year={2024},
journal={arXiv preprint arXiv:2407.08683},
url={https://arxiv.org/abs/2407.08683},
}
License
SEED-Story
is licensed under the Apache License Version 2.0 except for the third-party components listed in
License
.
Runs of TencentARC SEED-Story on huggingface.co
16
Total runs
0
24-hour runs
0
3-day runs
2
7-day runs
-3
30-day runs
More Information About SEED-Story huggingface.co Model
SEED-Story huggingface.co is an AI model on huggingface.co that provides SEED-Story's model effect (), which can be used instantly with this TencentARC SEED-Story model. huggingface.co supports a free trial of the SEED-Story model, and also provides paid use of the SEED-Story. Support call SEED-Story model through api, including Node.js, Python, http.
SEED-Story huggingface.co is an online trial and call api platform, which integrates SEED-Story's modeling effects, including api services, and provides a free online trial of SEED-Story, you can try SEED-Story online for free by clicking the link below.
TencentARC SEED-Story online free url in huggingface.co:
SEED-Story is an open source model from GitHub that offers a free installation service, and any user can find SEED-Story on GitHub to install. At the same time, huggingface.co provides the effect of SEED-Story install, users can directly use SEED-Story installed effect in huggingface.co for debugging and trial. It also supports api for free installation.