😋 Emojich is a 1.3 billion params model from the family GPT3-like, it generates emoji-style images with the brain of ◾ Malevich.
Fine-tuning stage:
The main goal of fine-tuning is trying to keep the generalization of
ruDALL-E Malevich (XL)
model on text to emoji tasks. ruDALL-E Malevich is a multi-modality big pretrained transformer, that uses images and texts.
The idea with freezing feedforward and self-attention layers in pretrained transformer is demonstrated high performance in changing different modalities.
Also, the model has a good chance for over-fitting text modality and lost generalization.
To deal with this problem is increased coefficient 10^3 in weighted cross-entropy loss for image codebooks part.
Full version of training code is available on Kaggle:
Examples of generated emojis
All examples are generated automatically (without manual cherry-picking) with hyper-parameters:
seed 42, batch size 16, top-k 2048, top-p 0.995, temperature 1.0, GPU A100.
For making better generative emojis should use more attempts (~512) and select the best one manually.
Remember, the great art makers became "great" after creating just only one masterpiece.
Runs of ai-forever rudalle-Emojich on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About rudalle-Emojich huggingface.co Model
rudalle-Emojich huggingface.co
rudalle-Emojich huggingface.co is an AI model on huggingface.co that provides rudalle-Emojich's model effect (), which can be used instantly with this ai-forever rudalle-Emojich model. huggingface.co supports a free trial of the rudalle-Emojich model, and also provides paid use of the rudalle-Emojich. Support call rudalle-Emojich model through api, including Node.js, Python, http.
rudalle-Emojich huggingface.co is an online trial and call api platform, which integrates rudalle-Emojich's modeling effects, including api services, and provides a free online trial of rudalle-Emojich, you can try rudalle-Emojich online for free by clicking the link below.
ai-forever rudalle-Emojich online free url in huggingface.co:
rudalle-Emojich is an open source model from GitHub that offers a free installation service, and any user can find rudalle-Emojich on GitHub to install. At the same time, huggingface.co provides the effect of rudalle-Emojich install, users can directly use rudalle-Emojich installed effect in huggingface.co for debugging and trial. It also supports api for free installation.