Japanese Stable Diffusion XL (JSDXL) is a Japanese-specific
SDXL
model that is capable of inputting prompts in Japanese and generating Japanese-style images.
Usage
from diffusers import DiffusionPipeline
import torch
pipeline = DiffusionPipeline.from_pretrained(
"stabilityai/japanese-stable-diffusion-xl", trust_remote_code=True
)
pipeline.to("cuda")
# if using torch < 2.0# pipeline.enable_xformers_memory_efficient_attention()
prompt = "柴犬、カラフルアート"
image = pipeline(prompt=prompt).images[0]
Model type
: Diffusion-based text-to-image generative model
Model Description
: This model is a fine-tuned model based on
SDXL 1.0
.
In order to maximize the understanding of the Japanese language and Japanese culture/expressions while preserving the versatility of the pre-trained model, we performed a PEFT training using one Japanese-specific compatible text encoder.
As a PEFT method, we applied
Orthogonal Fine-tuning (OFT)
for better results and training stability.
Generation of artworks and use in design and other artistic processes.
Applications in educational or creative tools.
Research on generative models.
Safe deployment of models which have the potential to generate harmful content.
Probing and understanding the limitations and biases of generative models.
Excluded uses are described below.
Out-of-Scope Use
The model was not trained to be factual or true representations of people or events, and therefore using the model to generate such content is out-of-scope for the abilities of this model.
Limitations and Bias
Limitations
The model does not achieve perfect photorealism
The model cannot render legible text
The model struggles with more difficult tasks which involve compositionality, such as rendering an image corresponding to “A red cube on top of a blue sphere”
Faces and people in general may not be generated properly.
The autoencoding part of the model is lossy.
Bias
While the capabilities of image generation models are impressive, they can also reinforce or exacerbate social biases.
How to cite
@misc{JSDXL,
url = {[https://huggingface.co/stabilityai/japanese-stable-diffusion-xl](https://huggingface.co/stabilityai/japanese-stable-diffusion-xl)},
title = {Japanese Stable Diffusion XL},
author = {Shing, Makoto and Akiba, Takuya and Chi, Jerry}
}
japanese-stable-diffusion-xl huggingface.co is an AI model on huggingface.co that provides japanese-stable-diffusion-xl's model effect (), which can be used instantly with this stabilityai japanese-stable-diffusion-xl model. huggingface.co supports a free trial of the japanese-stable-diffusion-xl model, and also provides paid use of the japanese-stable-diffusion-xl. Support call japanese-stable-diffusion-xl model through api, including Node.js, Python, http.
japanese-stable-diffusion-xl huggingface.co is an online trial and call api platform, which integrates japanese-stable-diffusion-xl's modeling effects, including api services, and provides a free online trial of japanese-stable-diffusion-xl, you can try japanese-stable-diffusion-xl online for free by clicking the link below.
stabilityai japanese-stable-diffusion-xl online free url in huggingface.co:
japanese-stable-diffusion-xl is an open source model from GitHub that offers a free installation service, and any user can find japanese-stable-diffusion-xl on GitHub to install. At the same time, huggingface.co provides the effect of japanese-stable-diffusion-xl install, users can directly use japanese-stable-diffusion-xl installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
japanese-stable-diffusion-xl install url in huggingface.co: