okuha-logo-small-white

How to Use LyCORIS In Stable Diffusion – Lightweight AI Art Model

lycoris-in-stable-diffusion-feature-image

If you click on a link and make a purchase, I may receive a small commission. As an Amazon affiliate partner, I may earn from qualifying purchases.
Read our disclosure.

What Is LyCORIS?

LyCORIS (Lora beYond Conventional methods, Other Rank adaptation Implementations for Stable Diffusion) model is an alternative method for implementing different algorithm to do parameter-efficient fine-tuning on Stable Diffusion.

LyCORIS started from LoCon and LoHa and can easily be mixed with LoRA. However, there are a few things that differentiate LyCORIS and LoRAs. LoRA files are, on average, 180MB in size, whereas LyCORIS files are 40-60MB in size. LyCORIS uses the *.safetensor file type.

LyCORIS uses convolutional layers instead of text encoder for image learning.

  • LoCon is a LoRA that uses convolutional layers.
  • LoHa is a more efficient LoRA.

Types of LyCORIS Models

Where to Find LyCORIS Models?

The best place to find LyCORIS models is through Civitai. Remember to use filters to get only LyCORIS AI art models.

How to Use LyCORIS?

To use LyCORIS models in Stable Diffusion and AUTOMATIC1111’s WebUI, you need to download a specific extension called a1111-sd-webui-lycoris by KohakuBlueleaf. You can install this straight from AUTOMATIC1111’s WebUI extension tab or GitHub.

lycoris-extension-installation-stable-diffusion-automatic1111-webui
LyCORIS AUTOMATIC1111 WebUI extension installation.

Restart the WebUI completely to activate the LyCORIS tab on the extra networks page.

LyCORIS-automatic1111-webui-stable-diffusion-selection
You can find the LyCORIS tab by selecting the extra networks button from AUTOMATIC1111’s WebUI.

LyCORIS models work the same way as LoRAs. You place the LyCORIS model in the following folder (if using AUTOMATIC1111 WebUI): *\stable-diffusion-webui\models\LyCORIS.

Note: The LyCORIS folder will appear after downloading the above-mentioned LyCORIS WebUI extension.

To activate and use the LyCORIS model, use the LyCORIS name in the normal text prompt <lyco:MODEL:WEIGHT>, or <lora:MODEL:WEIGHT> for example <lyco:DemonicT:1.2>.

lycoris-in-stable-diffusion-lycoris-example-result (2)
Image created with the Change-A-Character: Demonify Your Waifu! LyCORIS model.
lycoris-in-stable-diffusion-lycoris-example-result (1)
Image showing results without the Change-A-Character: Demonify Your Waifu! LyCORIS model.

After generating the image(s), you can find them in the following folder: *\stable-diffusion-webui\outputs\txt2img-images

Normal text prompt with LyCORIS:

1 girl, solo, starfish, seashell, shell, flower, hat, hair ornament, jewelry, straw hat, looking at viewer, sunglasses, hat flower, drinking straw, hairclip, earrings, red flower, tinted eyewear, yellow flower, bangs, multicolored hair, black flower, black hair, ring, cup, long hair, purple-tinted eyewear, portrait, shell hair ornament, blue skin, black sclera, colored sclera, colored skin, yellow eyes, demon wings, demon horns, slit pupils, <lyco:DemonicT:1.1>

Normal text prompt without LyCORIS:

1 girl, solo, starfish, seashell, shell, flower, hat, hair ornament, jewelry, straw hat, looking at viewer, sunglasses, hat flower, drinking straw, hairclip, earrings, red flower, tinted eyewear, yellow flower, bangs, multicolored hair, black flower, black hair, ring, cup, long hair, purple-tinted eyewear, portrait, shell hair ornament, blue skin

Negative text prompt (used in both examples):

sketch, duplicate, ugly, huge eyes, text, logo, worst face, (bad and mutated hands:1.3), (worst quality:2.0), (low quality:2.0), (blurry:2.0), horror, geometry, bad_prompt, (bad hands), (missing fingers), multiple limbs, bad anatomy, (interlocked fingers:1.2), Ugly Fingers, (extra digit and hands and fingers and legs and arms:1.4), ((2girl)), (deformed fingers:1.2), (long fingers:1.2),(bad-artist-anime), bad-artist, bad hand, extra legs, nipples,nsfw

How to Train LyCORIS?

You can train LyCORIS, LoCon, and LoHA by installing kohya_ss GUI (Graphical User Interface) by bmaltais. bmaltais GitHub page also provides instructions on how to get started with the training.

When training with Windows OS, you need the following files:

  • Python 3.10 (check the box to add Python to the ‘PATH’ environment variable)
  • Git
  • Visual Studio 2015, 2017, 2019, and 2022 redistributable

Video tutorial on how to train LyCORIS.

Feature image credits.

Search
artist-profile-picture-avatar

Okuha

Digital Artist

I’m a digital artist who is passionate about anime and manga art. My true artist journey pretty much started with CTRL+Z. When I experienced that and the limitless color choices and the number of tools I could use with art software, I was sold. Drawing digital anime art is the thing that makes me happy among eating cheeseburgers in between veggie meals.

More Posts

Thank You!

Thank you for visiting the page! If you want to build your next creative product business, I suggest you check out Kittl!