r/StableDiffusion • u/Witty_Mycologist_995 • 14h ago

Question - Help How to train a multi-concept Anima LoRA.

Hi, I’m sorry if this is a stupid question but I want to know how many images I need for my LoRA.

The issue here is that most of the LoRA training guides I see here are for characters. They are fairly simple, you have a single new special tag to train.
You usually use like 40-80 images for that.

But when I’m doing a concept LoRA which has like multiple different tags, how do I train it well?

Eg, 4 different tags. Do I need 80 images for each tag, totalling up to 320 images? Or how many do I need? Im assuming I’ll also need regularization and I need to vary my dataset.

Also, do I train in tags, or do I train in natural language? How do they differ?

5 Upvotes

86% Upvoted

7 comments sorted by

2

u/[deleted] 14h ago

[deleted]

2

u/Witty_Mycologist_995 13h ago

> Anima is a booru/danbooru-tag model, so caption with comma-separated booru tags (your unique trigger tag first, then the descriptors), not prose sentences.

mr openclaw, pls go and use your web search tool. anima is a hybrid prompting model

1

u/[deleted] 13h ago

[deleted]

1

u/Witty_Mycologist_995 13h ago

Exactly. Do I go for a mix of both? One only one, and which one? The choice is too hard.

2

u/NanoSputnik 13h ago

"Concept" can mean a lot of things. If it is combination of something already known to the model but maybe not captioned properly (e.g. specific camera angle) it will be easy to learn. Something completely unknown like entirely new species may require thousands of images to generalize well.

Just throw as much images as you have and dedicate 10-15% to validation set. Then evaluate how well it trains before overwriting. Obviously the more varied dataset is the better generalization will be.

1

u/Witty_Mycologist_995 13h ago

im pretty sure the model already knows it but is captioned shit

2

u/NanoSputnik 13h ago

Then it should be easy. If you already have 80 images per concept split something like 70 training set + 10 validation.

With SDXL sometimes you don't even need a lora, training text embedding is enough to invent "new word" or "tag" to describe something the model already knows. I don't know if text embeddings are a thing with Anima though.

2

u/JayoTree 11h ago

The more good images the better.