Sweet Lolita XL

My first LoRA!

I’ve been lamenting the lack of a LoRA for the Lolita Harajuku fashion for SDXL for a while now, and I’ve finally been able to produce a LoRA on my own hardware that I think produces decent images!

The LoRA was trained with 20 images at 18 epochs/348 steps with the Prodigy optimizer on my RTX 3070 8GB GPU. Training took a whopping 18.5 hours! I used 5 repeats, I’ll probably drop that down to 2 after adding more images for the next version. Model was ZavyChromaXL.

Oh yeah… there’s gonna be a next version.

My intention is to continue to improve this LoRA over time by adding a few images each version, to include more details such as shoes and stockings/tights/pantyhose, accessories, print details, makeup, and more. I may find myself straying into checkpoint territory… If that happens, then I’ll finalize the LoRA and look into releasing a lolita fashion checkpoint, should the Civitai folks allow it!

Notes:

1. A weight of 1.0 seems to work most of the time. Depending on checkpoint, you might reduce or even increase a bit.

2. Images were set to 768 in Kohya_SS, but I generated the samples at 896. YMMV. Future versions will have more high-quality images.

3. Some checkpoints created rather odd faces, deformed or ugly-looking. Probably an artifact from not the highest quality images used in the first version. I usually use Adetailer anyways for faces and hands, and this also worked wonders with this LoRA. “Highly detailed” or even just “lolita” in the positive prompt for faces works great.

4. Use “lolita”, “dress”, and/or the trigger word “SweetHarajuku_LoRA” as the main triggers for this LoRA. I’ll be changing the trigger word and the lora filename in future versions. Also, I don’t believe using the trigger word is absolutely necessary if you have “lolita” in the prompt, but when making the sample images I left it in just in case. YMMV!

5. Civitai pretty much bans the “lolita” tag on their website. When uploading images with this LoRA in them (or even just in general), try to leave out the “lolita” tag. If it auto-tags and doesn’t let you remove it, I’ve found that upscaling with “highly detailed” or alternatively scrubbing the EXIF data works. Lolita fashion is NOT CP! It is a legitimate J-fashion, and most lolita clothing is far too expensive for children to afford anyways! An average high-quality brand-new Lolita dress can cost anywhere from $150-500 USD!

I’m doing this for fun and my own use mainly, but if you enjoy this LoRA, feel free to drop some coin my way:

Ko-fi.com/mysticdaedra

Finally, huge thanks to the folks over on the Civitai and SD.Next discords, I couldn’t have gotten into AI art and Stable Diffusion without them! You guys rock!