*Every like, comment, and post will support me to go further!!

Can find project files(.blend) on my Patreon Chamber | creating Game, Art | Patreon. Subscriptions can help me update further and create more~

Plan, future, coming soon…

– [ ] more data from 3d models rendering test(about 100(will post if any improvement
– [ ] more steps test (around 5000 (will post if any improvement

– [ ] better tags and prompt test (including wildcards(will post if any improvement
– [ ] charturn (also others‘ turntable) ti for sdxl/sd1.5
– [ ] charturn (also others‘ turntable)remix ver for both sd1.5 and sdxl,
based on picked-generated images to try to make the output prettier(will post if any improvement,
relate to the current version based on 20-50 3d model render images aimed at multi-view correction
– [ ] charturn age/body shape/height/suit outline/face control test(will post if any improvement
– [ ] my LoRA/models will post in public, and my train/generate tool/workflow will post on my Patreon only


Tried
XL CKPT/LoRA plan to improve the hand/palm/finger, hair/helmet/mask, and clothing,
for controllable elements/styles, quantity, and consistency, they did have some improvements, you can feel from these samples above,
The main improvement I feel is a better understanding of the prompts, like some kind of clothes and characters, better to control the outputs by prompts details,

but after training and testing, I think SDXL has some shorting at this stage(3/22/2024):

  • the main one, there are not enough awesome checkpoints XL and LoRAs XL to make results as good as SD 1.5,
    both for design tools like style offset, and their beauty level as base/beautify models

  • The open pose controller XL is not as good as SD 1.5 version,

  • Slower and harder to train/generate
    (4-5min for each 1536*1024 upscale to 1920*1024 then turn on ADetailer with 4 faces, actually with hands improvements may generate better but too slow to add more than 10 palms in ADetailer),
    while lighting versions work faster but their results don’t look good enough for me now.

I am not familiar with CKPT XL, and it seems too expensive to train now, so let’s support other great creators and wait for some better results,
For more tools LoRA XL, I will do some research and try later~

Good news, RTX 4080 Laptop 12Gb VRAM is enough to train XL LoRA after some settings and updating kohya_ss~

!!! If you want similar results,
Please
repeat most of the generate/sample settings from the raw pictures examples above,
including ControlNet(OpenPose) and also others’ LoRA,
different extra LoRA/TI have their special efforts, add or delete them to test what suits your targets~

Here is one of the LoRAs I trained for my new workflow, AI-powered designs, and textures(camera-based projection) tools.

for SD XL

Clothturn Helper XL Remix – v1.0 | Stable Diffusion LoRA | Civitai

Clothturn Helper XL – v1.0 | Stable Diffusion LoRA | Civitai

Charturn Helper Merged XL – v1.0 | Stable Diffusion LoRA | Civitai

for SD 1.5:

Charturn Helper Merged – v4.0 | Stable Diffusion LoRA | Civitai
Bodyturn Helper – v3.0 | Stable Diffusion LoRA | Civitai
Faceturn Helper – v2.0 | Stable Diffusion LoRA | Civitai
Hairturn Helper – v1.0 | Stable Diffusion LoRA | Civitai
Clothturn Helper – v1.0 | Stable Diffusion LoRA | Civitai
Mechturn / Armorturn Helper – v1.0 | Stable Diffusion LoRA | Civitai
Sword Gen – v1.0 | Stable Diffusion LoRA | Civitai

They work best with my character Library on Blender in the future,
including 3d models’ mesh shape edit guide, auto texturing/shading, weight painting, and so on…~
Mostly design for asset creation to develop my own game,
which may help other independent developers like me.

Personally Recommend Checkpoint(only one suitable for SDXL now after testing):
AbyssOrange XL Else – v1.0 | Stable Diffusion Checkpoint | Civitai

Also training data here, about 30 percent of them rendered from artwork I created and posted before 3D models by ChamberSu1996 – Sketchfab,
the rest are bought and collected from the internet: TrainDataPack.zip
Every LoRA was trained from a relatively tiny collection including 20~ 50 pictures for this early and test version, but it still helps a lot now.

And training setting for kohya_ss for every LoRA I create, only uses different data, image size, and epoch, the rest are the same(Turn on XL option): ToonHairTurn_v1.json
(recommend trying your own better data and setting, for I am not familiar with training now, just try to make every step/feature workable this time and keep settings as simple/default as possible,
will learn further about reasonable data, tags, and train settings later,
then train better by only using my own artwork render images to ensure it will be open to use, and follow my styles/tastes)

Add dynamic prompt and wildcard from Civital to help get unlimited different results,  using Gemini and Chat GPT to generate prompt wildcards for testing work well too~

if any questions or anything here interests you, Feel free to contact me by leaving a comment or mailing to [email protected]

Also Discord Channel here~
https://discord.gg/SFJFcctfgD

Every like, comment, post, and Patreon Chamber | creating Game, Art | Patreon Subscriptions can help to get the budget to update further, create more, and post them~

Related Model

[PonyXL] Boymoder
[PonyXL] Boymoder
Kosaka nao JP_Idol
Kosaka nao JP_Idol
Lilimix
Lilimix
portalsAI
portalsAI v2
Mafehsingluten
Mafehsingluten
Gatekept
Gatekept

No comments

No comments...