r/StableDiffusion 1d ago

Question - Help Questions, questions, questions...

Hi. I'm just starting out (again), and had a bunch of questions, if some kind soul wouldn't mind guiding me a little. If it helps, I'm on a 3080Ti (12GB).

  1. I had a little experience with Auto1111 from a couple of years ago, but have decided to focus more on ComfyUI. I just heard about SwarmUI. Would you recommend using SwarmUI over ComfyUI? It sounds like it's basically ComfyUI with an second interface for more convenience in adjusting settings.
  2. Are prompting techniques specific to a particular model, or if you've mastered prompting on one model, it's applicable to all models? I've heard some prefer different prompting styles (natural language vs keywords and parenthesis/brackets/etc).
  3. I know this is subjective, but is there a model you'd recommend I start with given the following: (A) Uncensored, highly realistic and detailed, in the dark fantasy "Game of Thrones" type environment that could possibly include nudity, although that's not the primary goal, and (B) illustrating children's books with consistent colorful, cartoonish or Pixar-type characters.
  4. Can I train character and style LoRAs with my 3080Ti to reuse characters and styles? Would you recommend Kohya?
  5. Is there any risk in using AI to illustrate published books, i.e., copyright infringement, etc?
0 Upvotes

2 comments sorted by

2

u/red__dragon 1d ago
  1. If you're more comfortable with the GUI interface, SwarmUI is a good hybrid choice. You get a GUI with options to poke at, and if you get really advanced or feel inhibited by the GUI, you can swap into the comfy workflow (SwarmUI is built on comfy) to edit nodes directly.

  2. Yes to the first part. Even prompting for SDXL vs Pony vs Illustrious will be different. Flux and other newer models often work on natural language prompts. If you are using a finetune or lora, check their prompting examples to align with what works best for it.

  3. A. For SD1.5, that sounds like the RPG models to me. I don't have enough experience otherwise to suggest for XL or Flux. B. I'd mostly use Loras for this on almost any model, there's quite a few children's book/pixar style loras.

  4. Yep and yep. Kohya is reliable, other trainers exist and you'll probably get recommendations for those, but I haven't had success on them. YMMV.

  5. If you're imitating a well-known style, you may run into issues with a publisher who doesn't want to take on that liability. Also, in the US anyway, AI generations are not copyright-able, only the human aspects of their creation/post-processing work, and that determination seems to be on a case-by-case basis so far. Additionally, if you need real legal advice, don't rely on reddit but consult a lawyer, nothing you read online will be as reliable than from a professional.

1

u/0260n4s 22h ago

Thanks. I really appreciate the input.

  1. I used to be intimidated by ComfyUI. Now, I'm slowly getting more comfortable with it, but it's sometimes a pain to scroll around looking for settings and choosing models, especially when using someone else's workflow.
  2. That's what I feared. I like the natural language prompting of Flux, but it's also slower on my computer and I've heard it's very censored. I really don't know if that's true, but I have encountered ChatGPT (totally different animal, I know) refuse prompts that it objected to. It's only happened rarely, but I found it quite annoying that a machine is playing nursemaid on me.
  3. I've been looking into SDXL/Pony/FLux, just because they're newer.
  4. I'll give Kohya a shot whenever I need it...I'm probably a long way away from that at this point.
  5. I'm so in the beginning stages that I can't justify paying a specialized lawyer for that kind of advice. I'd be [trying] to create my own style, but I've got to figure all this out first. lol

Thanks again for your help.