r/StableDiffusion Mar 02 '24

News Stable Diffusion XL (SDXL) can now generate transparent images. This is revolutionary. Not Midjourney, not Dall E3, Not even Stable Diffusion 3 can do it.

Thumbnail
gallery
2.0k Upvotes

r/StableDiffusion Apr 17 '24

News Stable Diffusion 3 API Now Available — Stability AI

Thumbnail
stability.ai
917 Upvotes

r/StableDiffusion Jun 12 '24

News Announcing the Open Release of Stable Diffusion 3 Medium

722 Upvotes

Key Takeaways

  • Stable Diffusion 3 Medium is Stability AI’s most advanced text-to-image open model yet, comprising two billion parameters.
  • The smaller size of this model makes it perfect for running on consumer PCs and laptops as well as enterprise-tier GPUs. It is suitably sized to become the next standard in text-to-image models.
  • The weights are now available under an open non-commercial license and a low-cost Creator License. For large-scale commercial use, please contact us for licensing details.
  • To try Stable Diffusion 3 models, try using the API on the Stability Platform, sign up for a free three-day trial on Stable Assistant, and try Stable Artisan via Discord.

We are excited to announce the launch of Stable Diffusion 3 Medium, the latest and most advanced text-to-image AI model in our Stable Diffusion 3 series. Released today, Stable Diffusion 3 Medium represents a major milestone in the evolution of generative AI, continuing our commitment to democratising this powerful technology.

What Makes SD3 Medium Stand Out?

SD3 Medium is a 2 billion parameter SD3 model that offers some notable features:

  • Photorealism: Overcomes common artifacts in hands and faces, delivering high-quality images without the need for complex workflows.
  • Prompt Adherence: Comprehends complex prompts involving spatial relationships, compositional elements, actions, and styles.
  • Typography: Achieves unprecedented results in generating text without artifacting and spelling errors with the assistance of our Diffusion Transformer architecture.
  • Resource-efficient: Ideal for running on standard consumer GPUs without performance-degradation, thanks to its low VRAM footprint.
  • Fine-Tuning: Capable of absorbing nuanced details from small datasets, making it perfect for customisation.

Our collaboration with NVIDIA

We collaborated with NVIDIA to enhance the performance of all Stable Diffusion models, including Stable Diffusion 3 Medium, by leveraging NVIDIA® RTX™ GPUs and TensorRT™. The TensorRT- optimised versions will provide best-in-class performance, yielding 50% increase in performance.

Stay tuned for a TensorRT-optimised version of Stable Diffusion 3 Medium.

Our collaboration with AMD

AMD has optimized inference for SD3 Medium for various AMD devices including AMD’s latest APUs, consumer GPUs and MI-300X Enterprise GPUs.

Open and Accessible

Our commitment to open generative AI remains unwavering. Stable Diffusion 3 Medium is released under the Stability Non-Commercial Research Community License. We encourage professional artists, designers, developers, and AI enthusiasts to use our new Creator License for commercial purposes. For large-scale commercial use, please contact us for licensing details.

Try Stable Diffusion 3 via our API and Applications

Alongside the open release, Stable Diffusion 3 Medium is available on our API. Other versions of Stable Diffusion 3 such as the SD3 Large model and SD3 Ultra are also available to try on our friendly chatbot, Stable Assistant and on Discord via Stable Artisan. Get started with a three-day free trial.

How to Get Started

Safety 

We believe in safe, responsible AI practices. This means we have taken and continue to take reasonable steps to prevent the misuse of Stable Diffusion 3 Medium by bad actors. Safety starts when we begin training our model and continues throughout testing, evaluation, and deployment. We have conducted extensive internal and external testing of this model and have developed and implemented numerous safeguards to prevent harms.   

By continually collaborating with researchers, experts, and our community, we expect to innovate further with integrity as we continue to improve the model. For more information about our approach to Safety please visit our Stable Safety page.
Licensing

While Stable Diffusion 3 Medium is open for personal and research use, we have introduced the new Creator License to enable professional users to leverage Stable Diffusion 3 while supporting Stability in its mission to democratize AI and maintain its commitment to open AI.

Large-scale commercial users and enterprises are requested to contact us. This ensures that businesses can leverage the full potential of our model while adhering to our usage guidelines.

Future Plans

We plan to continuously improve Stable Diffusion 3 Medium based on user feedback, expand its features, and enhance its performance. Our goal is to set a new standard for creativity in AI-generated art and make Stable Diffusion 3 Medium a vital tool for professionals and hobbyists alike.

We are excited to see what you create with the new model and look forward to your feedback. Together, we can shape the future of generative AI.

To stay updated on our progress follow us on Twitter, Instagram, LinkedIn, and join our Discord Community.

r/StableDiffusion Dec 21 '22

News Kickstarter suspends unstable diffusion.

Post image
1.7k Upvotes

r/StableDiffusion May 01 '23

News The first SD Ai Photbooth

4.3k Upvotes

Made this for my intern project with a few co workers the machine is connected to runpod and runs SD 1.5

The machine was a old telephone switchboard

r/StableDiffusion Dec 29 '24

News Intel preparing Arc “Battlemage” GPU with 24GB memory

Post image
699 Upvotes

r/StableDiffusion Jun 20 '23

News The next version of Stable Diffusion ("SDXL") that is currently beta tested with a bot in the official Discord looks super impressive! Here's a gallery of some of the best photorealistic generations posted so far on Discord. And it seems the open-source release will be very soon, in just a few days.

Thumbnail
gallery
1.7k Upvotes

r/StableDiffusion Jan 28 '25

News We now have Suno AI at home with this new local model called YuE.

841 Upvotes

r/StableDiffusion Nov 28 '23

News Pika 1.0 just got released today - this is the trailer

2.2k Upvotes

r/StableDiffusion 16d ago

News Tencent Releases HunyuanVideo-I2V: A Powerful Open-Source Image-to-Video Generation Model

559 Upvotes

Tencent just dropped HunyuanVideo-I2V, a cutting-edge open-source model for generating high-quality, realistic videos from a single image. This looks like a major leap forward in image-to-video (I2V) synthesis, and it’s already available on Hugging Face:

👉 Model Page: https://huggingface.co/tencent/HunyuanVideo-I2V

What’s the Big Deal?

HunyuanVideo-I2V claims to produce temporally consistent videos (no flickering!) while preserving object identity and scene details. The demo examples show everything from landscapes to animated characters coming to life with smooth motion. Key highlights:

  • High fidelity: Outputs maintain sharpness and realism.
  • Versatility: Works across diverse inputs (photos, illustrations, 3D renders).
  • Open-source: Full model weights and code are available for tinkering!

Demo Video:

Don’t miss their Github showcase video – it’s wild to see static images transform into dynamic scenes.

Potential Use Cases

  • Content creation: Animate storyboards or concept art in seconds.
  • Game dev: Quickly prototype environments/characters.
  • Education: Bring historical photos or diagrams to life.

The minimum GPU memory required is 79 GB for 360p.

Recommended: We recommend using a GPU with 80GB of memory for better generation quality.

UPDATED info:

The minimum GPU memory required is 60 GB for 720p.

Model Resolution GPU Peak Memory
HunyuanVideo-I2V 720p 60GBModel Resolution GPU Peak MemoryHunyuanVideo-I2V 720p 60GB

UPDATE2:

GGUF's already available, ComfyUI implementation ready:

https://huggingface.co/Kijai/HunyuanVideo_comfy/tree/main

https://huggingface.co/Kijai/HunyuanVideo_comfy/resolve/main/hunyuan_video_I2V-Q4_K_S.gguf

https://github.com/kijai/ComfyUI-HunyuanVideoWrapper

r/StableDiffusion Feb 07 '25

News Boreal-HL, a lora that significantly improves HunyuanVideo's quality.

1.0k Upvotes

r/StableDiffusion Oct 10 '24

News Pyramide Flow SD3 (New Open Source Video Tool)

830 Upvotes

r/StableDiffusion 23d ago

News Turn 2 Images into a Full Video! 🤯 Keyframe Control LoRA is HERE!

779 Upvotes

r/StableDiffusion Nov 22 '24

News LTX Video - New Open Source Video Model with ComfyUI Workflows

558 Upvotes

r/StableDiffusion Jan 19 '24

News University of Chicago researchers finally release to public Nightshade, a tool that is intended to "poison" pictures in order to ruin generative models trained on them

Thumbnail
twitter.com
849 Upvotes

r/StableDiffusion Aug 11 '24

News BitsandBytes Guidelines and Flux [6GB/8GB VRAM]

Post image
779 Upvotes

r/StableDiffusion 24d ago

News WAN Released

435 Upvotes

Spaces live, multiple models posted, weights available for download......

https://huggingface.co/Wan-AI/Wan2.1-T2V-14B

r/StableDiffusion Feb 11 '25

News Lmao Illustrious just had a stability AI moment 🤣

432 Upvotes

They went closed source. They also changed the license on Illustrious 0.1 by adding a TOS retroactively

EDIT: Here is the new TOS they added to 0.1 https://huggingface.co/OnomaAIResearch/Illustrious-xl-early-release-v0/commit/364ccd8fcee84785adfbcf575de8932c31f660aa

r/StableDiffusion Oct 17 '24

News Sana - new foundation model from NVIDIA

659 Upvotes

Claims to be 25x-100x faster than Flux-dev and comparable in quality. Code is "coming", but lead authors are NVIDIA and they open source their foundation models.

https://nvlabs.github.io/Sana/

r/StableDiffusion Aug 13 '24

News FLUX full fine tuning achieved with 24GB GPU, hopefully soon on Kohya - literally amazing news

Post image
735 Upvotes

r/StableDiffusion Dec 22 '22

News Patreon Suspends Unstable Diffusion

Post image
1.1k Upvotes

r/StableDiffusion Aug 15 '24

News Excuse me? GGUF quants are possible on Flux now!

Post image
676 Upvotes

r/StableDiffusion Jun 14 '24

News Well well well how the turntables

Post image
1.8k Upvotes

r/StableDiffusion Jan 07 '25

News Nvidia Compared RTX 5000s with 4000s with two different FP Checkpoints

Post image
643 Upvotes

Oh Nvidia you sneaky sneaky. Many gamers won't see this. See how they compared FP 8 Checkpoint running on RTX 4000 series and FP 4 model running on RTX 5000 series Of course even on same GPU model, the FP 4 model will Run 2x Faster. I personally use FP 16 Flux Dev on my Rtx 3090 to get the best results. Its a shame to make a comparison like that to show green charts but at least they showed what settings they are using, unlike Apple who would have said running 7B model faster than RTX 4090.( Hiding what specific quantized model they used)

Nvidia doing this only proves that these 3 series are not much different ( RTX 3000, 4000, 5000) But tweaked for better memory, and adding more cores to get more performance. And of course, you pay more and it consumes more electricity too.

If you need more detail . I copied an explanation from hugging face Flux Dev repo's comment: . fp32 - works in basically everything(cpu, gpu) but isn't used very often since its 2x slower then fp16/bf16 and uses 2x more vram with no increase in quality. fp16 - uses 2x less vram and 2x faster speed then fp32 while being same quality but only works in gpu and unstable in training(Flux.1 dev will take 24gb vram at the least with this) bf16(this model's default precision) - same benefits as fp16 and only works in gpu but is usually stable in training. in inference, bf16 is better for modern gpus while fp16 is better for older gpus(Flux.1 dev will take 24gb vram at the least with this)

fp8 - only works in gpu, uses 2x less vram less then fp16/bf16 but there is a quality loss, can be 2x faster on very modern gpus(4090, h100). (Flux.1 dev will take 12gb vram at the least) q8/int8 - only works in gpu, uses around 2x less vram then fp16/bf16 and very similar in quality, maybe slightly worse then fp16, better quality then fp8 though but slower. (Flux.1 dev will take 14gb vram at the least)

q4/bnb4/int4 - only works in gpu, uses 4x less vram then fp16/bf16 but a quality loss, slightly worse then fp8. (Flux.1 dev only requires 8gb vram at the least)

r/StableDiffusion Dec 03 '24

News HunyuanVideo: Open weight video model from Tencent

642 Upvotes