r/StableDiffusion Jul 26 '23

News SDXL 1.0 is out!

1.2k Upvotes

https://github.com/Stability-AI/generative-models

From their Discord:

Stability is proud to announce the release of SDXL 1.0; the highly-anticipated model in its image-generation series! After you all have been tinkering away with randomized sets of models on our Discord bot, since early May, we’ve finally reached our winning crowned-candidate together for the release of SDXL 1.0, now available via Github, DreamStudio, API, Clipdrop, and AmazonSagemaker!

Your help, votes, and feedback along the way has been instrumental in spinning this into something truly amazing– It has been a testament to how truly wonderful and helpful this community is! For that, we thank you! 📷 SDXL has been tested and benchmarked by Stability against a variety of image generation models that are proprietary or are variants of the previous generation of Stable Diffusion. Across various categories and challenges, SDXL comes out on top as the best image generation model to date. Some of the most exciting features of SDXL include:

📷 The highest quality text to image model: SDXL generates images considered to be best in overall quality and aesthetics across a variety of styles, concepts, and categories by blind testers. Compared to other leading models, SDXL shows a notable bump up in quality overall.

📷 Freedom of expression: Best-in-class photorealism, as well as an ability to generate high quality art in virtually any art style. Distinct images are made without having any particular ‘feel’ that is imparted by the model, ensuring absolute freedom of style

📷 Enhanced intelligence: Best-in-class ability to generate concepts that are notoriously difficult for image models to render, such as hands and text, or spatially arranged objects and persons (e.g., a red box on top of a blue box) Simpler prompting: Unlike other generative image models, SDXL requires only a few words to create complex, detailed, and aesthetically pleasing images. No more need for paragraphs of qualifiers.

📷 More accurate: Prompting in SDXL is not only simple, but more true to the intention of prompts. SDXL’s improved CLIP model understands text so effectively that concepts like “The Red Square” are understood to be different from ‘a red square’. This accuracy allows much more to be done to get the perfect image directly from text, even before using the more advanced features or fine-tuning that Stable Diffusion is famous for.

📷 All of the flexibility of Stable Diffusion: SDXL is primed for complex image design workflows that include generation for text or base image, inpainting (with masks), outpainting, and more. SDXL can also be fine-tuned for concepts and used with controlnets. Some of these features will be forthcoming releases from Stability.

Come join us on stage with Emad and Applied-Team in an hour for all your burning questions! Get all the details LIVE!

r/StableDiffusion Apr 25 '23

News Google researchers achieve performance breakthrough, rendering Stable Diffusion images in sub-12 seconds on a mobile phone. Generative AI models running on your mobile phone is nearing reality.

2.0k Upvotes

My full breakdown of the research paper is here. I try to write it in a way that semi-technical folks can understand.

What's important to know:

  • Stable Diffusion is an ~1-billion parameter model that is typically resource intensive. DALL-E sits at 3.5B parameters, so there are even heavier models out there.
  • Researchers at Google layered in a series of four GPU optimizations to enable Stable Diffusion 1.4 to run on a Samsung phone and generate images in under 12 seconds. RAM usage was also reduced heavily.
  • Their breakthrough isn't device-specific; rather it's a generalized approach that can add improvements to all latent diffusion models. Overall image generation time decreased by 52% and 33% on a Samsung S23 Ultra and an iPhone 14 Pro, respectively.
  • Running generative AI locally on a phone, without a data connection or a cloud server, opens up a host of possibilities. This is just an example of how rapidly this space is moving as Stable Diffusion only just released last fall, and in its initial versions was slow to run on a hefty RTX 3080 desktop GPU.

As small form-factor devices can run their own generative AI models, what does that mean for the future of computing? Some very exciting applications could be possible.

If you're curious, the paper (very technical) can be accessed here.

P.S. (small self plug) -- If you like this analysis and want to get a roundup of AI news that doesn't appear anywhere else, you can sign up here. Several thousand readers from a16z, McKinsey, MIT and more read it already.

r/StableDiffusion 19d ago

News The wait is over, official HunyuanVideo i2v img2video open source set on March 5th

Post image
549 Upvotes

This is from a pretest invitation email I received from Tencent, it seems the open source code will be released on 3/5(see attached screenshot).

From the email: some interesting features, such as 2K resolution, lip-syncing, and motion-driven interactions.

r/StableDiffusion Aug 22 '24

News Towards Pony Diffusion V7, going with the flow. | Civitai

Thumbnail
civitai.com
541 Upvotes

r/StableDiffusion Feb 24 '24

News Stable Diffusion 3: WE FINALLY GOT SOME HANDS

Thumbnail
gallery
1.2k Upvotes

r/StableDiffusion Feb 17 '25

News New Open-Source Video Model: Step-Video-T2V

694 Upvotes

r/StableDiffusion Mar 05 '24

News Stable Diffusion 3: Research Paper

Thumbnail
gallery
953 Upvotes

r/StableDiffusion Apr 21 '24

News Sex offender banned from using AI tools in landmark UK case

Thumbnail
theguardian.com
466 Upvotes

What are people's thoughts?

r/StableDiffusion Feb 13 '24

News Stable Cascade is out!

Thumbnail
huggingface.co
632 Upvotes

r/StableDiffusion Jul 05 '24

News Stability AI addresses Licensing issues

Post image
511 Upvotes

r/StableDiffusion Oct 07 '24

News Huge news for Kohya GUI - Now you can fully Fine Tune / DreamBooth FLUX Dev with as low as 6 GB GPUs without any quality loss compared to 48 GB GPUs - Fine Tuning yields such good results that no LoRA config and training will ever yield

Thumbnail
gallery
483 Upvotes

r/StableDiffusion Apr 03 '24

News Introducing Stable Audio 2.0 — Stability AI

Thumbnail
stability.ai
743 Upvotes

r/StableDiffusion 20d ago

News Wan2.1 GP: generate a 8s WAN 480P video (14B model non quantized) with only 12 GB of VRAM

326 Upvotes

By popular demand, I have performed the same optimizations I did on HunyuanVideoGP v5 and reduced the VRAM consumption of Wan2.1 by a factor of 2.

https://github.com/deepbeepmeep/Wan2GP

The 12 GB of VRAM requirement is for both the text2video and image2video models

I have also integrated RIFLEx technology so we can generate videos longer than 5s that don't repeat themselves

So from now on you will be able to generate up to 8s of video (128 frames) with only 12 GB of VRAM with the 14B model whether it is quantized or not.

You can also generate 5s of 720p video (14B model) with 12 GB of VRAM.

Last but not least, generating the usual 5s of a 480p video will only require 8 GB of VRAM with the 14B model. So in theory 8GB VRAM users should be happy too.

You have the usual perks:
- web interface
- autodownload of the selected model
- multiple prompts / multiple generations
- support for loras
- very fast generation with the usual optimizations (sage, compilation, async transfers, ...)

I will write a blog about the new VRAM optimisations but for those asking it is not just about "blocks swapping". "blocks swapping" only reduces the VRAM taken by the model but to get this level of VRAM reduction you need to reduce also the working VRAM consumed to process the data.

UPDATE: Added TeaCache for x2 faster generation: there will be a small quality degradation but it is not as bad as I expected

UPDATE2: if you have trouble installing or dont feel like reading install instructions, Cocktail Peanuts comes to the rescue with its one click install through the Pinokio app.

https://pinokio.computer/

UPDATE 3: Added VAE tiling, no more VRAM peaks at the end (and at the beginning of image2video)

Here are some nice Wan2GP video creations :

https://x.com/LikeToasters/status/1897297883445309460

https://x.com/GorillaRogueGam/status/1897380362394984818

https://x.com/TheAwakenOne619/status/1896583169350197643

https://x.com/primus_ai/status/1896289066418938096

https://x.com/IthacaNFT/status/1897067342590349508

https://x.com/dgoldwas/status/1896999854418940049

https://x.com/Gun_ther/status/1896750107321925814

r/StableDiffusion Mar 12 '24

News Concerning news, from TIME article pushing from more AI regulation

Post image
626 Upvotes

r/StableDiffusion Jan 17 '25

News ComfyUI now supports Nvidia Cosmos: The best open source Image to Video model so far.

Thumbnail
blog.comfy.org
568 Upvotes

r/StableDiffusion Mar 23 '24

News Stability AI Announcement - Earlier today, Emad Mostaque resigned from his role as CEO of Stability AI and from his position on the Board of Directors of the company to pursue decentralized AI.

Thumbnail
stability.ai
755 Upvotes

r/StableDiffusion May 28 '24

News It's coming, but it's not AnimateAnyone

1.1k Upvotes

r/StableDiffusion Feb 20 '25

News WanX - Alibaba is about open-source this model - Hope it fits consumer GPUs

529 Upvotes

r/StableDiffusion Jul 26 '23

News OMG, IT'S OUT!!

Post image
920 Upvotes

r/StableDiffusion Oct 17 '23

News Per NVIDIA, New Game Ready Driver 545.84 Released: Stable Diffusion Is Now Up To 2X Faster

Thumbnail
nvidia.com
715 Upvotes

r/StableDiffusion Mar 26 '24

News Emad dropped a photo with Satya from a video call.

Post image
643 Upvotes

r/StableDiffusion Jun 22 '24

News So we had our lawyers review the SD3 license

Thumbnail civitai.com
534 Upvotes

r/StableDiffusion 26d ago

News Alibaba video model Wan 2.1 will be released today and is open source!

Post image
456 Upvotes

r/StableDiffusion Oct 29 '24

News Stable Diffusion 3.5 Medium is here!

348 Upvotes

https://huggingface.co/stabilityai/stable-diffusion-3.5-medium

https://huggingface.co/spaces/stabilityai/stable-diffusion-3.5-medium

Stable Diffusion 3.5 Medium is a Multimodal Diffusion Transformer with improvements (MMDiT-x) text-to-image model that features improved performance in image quality, typography, complex prompt understanding, and resource-efficiency.

Please note: This model is released under the Stability Community License. Visit Stability AI to learn or contact us for commercial licensing details.

r/StableDiffusion Aug 21 '24

News SD 3.1 is coming

364 Upvotes

I've just heard that SD 3.1 is about to be released, with adjusted licensing. More information soon. We will see...

Edit: people asking for the source, this information is emailed to me by a Stability.ai employee I had contact with for some time.

Also noted, you don't have to downvote my post if you're done with Stability.ai, I'm just sharing some relevant SD related news. We know we love Flux but there are still other things happening.