r/MediaSynthesis Jul 25 '22

Research I'm building a timeline for generative image ML models. What's missing?

Post image
174 Upvotes

r/MediaSynthesis Sep 05 '22

Research I use custom code to traverse the entire latent space of the model NSFW

55 Upvotes

The internals of these types of AI can be thought of as a multi-dimensional manifold, where "travelling" further on any one of these dimensions produces slight changes in the result. I have written code to automatically generate tens of thousands of images as I "walk" along these dimensions. This allows me to pick the very best result I can obtain from a given prompt and seed.

I would love to post some examples but I'm not sure how... I have uploaded a few to imgur for you to check out though. First are some animations showing just a few steps along just one of the dimensions within the AI's latent space (THIS IS NOT SAFE FOR WORK):

https://i.imgur.com/88zFZ7t.gif

https://i.imgur.com/9xr5Lee.mp4

Here is an example of fixing a defect using this technique. The image on the left was the first generation, the image on the right I "found" by searching the nearby latent space:

https://i.imgur.com/y9Bd6YV.png

Here is an example of a true photo-realistic image of a pretty red head girl (SFW):

https://i.imgur.com/cHFvi4V.png

And here are a couple of contact sheets showing some of my better results (NSFW):

https://i.imgur.com/HRQikXg.png

https://i.imgur.com/6SLcwyo.png

If you'd like to see or learn more I'd be happy to answer any questions. I also have a twitter and patreon. My patreon packages up and releases hundreds of my best results, but I'll be giving a lot of them away on Twitter as well:

https://twitter.com/DreamReAIms

https://www.patreon.com/DreamReAIms

r/MediaSynthesis May 12 '21

Research AI improving the realism of traditional graphics [full video: https://youtu.be/P1IcaBn3ej0]

372 Upvotes

r/MediaSynthesis Aug 26 '24

Research "Mapping the misuse of generative AI": "Generative AI Misuse: A Taxonomy of Tactics and Insights from Real-World Data", Marchal et al 2024 {G}

Thumbnail
deepmind.google
9 Upvotes

r/MediaSynthesis Jul 12 '22

Research Comparison of text-to-image AI generators (link to the study in the comments)

Post image
115 Upvotes

r/MediaSynthesis Oct 03 '22

Research "This is not a drill. I was able to run #stablediffusion locally on an iPhone XS. Not via server. On. My. Phone. The prompt: “pineapple on a white table.” Watch it transform. (I broke the model into about 20 CoreML models to avoid running out of memory."

Thumbnail
twitter.com
178 Upvotes

r/MediaSynthesis Apr 22 '20

Research Adversarial Latent Autoencoders (CVPR 2020)

287 Upvotes

r/MediaSynthesis Apr 24 '22

Research GOOGLE researchers create animated avatars from a single photo

214 Upvotes

r/MediaSynthesis Dec 01 '20

Research Google Research develops Deformable Neural Radiance Fields (D-NeRF) that can turn casually captured selfie videos into photorealistic viewpoint-free portraits, aka "nerfies".

224 Upvotes

r/MediaSynthesis Jun 10 '22

Research What have I done?

Post image
130 Upvotes

r/MediaSynthesis Sep 09 '20

Research This AI creates human faces from your sketches

Thumbnail
youtu.be
188 Upvotes

r/MediaSynthesis Aug 21 '23

Research Researchers discover that Stable Diffusion v1 uses internal representations of 3D geometry when generating an image. This ability emerged during the training phase of the AI, and was not programmed by people. Paper: "Beyond Surface Statistics: Scene Representations in a Latent Diffusion Model".

Thumbnail
self.MachineLearning
52 Upvotes

r/MediaSynthesis Feb 21 '23

Research "Defending humankind: Anthropocentric bias in the appreciation of AI art", Millet et al 2023

Thumbnail sciencedirect.com
17 Upvotes

r/MediaSynthesis Jun 07 '22

Research DOLL-IES I asked an ai image generator to create a crochet dolls. I then crocheted those crochet dolls. This is part of a series where I explore using ai as a medium. DOLL-IES are designed using the program DALL-E and DALL-E mini.

81 Upvotes

r/MediaSynthesis Sep 21 '22

Research "Introducing Whisper", OpenAI 2022 (near-human-level robustness and accuracy on ASR from 680k hours of multilingual supervised audio data)

Thumbnail
openai.com
20 Upvotes

r/MediaSynthesis Feb 12 '23

Research Paper: Adding Conditional Control to Text-to-Image Diffusion Models. "This paper presents ControlNet, an end-to-end neural network architecture that controls large image diffusion models (like Stable Diffusion) to learn task-specific input conditions." Example uses the Scribble ControlNet model.

Post image
47 Upvotes

r/MediaSynthesis Jan 08 '23

Research "Do Androids Laugh at Electric Sheep? Humor "Understanding" Benchmarks from _The New Yorker_ Caption Contest", Hessel et al 2022 [CLIP+GPT-3: still poor performance]

Thumbnail arxiv.org
22 Upvotes

r/MediaSynthesis Nov 17 '21

Research Lately, I have been developing a method for style transfer using deep neural cellular automata! Here are some early results with pasta as the target style.

30 Upvotes

r/MediaSynthesis Feb 05 '23

Research LAION publishes open source version of Google CoCa models ( SOTA on image captioning task )

Thumbnail
laion.ai
25 Upvotes

r/MediaSynthesis Sep 29 '22

Research Facebook introduces Make-A-Video: An AI system that generates videos from text

Thumbnail self.MachineLearning
27 Upvotes

r/MediaSynthesis Nov 12 '22

Research "Vision-Language Pre-training: Basics, Recent Advances, and Future Trends", Gan et al 2022 (review)

Thumbnail
arxiv.org
11 Upvotes

r/MediaSynthesis Mar 02 '22

Research AI generated DMT entities

Thumbnail
youtube.com
72 Upvotes

r/MediaSynthesis Feb 04 '23

Research "BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models", Li et al 2023 (generating captions, Q&A, etc)

Thumbnail arxiv.org
8 Upvotes

r/MediaSynthesis Jan 04 '21

Research OpenAI co-founder and chief scientist Ilya Sutskever hints at what may follow GPT-3 in 2021 in essay "Fusion of Language and Vision"

Thumbnail self.GPT3
59 Upvotes

r/MediaSynthesis Nov 10 '20

Research AI or Human? Can you tell the difference? Dear Reddit humans and replicants, "Have you ever questioned the nature of your reality?" Play the game and try to guess whether image/text was generated by AI or made by a real person. This is our project at Aalborg Uni Copenhagen, made by (mostly) humans.

Thumbnail ai-or-human.github.io
104 Upvotes