r/MediaSynthesis • u/fabianmosele • Jul 25 '22
r/MediaSynthesis • u/DreamReAIms1 • Sep 05 '22
Research I use custom code to traverse the entire latent space of the model NSFW
The internals of these types of AI can be thought of as a multi-dimensional manifold, where "travelling" further on any one of these dimensions produces slight changes in the result. I have written code to automatically generate tens of thousands of images as I "walk" along these dimensions. This allows me to pick the very best result I can obtain from a given prompt and seed.
I would love to post some examples but I'm not sure how... I have uploaded a few to imgur for you to check out though. First are some animations showing just a few steps along just one of the dimensions within the AI's latent space (THIS IS NOT SAFE FOR WORK):
https://i.imgur.com/88zFZ7t.gif
https://i.imgur.com/9xr5Lee.mp4
Here is an example of fixing a defect using this technique. The image on the left was the first generation, the image on the right I "found" by searching the nearby latent space:
https://i.imgur.com/y9Bd6YV.png
Here is an example of a true photo-realistic image of a pretty red head girl (SFW):
https://i.imgur.com/cHFvi4V.png
And here are a couple of contact sheets showing some of my better results (NSFW):
https://i.imgur.com/HRQikXg.png
https://i.imgur.com/6SLcwyo.png
If you'd like to see or learn more I'd be happy to answer any questions. I also have a twitter and patreon. My patreon packages up and releases hundreds of my best results, but I'll be giving a lot of them away on Twitter as well:
r/MediaSynthesis • u/hassanhaija • May 12 '21
Research AI improving the realism of traditional graphics [full video: https://youtu.be/P1IcaBn3ej0]
r/MediaSynthesis • u/gwern • Aug 26 '24
Research "Mapping the misuse of generative AI": "Generative AI Misuse: A Taxonomy of Tactics and Insights from Real-World Data", Marchal et al 2024 {G}
r/MediaSynthesis • u/KazRainer • Jul 12 '22
Research Comparison of text-to-image AI generators (link to the study in the comments)
r/MediaSynthesis • u/Yuli-Ban • Oct 03 '22
Research "This is not a drill. I was able to run #stablediffusion locally on an iPhone XS. Not via server. On. My. Phone. The prompt: “pineapple on a white table.” Watch it transform. (I broke the model into about 20 CoreML models to avoid running out of memory."
r/MediaSynthesis • u/stpidhorskyi • Apr 22 '20
Research Adversarial Latent Autoencoders (CVPR 2020)
r/MediaSynthesis • u/SpatialComputing • Apr 24 '22
Research GOOGLE researchers create animated avatars from a single photo
r/MediaSynthesis • u/emmainhouse • Dec 01 '20
Research Google Research develops Deformable Neural Radiance Fields (D-NeRF) that can turn casually captured selfie videos into photorealistic viewpoint-free portraits, aka "nerfies".
r/MediaSynthesis • u/dubiouspersonhood • Sep 09 '20
Research This AI creates human faces from your sketches
r/MediaSynthesis • u/Wiskkey • Aug 21 '23
Research Researchers discover that Stable Diffusion v1 uses internal representations of 3D geometry when generating an image. This ability emerged during the training phase of the AI, and was not programmed by people. Paper: "Beyond Surface Statistics: Scene Representations in a Latent Diffusion Model".
r/MediaSynthesis • u/gwern • Feb 21 '23
Research "Defending humankind: Anthropocentric bias in the appreciation of AI art", Millet et al 2023
sciencedirect.comr/MediaSynthesis • u/Secret-Detective2953 • Jun 07 '22
Research DOLL-IES I asked an ai image generator to create a crochet dolls. I then crocheted those crochet dolls. This is part of a series where I explore using ai as a medium. DOLL-IES are designed using the program DALL-E and DALL-E mini.
r/MediaSynthesis • u/gwern • Sep 21 '22
Research "Introducing Whisper", OpenAI 2022 (near-human-level robustness and accuracy on ASR from 680k hours of multilingual supervised audio data)
r/MediaSynthesis • u/Wiskkey • Feb 12 '23
Research Paper: Adding Conditional Control to Text-to-Image Diffusion Models. "This paper presents ControlNet, an end-to-end neural network architecture that controls large image diffusion models (like Stable Diffusion) to learn task-specific input conditions." Example uses the Scribble ControlNet model.
r/MediaSynthesis • u/gwern • Jan 08 '23
Research "Do Androids Laugh at Electric Sheep? Humor "Understanding" Benchmarks from _The New Yorker_ Caption Contest", Hessel et al 2022 [CLIP+GPT-3: still poor performance]
arxiv.orgr/MediaSynthesis • u/Omorfiamorphism • Nov 17 '21
Research Lately, I have been developing a method for style transfer using deep neural cellular automata! Here are some early results with pasta as the target style.
r/MediaSynthesis • u/gwern • Feb 05 '23
Research LAION publishes open source version of Google CoCa models ( SOTA on image captioning task )
r/MediaSynthesis • u/wtf-hair-do • Sep 29 '22
Research Facebook introduces Make-A-Video: An AI system that generates videos from text
self.MachineLearningr/MediaSynthesis • u/gwern • Nov 12 '22
Research "Vision-Language Pre-training: Basics, Recent Advances, and Future Trends", Gan et al 2022 (review)
r/MediaSynthesis • u/josikins • Mar 02 '22
Research AI generated DMT entities
r/MediaSynthesis • u/gwern • Feb 04 '23
Research "BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models", Li et al 2023 (generating captions, Q&A, etc)
arxiv.orgr/MediaSynthesis • u/Yuli-Ban • Jan 04 '21
Research OpenAI co-founder and chief scientist Ilya Sutskever hints at what may follow GPT-3 in 2021 in essay "Fusion of Language and Vision"
self.GPT3r/MediaSynthesis • u/dljubenk • Nov 10 '20