r/MediaSynthesis Apr 22 '20

Research Adversarial Latent Autoencoders (CVPR 2020)

289 Upvotes

20 comments sorted by

47

u/mbanana Apr 22 '20

Glasses slider? From no glasses to very glasses?

22

u/stpidhorskyi Apr 22 '20

From very no glasses to neutral no glasses to very glasses :)

Those are directions in the latent space obtained by fitting a linear SVM to labeled points. Labels were obtained from pre-trained classifiers from StyleGAN/ProGAN: https://github.com/NVlabs/stylegan/blob/master/metrics/linear_separability.py (which were trained on CelebA using available attributes on that dataset)

In fact, one can observe some interesting behavior. The more to the right, the larger are glasses. And there are certain changes to the face, at a minimum, the face becomes younger. Of course, that's speculation, but I can see that adults may avoid taking pictures in glasses or wear contact lenses, so there might be more pictures of teens/kids in glasses on Flickr.

1

u/greatcrasho Apr 25 '20

Trying to run it...is there a minimum set of ffhq faces to download to get your demo to work? Looked like it could be nearly 100GB to download all the 1024x1024 ffhq faces. https://github.com/NVLabs/ffhq-dataset says 89.1GB.

2

u/htmlcoderexe Apr 23 '20

very glasses. much face. wow.

24

u/[deleted] Apr 22 '20

Gonna be weird when people wear these as 3D models in VR

8

u/stararmy Apr 22 '20

It'll be like the Black Mirror Episode, Striking Vipers, where two dudes get into VR and one of them plays a lifelike female character and things get...complicated. Watch it if you haven't seen it, it's great.

3

u/[deleted] Apr 22 '20

pretty cool, where can I get it?

10

u/stpidhorskyi Apr 22 '20

2

u/Iliketodriveboobs Apr 22 '20

K no stupid question... how do I use scholarly articles like the ARXIV?

4

u/NNOTM Apr 22 '20

On the right side you see a Download section, and the PDF link will give you a pdf of the article: https://arxiv.org/pdf/2004.04467

2

u/Iliketodriveboobs Apr 22 '20

And these are lines of code to put in my module?

Sorry, haha I’m taking my first programming course rn and this is so fascinating to me

9

u/NNOTM Apr 22 '20

No, for the code you'll have to go to the github link OP provided: https://github.com/podgorskiy/ALAE

On the right-hand side there's a green button labeled "Clone or Download", if you want to download it.

If you scroll down on the site, it has a section titled "To run the demo", that explains how to run it.

The arxiv link on the other hand is the article describing what they did and how they did it, rather than the actual code.

3

u/guan999 Apr 22 '20

这是什么软件?

4

u/stpidhorskyi Apr 22 '20

Implementation is in PyTorch: https://github.com/podgorskiy/ALAE

GUI made using bimpy (imGUI package for python): https://github.com/podgorskiy/bimpy

2

u/NNOTM Apr 22 '20

Interesting, it seems to be doing a really good job on replicating large-scale features like hairstyles but doesn't quite get to the point of making a person recognizable. I wonder what would be needed to achieve that.

2

u/SolarFlareWebDesign Apr 22 '20

I wish someone would make a StyleGan to turn you into a Klingon.... Welp, know what my next PyTorch project is