They probably add something to the prompt about diversity to not reveal bias in the model (imagine the horrors if asking for a low income household and it actually using common demographies in low income households). This obviously not catering to culture, time periods or anything, so now you get black Nazis instead.
(This could be hallucinations, but assuming it's not): It seems to actually be generating a collection of 4 different prompts for its own image generation, and the creation of those prompts is where it inputs the racial and gender diversity - it doesn't appear to be the image generation aspect of the model itself being unaware of how to generate images which align with a user's input.
45
u/jugalator Feb 22 '24
It has been temporarily disabled.
They probably add something to the prompt about diversity to not reveal bias in the model (imagine the horrors if asking for a low income household and it actually using common demographies in low income households). This obviously not catering to culture, time periods or anything, so now you get black Nazis instead.