Hacker News new | past | comments | ask | show | jobs | submit login
Google Pauses Ability to Generate Images of People (engadget.com)
34 points by Koshkin 8 months ago | hide | past | favorite | 7 comments



So, with the initial controversy, what exactly happened? Was Google inserting information that wasn't asked for into the user prompts? Or is the underlying model strongly biased towards certain outputs?


If these prompt leaks on Twitter are to be believed, then it appears Gemini was injecting words such as "diverse" into user prompts as well as specifying certain ethnicities in order to create a more varied set of images.

https://twitter.com/BasedTorba/status/1760486551627182337


It's probably true because if you asked the bot for any kind of vague info humanity in any way, almost every response talked explicitly about diversity.

They need to change the pre prompt "you are helpful and creative. You care about diversity, but you don't annoy people by obsessing over it in all your statements. You show your values in your actions, not by constantly talking about them.

But wasn't this method of "attack" debunked a year ago? Thes bots are programmed to be suck ups. If you accuse them of anything not banned, they will agree with you and hallucinate an explanation to confirm your stated bias. They can't actually see their own preprompts as such.


Yeah, that's what's broken


Seems like it would check out, I'm pretty sure if I said "show me black and south asian diverse non-binary and woman solders from 1940s Germany" I might end up with diverse Nazis.

This also means Google could always, you know, simply expose the prompt injection to users and allow them to request nothing but white men. Of course they won't, because you are wrong for wanting a picture of a white man, as Gemini will explain to you.


> Or is the underlying model strongly biased towards certain outputs?

While Reddit might have just publicly announced an AI deal with Google, I highly suspect Gemini has been trained on Reddit’s dataset, extreme left leaning sensitivities and all.

It’s the reason why Reddit sold out for so cheap. Their product has already been deemed as flawed, and they want to IPO before people find out in hopes others are left holding the bag.


[dupe]

Lots of discussion here: https://news.ycombinator.com/item?id=39465250




Consider applying for YC's W25 batch! Applications are open till Nov 12.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: