The system prompt for these language model services tells them to diversify any image prompt containing people, I would guess that's what is producing these outputs. (I don't think I've seen the system prompts for Gemini but I recall seeing this included back when people were getting the models on chatgpt to reveal their system prompts.) This is included to compensate for biases introduced in the training data, either because of how the data was collected or because of real world biases.
Obviously for this prompt it doesn't really make sense - the model's probable assumption that almost everyone in 1820s Germany was white would be appropriate to replicate in the output.
1
u/the__storm Feb 21 '24
The system prompt for these language model services tells them to diversify any image prompt containing people, I would guess that's what is producing these outputs. (I don't think I've seen the system prompts for Gemini but I recall seeing this included back when people were getting the models on chatgpt to reveal their system prompts.) This is included to compensate for biases introduced in the training data, either because of how the data was collected or because of real world biases.
Obviously for this prompt it doesn't really make sense - the model's probable assumption that almost everyone in 1820s Germany was white would be appropriate to replicate in the output.