Remarkably cool. My only bit of feedback is that it's unfortunate so much of the commentary uses masculine pronouns (I found it distracting). Is that just a consequence of the training data?
Yeah, that's a massive problem with the natural language domain all across machine learning.
Unfortunately it's very difficult to track down training data for chess commentary in the first place, let alone trim down biases. For reference, I was able to gather about 1 million samples, but it really needs a billion.
Hopefully through data augmentation and better general intelligence models we can make better progress on bias issues soon, as that's a huge problem when we start trusting AI models too much in life.
You might be able to kludge a fix to tokenize the output and replace he/him/she/her with them/their. It's not as sexy as the engine outputting the correct words, but it should get the job done.
Yes, in this case as long as they still agree when it actually names people, I don't think it would be too difficult. There may be factors I'm not considering though.
Harder would be more general models like GPT-2 and GPT-3.
Sometimes it seems really accurate (like the cherry-picked GIF in the overview docs) and sometimes really off.
I think for the most part, it knows more than it lets on, but finding the right sampling methods (or better yet, generalized search) to generate the best comments is a tough problem because it's difficult to evaluate quality.
Probably not. The issue with always using one set of pronouns is that people with other pronouns may feel isolated. For example, always assuming software devs are male could cause female devs to feel like they don't belong.
Realistically, it's really hard to fix this encoded bias in language models.
Yeah it’s always annoyingly jarring when people assume that. You can even see in the comments on this topic that people attack the suggestion of gender neutral language, which further compounds on the feeling like we don’t belong or are explicitly unwanted.
Would 'queen' be considered masculine or feminine?
Bishops? Knights (joan of arc excepted)?
Are pawns slaves?
Ahhh, the sport of kings, reduced to 2021.
Personal attacks aren't cool and will get you banned here. Please review the rules and please don't post that way to HN. We're trying for a quite different quality of conversation here.
