On: Microsoft’s New MT-DNN Outperforms Google BERT

[dav43]

I’m interested in this space and the technical aspects. However, can someone enlighten me as to specific problems these models solve? Any real world implementations? Eg we had this problem, we used this tool, these are the outcomes?

[danielcampos93 → dav43]

Document ranking, question answering, caption creation, keyword generation. Basically these model are super useful to search engines or any kind of engine that performs some kind of reasoning with text.

[tedivm → dav43]

These models are really good at translating from one language to another and summarizing text.

[solomatov → dav43]

Transformer model which this paper was baed on was used in Starcraft 2 bot by DeepMind.