On: Google T5 scores 88.9 on SuperGLUE Benchmark, appr...

[nopinsight]

The amount of data required may not be a decisive factor but rather a canary in the coal mine that something is off.

If we wish to use a model in critical situations, such as a medical setting or commanding a self-driving car, 1) and 4) above cannot be ignored.