On: The Neural Net Tank Urban Legend

[divergencefree]

Yea this is what I was thinking of. Another work in that direction: https://www.nature.com/articles/s42256-021-00338-7

I never heard of the tanks story, but I vaguely remember stuff in radiology which was a similar story basically, it learned some spurious correlation to the label.