My AI lecturer at University told both the tank story and a similar London Underground story. In his version of the latter, the NN was measuring platform occupancy but sometimes produced anomalous results. After investigation it was determined that the NN was actually counting the number of bins that were visible on the wall (pre-IRA, I guess). On average, the more people the fewer bins are visible.