The thing is the network didn't learn the features you described. Take a simple example : neural networks confuse leopard print couches with leopards. Why? Because the network learns discriminative features based on the data it has. Theres not shared concept saying "oh this is an animal with for legs".
