I never said the "artificial neuron" would be stateless. Natural ones have states and, if we model artificial ones as stateless it's just because they are easier to model that way. In that sense, an artificial neural network is an exercise of how little "neuron-ness" one needs to make a useful neural network.
