On: Neural Networks, Types, and Functional Programming

[colah3]

I think questions about representations and symmetry are really interesting.

Have you looked at deep symmetry networks? (I think the right way to frame the idea is in terms of group convolutions, which I outlined here: http://colah.github.io/posts/2014-12-Groups-Convolution/)