On: Differentiable Neural Computers

[modeless]

Actually, in the architecture you described, if there is a planning net that's connected to image net and an audio net, rather than feeding audio to the image net I think synesthesia would be better modeled by feeding the output of the audio net into the image net's input on the planning net. If that makes sense.

[Senji → modeless]

Not the output. Making several single connections from intermediate layers from the different nets.