On: Differentiable Neural Computers

[Senji]

If we're going with a brain metaphor. What would be the those neural networks' version of synesthesia?

[empath75 → Senji]

Feeding mp3s to an image recognition neural net. And as soon as I typed that, I want to try it.

[modeless → empath75]

Actually, in the architecture you described, if there is a planning net that's connected to image net and an audio net, rather than feeding audio to the image net I think synesthesia would be better modeled by feeding the output of the audio net into the image net's input on the planning net. If that makes sense.

[Senji → modeless]

Not the output. Making several single connections from intermediate layers from the different nets.

[dharma1 → empath75]

CNNs can actually be used for audio tasks too, on spectrograms

[Senji → dharma1]

It's how some guys defeated the first iteration of recaptcha's audio mode. Then google replaced it with something very annoying to use even for humans.