I made a similar project to this (but without sound).
https://github.com/kfei/sshcam
Which uses SSH connection, 256-colors, Unicode block characters and CIE94 algorithm to compute color distance when mapping colors to 256 palette.
Watch it in action: https://www.youtube.com/watch?v=pAa-pGda9kY
