There will be another articles in this series on FPGAs, ASICs and so on.
https://blog.inten.to/hardware-for-deep-learning-current-sta...
There was also a PDF published by some university on Hardware required on DL operations. Must be somewhere in my submitted posts here