> edge NN's have two practical applications: anomaly detection and object defect detection
Do you have any links to companies working on this?
I also haven't found any real innovations since adversarial neural networks in ~2016, which roughly fits in with your timeline. Not sure what happened to Geoff Hinton's Capsule networks, that looked like it was going to be a big thing at the time. This is admittedly a very hot take though.
At Embedded World 2020, every embedded semi and FPGA company had some kind of NNet running. One that was really impressive was Xilinx. They had multiple demos set up at Embedded World in 2020 showing NNet's for defects, person detection, and audio vibrational analysis with autoencoders. As did several other FPGA companies. I googled some links but they don't look like what I saw. So I'd recommend googling Xilinx if you are interested in industrial applications.
Do you have any links to companies working on this?
I also haven't found any real innovations since adversarial neural networks in ~2016, which roughly fits in with your timeline. Not sure what happened to Geoff Hinton's Capsule networks, that looked like it was going to be a big thing at the time. This is admittedly a very hot take though.