On: Hardware Acceleration of LLMs: A comprehensive sur...

[nickpsecurity]

They mostly failed in the market. I have a list of them here:

https://news.ycombinator.com/item?id=41069685

I like the one that’s in RAM sticks with an affordable price. I could imagine cramming a bunch of them into a 1U board with high-speed interconnects. Or just PCI cards full of them.