To a first approximation all breakthroughs are ignored for years until someone else steals them.
Transformers weren't scaled at google because it would eat their ad business. We could have had current level AI in 2020 if they'd been serious about it. They weren't and everyone who worked on it left when the gold rush started without having done anything meaningful in google.
Computer vision, which is the field I've been working on the past few months, is even worse.
Perverts in their basements are getting better than sota image recognition so their wifus have realistic vaginas, and writing tutorials which provide more working insights than any scientific paper.
This isn't a new thing. I dropped out of my PhD working on something similar to AlexNet in 2009 because everyone thought I should just use gradient boosted decision trees like everyone else at the time. I couldn't get $10,000 grant to buy a machine to run the training on.
It isn't just me. Yann LeCun's networks were running the postal service, but he couldn't get a paper published anywhere because it wasn't a hot area to publish in.
But, yeah. Tell me more about how great Western academia is.
Transformers weren't scaled at google because it would eat their ad business. We could have had current level AI in 2020 if they'd been serious about it. They weren't and everyone who worked on it left when the gold rush started without having done anything meaningful in google.
Computer vision, which is the field I've been working on the past few months, is even worse.
Perverts in their basements are getting better than sota image recognition so their wifus have realistic vaginas, and writing tutorials which provide more working insights than any scientific paper.
This isn't a new thing. I dropped out of my PhD working on something similar to AlexNet in 2009 because everyone thought I should just use gradient boosted decision trees like everyone else at the time. I couldn't get $10,000 grant to buy a machine to run the training on.
It isn't just me. Yann LeCun's networks were running the postal service, but he couldn't get a paper published anywhere because it wasn't a hot area to publish in.
But, yeah. Tell me more about how great Western academia is.