Can't we have hardware companies that make hardware, software (AI) companies that make software, and data companies (or government institutions) that run the software on the hardware and deal with our data?
We had that, then we realized that companies who understand all the pieces lead to better user experiences, which is why we all have MacBooks and iPhones.
Using my Apple Silicon Macbook is a way better user experience than my Intel Macbook ever was. It certainly feels like they invested in user experience well after the walls were up around the garden.
> It also creates walled gardens and reduced incentives to invest in user experience once those walls are built.
> Not because the UX is bad
I don’t see the connection. The first sentence says that walled gardens create bad UX, but Macs are the premier mainstream walled gardens and you don’t find their UX bad.
I dunno, the last two generations of MacBook pro pretty much feature for feature provide fixes for all the widely criticized issues of the last Johnny Ive models. Apple has plenty of faults but they seem to actually be listening to user feedback in some areas despite a captive audience.
This is a funny example because Apple has disproven this logic just as often as they have proven it. Carplay and the App Store are two examples. People generally prefer the software Apple makes over the software car manufacturers make. People also like to install their own software on their devices beyond the software that Apple makes.
Just because vertical integration occasionally works doesn't mean it is actually good for the consumer.
“good for the consumer” is as subjective as the consumer.
the eu disagrees in that it views itself as representative of the consumer. similar to how us states set laws that may be more strict than others.
get a large enough government of a populace with a large enough portion of the sales, and companies can be made to act. which can be good, but isn’t a guarantee.
just because companies can be forced to act doesn’t mean the forced actions are actually good for the consumer.
Honest question, is Google the one making it impossible to set Google Maps as the default maps option on Apple? Or making it impossible to one-click delete backed up photos?
I fully believe Google holds back differentiating features and DSPA is certainly mismanaged, but I'd hope these basic functionalities are not the ones since there's always the tradeoff between serving 50%+ of your mobile users and trying to differentiate Android/Pixel...
Apple does shit like make it impossible for Google Fi to set up easily on iPhone, so I just assumed most of the UX idiocy came from Apple's anticompetitive review process.
When hardware companies fail to provide sufficient competition to an extortionate monopoly, the layer1 companies react after feeling the burn for too long.
If Nvidia, Amd and Intel were in a battle for offering the best VFM, none of these companies would be hopping into hardware. Apple's strong commitment to chip making coincides with years of stagnation from Qualcomm and Intel.
From my experience, companies love nothing more than a 3rd party that solves your problem for you, better than you and at a price that's easily cheaper than what I'd cost to build it in-house. This is especially true when the 3rd party product is an internal spec (gpu, cpu) rather than a competing platform (android auto)
There is a reason car companies don't build their own speakers or tires....but still try to build their own UI (no matter how bad)
Moores law is dead when it comes to power consumption, that means compute is getting more capital intensive.
If you have an algorithm that works and need scale, you must vertically integrate to maintain an edge over those using more general compute architectures.
The vertical integration allows them to corner the market and destroy the competition or prevent them from entering the market, which is bad for the consumer and bad for society, eventually.
It's lack of anti-trust laws and (more importantly) enforcement that allow companies to corner the market. nVidia and ARM should be worried about competition from OpenAI and Google: that's the good kind of competition that we want. If only "hardware companies" are legally allowed to make hardware, that increases their moat, not decreases it.
Let's instead go back to when we actually enforced the anti-trust laws that we have. That was nice.
Would OpenAI be competing with them, though? If they just manufacture their own and use their own, but don't sell them, then nVidia and ARM are just losing a client, not getting competition.
Ideally what we would see is OpenAI investing in a new but independently operated chip manufacturer that makes chips to their standards. Though is it also possible that a chip of such standard would be so specialized that it wouldn't be usable by others? I'm not a hardware person, so that's a genuine question.
I'm very hesitant to define competition as "can't sell to them because they make theirs in house". Losing a sale isn't competition. Competition is someone threatening to take your clientele from you with their own offering. Apple can afford to design and use its own chips, but they're in a pretty unique position to do so. It's not like every other consumer of their chips is going to say "hey, if it's that easy, I'll do it too".
I would go even further. I was wondering why most chip companies are so good at being mediocre. Like TI OMAP dropping out of smartphones and so on. But I think it's worthwhile to invert the question. It is quite extraordinary in the silicon space for there to be 1 clear winner like Nvidia or Qualcomm (or Intel not so long ago). So much so, that we can assume they got there by anti-competitive means and rent-seeking measures.
Ironically, Open AI are going to face the same gigantic barrier to enter the market.
As of today, I say if they go into consumer market they will fail.
If they go into specialised server chips, then they would have a chance, with some sort of accelerator over some arm-based chip - similar to what Nvidia is doing with Grace. Still big money to be spent on supporting the existing ecosystem on their hardware.
Vertical integration is already under scrutiny by the antitrust folks. Even more so now after everything Google was able to get away with.
OpenAI wanting to vertically merge to make their own AI chips may seem harmless enough (it's a good business move, we can cut expenses)! But we can't forget that Sam Altman just a few months ago told Congress he supports making an organization that companies need permission from to being creating/utilizing advanced AI systems. And he's such a kind man he's willing to lead that organization himself.
Obviously someone integrating the chips to train AI, and having the ability to approve/deny his own competition is a huge red flag.
Well kind of. You are ignoring the elephant in the GPU hardware room right now, which is NVidia.
NVidia has a near monopoly on the AI hardware market right now, so some vertical integration of alternative AI hardware doesn't seem nearly as big if a deal if it is needed to fight that current monopoly.
That's true, but again, him attempting to put himself as the gatekeeper of who can and cannot train/utilize advanced AI systems at scale gives him (almost) unilateral control over Nvidia's own AI chip manufacturing business. Deny startups the ability to train AI systems, and you deny Nvidia the opportunity to sell them their chips. Nvidia loses that revenue stream and stops producing AI chips due to high production costs and "lack" of demand. Ultimately leading to a market where only the obscenely wealthy companies who can manufacturer their own in-house chips can train AI, and even then, Sam Altman can deny even that.
I bet OpenAI is trying to figure out how to have self-improving AI which suggests modifications to the hardware that runs it. You’d need some hardware expertise in-house for that (in addition to software of course), though not necessarily a big chip company.
Dealing with this professionally for DNNs. It just doesn't work. The large, important DNN models are so complicated, the toolchains for optimized execution don't do sane things unless you do some sort of vertical integration. The community tried with things like TVM, Halide, ONNX and others .. it is just crazy if you don't have a fully opinioned pipeline. Just my personal opinion.
Every company is going to want to avoid paying rent on key infrastructure that they rely on for their business, thus the push to own their own IP and means of production in that regard.
It doesn't work out all the time, for sure. In fact it probably fails more than it succeeds. But the motivation is pretty clear.
This is especially true when you are beholden to a single supplier, with basically no competitive options.
Right now nvidia completely owns the AI market, and is exploiting that absolute monopoly with ever escalating pricing, licensing and restrictive usage models. Everyone keeps trying to escape this -- see Tesla and their super-hyped and now apparently abandoned Dojo thing, while they put in their orders for tens of thousands of H100s -- but instead they keep being beholden to nvidia.
That may seem to be an advantage. But because there is only 1 (or a few) companies now controlling the whole stack, you have less choice in the products you can buy. And since the incentives of the vendor may not be aligned with yours, which is increasingly the case if they are a monopoly, then the product is not actually better from the consumer's point of view.
Don't like the way OpenAI treats your data, or how you can only run it in the cloud and not on an on-premises server? Or what dataset they used for training? You're out of luck!
But if the market were more modular, and lots of small companies could use the same hardware in their products, you'd have something to choose from!
Can't we have hardware companies that make hardware, software (AI) companies that make software, and data companies (or government institutions) that run the software on the hardware and deal with our data?