Wrong (it's 350K according to Zuck on insta) and dupe of "Meta will have more than 350.000 Nvidia H100s this year"[0], or "Zuckerberg's Meta Is Spending Billions to Buy 350k Nvidia H100 GPUs"[1]
I wonder what he means by "H100 equivalents" - are these GPUs built in-house or from competitors like AMD / Intel that give equivalent performance to Nvidia's H100s?
I wouldn't be surprised if the answer is "all of the above" and more. Not only is there limited availability of NVIDIA chips, it's also useful to tell Jensen that you actually could buy from somewhere else, even if you don't really want to.
At the end of the day, the bottleneck is TSMC, on which all GPUs are produced right now, even the ones from Intel.
> “We’re so short on GPUs the less people use our products the better… We’d love it if they use it less because we don’t have enough GPUs” — Sam Altman
> Meta who has the 2nd most H100 GPUs in the world is increasingly leveraging GPU supply as a recruiting strategy.
$7 billion is a lot, but not comparable to the GDPs of countries which are in the trillions (unless you compare to the smallest of the long-tail).
Meta's annual revenues alone exceed $100B+ at this point, assuming these purchases are staggered over 2-3 years, it is basically adding a 2-3% overhead to their expenses on an annualized basis.
[0]: https://news.ycombinator.com/item?id=39044911 [1]: https://news.ycombinator.com/item?id=39046193