Which companies have all the Nvidia chips? Each Nvidia H100 can cost up to $40,000, and one big tech company has 350,000 of them!
Of course, the list of companies seeking such powerful chips for AI training is long, and likely includes most large technology companies today, but only a few companies have publicly crowed about how many H100s they have. The H100 is estimated to cost between $20,000 and $40,000 meaning that Meta used up to $640 million worth of hardware to train the model. And that’s just a small slice of the Nvidia hardware Meta has been stockpiling. Earlier this year, Meta said that it was aiming to have a stash of 350,000 H100s in its AI training infrastructure – which adds up to over $10 billion worth of the specialized Nvidia chips.
https://sherwood.news/tech/companies-hoarding-nvidia-gpu-chips-meta-tesla/