Sam Altman: “Local inference is a terrible allocation of scarce resources”

Sam Altman: “*Local inference is a terrible allocation of scarce resources.*

*A lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we're going to be able to run them on our computers, and so we're not going to need all the stuff in the data centre*

*but from a global allocation perspective, actually it's quite terrible to have everybody, like, have a bunch of the world's limited supply of DRAM sitting in their own computer and being used five percent of the time*

*you want maximum utilisation in the cloud if you're trying to deal with this very supply-constrained environment,*

*somehow many people's intuition is the opposite of that”*

*——————————————————————*

**TL;DR Guy selling product: "Here's why owning your own product instead of renting it from me is a terrible idea"**

(Credits to @RyanTStull, his TLDR made me laugh)