OpenAI CEO Sam Altman managed to stir up a small storm online with a remark about the memory in your computer. According to Tom's Hardware, Altman said on a podcast that it is "quite terrible" that people have RAM in their personal computers, because it is idle most of the time, and that data centers can use it much better.

Altman's logic

Technically, the claim has a basis: in a home computer memory sits idle most of the day, while in a data center the same memory serves thousands of users around the clock. For OpenAI, a future in which most computing happens in the cloud rather than on the device is also a future in which it earns more.

Why it rankles

The problem is the timing. The world is in an acute memory chip shortage, precisely because of demand from AI data centers. Samsung and SK Hynix reported record profits this month, and memory prices for PCs and smartphones have risen. Mobileye also said it is passing higher memory costs on to customers. When the CEO of one of the companies driving that demand tells consumers their memory is wasted, it is no surprise the reactions were angry.

The big debate

Behind the remark is a fundamental debate: will AI run mainly in the cloud, controlled by a few giants, or also on our devices, with more privacy and control. Nvidia and Microsoft, for example, are promoting PCs that run AI agents locally. Altman, it seems, is betting on the opposite direction.

Sources and further reading