RAM Altman: Linux Script Emails Sam Altman Daily How Much Unused RAM in Your PC

240 points by randycupertino 22 hours ago on hackernews | 139 comments

badgersnake | 22 hours ago

I didn’t think we’d get to the point where all compute is headed for the data centre and normal people don’t get to have anything bigger than a phone but here we are.
Kind of inevitable when you realize how much people are naturally willing to give up computational sovereignty for the sake of convenience and psychological safety espousing values claiming the opposite, and it's still the case despite everything that's happened so far
I don't think there is a lot of conscious choice here: If at some point, anything more complex than a phone would be phased out or become unaffordable for consumers, that's not because consumers had somehow collectively voted they only want phones from now on.
Well sure someone could argue that the market isn't an actually reasonable set of choices that people can vote on, but how can it not be considered at least some form of voting? There's been at least 30-40 years in which consumers could try to find out. Unfortunately there's only a finite amount of resources in the market and consumers have to compromise on what takes priority in the tech industry, like getting work done or tackling issues that are visible only in front of them. When people collectively vote for politicians they also have to compromise

I don't feel extremely on either end, but I would prefer if consumers could own their choices and not try to pretend otherwise

Well, ok, what would you do in the current situation to "vote" for affordable RAM?

In a perfectly free and fair market and in a world where companies would plan their product strategy exclusively based on current consumer data, this would be true. But neither holds in the real world: The current AI gold rush is now something that is largely decided between investors, boardrooms and hardware vendors (*) with little input from small everyday consumers. And I wager this has been the case for many "tech trends" before that seem more forced on users than originating from them - such as forced updates, mandatory accounts, subscriptions, in-app purchases etc.

(* if you want to be provocative, in the US mostly by the people in this photo: https://apnews.com/article/ai-safety-openai-tech-week-32064f... )

agile-gift0262 | 17 hours ago

Even if it were possible to vote in the market (I deeply disagree though), the ultra rich have waaaaaaay more "votes" in the market to a point where anyone's vote doesn't matter.

armanckeser | 17 hours ago

Its interesting that you put it as "don't get to", I am pretty sure "normal people" don't care about having local computational power. We in this forum are not normal people, 80% of people just care about the end value computation brings. The future is likely devices with network chips attached to screens ans that's probably a better outcome for 80% of the world. There is no reason to think we pay the same amount of money to get worse results in the future, we can work towards one where we pay less because centralized computation and devices that are only screens and WiFi chips will be cheaper for everyone

soraminazuki | 9 hours ago

Ah, the classic HN "normies don't care about being screwed over by multi-trillion dollar companies as long as it involves technology that they don't understand." And then people here also complain about how the growing backlash to the tech industry is all based on "clickbait." The lack of self-awareness is staggering.

armanckeser | 2 hours ago

What is there to understand? You are a bit delusional if you don't see that everything is data and when internet becomes so fast and infrastructure widespread that its viable to distribute all data needed to get a good real time experience, most devices will be built that way. I'm sure just like we self host, we will be able to buy our own compute shared from our home but if you think that a future where anywhere in the world you could use the most advanced computational resources through satellites just has to be one where people are screwed over by trillion dollar companies, you don't understand what value is.

soraminazuki | 2 hours ago

Right, so any time soon, the very same companies currently exploiting the public will somehow have a change of heart. Tech companies built on mass surveillance, emotional manipulation, and rent-seeking will all voluntarily start to give back and we'll all benefit from abundance enabled by Musk and co's physics-defying sci-fi tech. Talk about being delusional.

altcognito | 22 hours ago

What are the chances that they already do this :) Well, probably not given how much memory the harnesses use. (Claude too in fairness)

Tiberium | 22 hours ago

SurfingAlpaca | 19 hours ago

That's a dupe too. This is the original https://news.ycombinator.com/item?id=50412766

realist_not | 22 hours ago

Wouldn't unused RAM infuriate him more ?

badgersnake | 22 hours ago

That’s the point.

bstsb | 22 hours ago

the ridiculous "no ad blocker" full-screen modal that's unclosable led me down a rabbit hole there - turns out there's some obfuscated script from "Ad Shield" which replaces the whole site with an iframe if you dare to block their domain, "html-load.com", which proxies ad networks.

fortunately one can just run debugger; to stop it early

BrandoElFollito | 20 hours ago

I noticed it on several completely unrelated sites since a few days. I've never seen it before.

I was wondering if they're was some kind of consolidation/buyoff of pro-ad-protection services.

plausibility | 10 hours ago

This particular parasite is pretty common on cooking blogs, for some reason. I remember it going back at least the last 2-3 years. It's a clever trick.

The site embeds something directly on the page (<script> tag) that redirects you to the normal "turn off your adblock" begging page if a callback timer doesn't return. So blocking the AdShield domain the naive way just means all the sites load for about 500-1000ms and then redirect once it's rendered but the ad script doesn't kick in.

braiamp | 19 hours ago

Or... one run noscript

kotaKat | 18 hours ago

if you're on ubo lite, move from 'optimized' to full for that page and it shoooould dump adshield out.

Vinnl | 18 hours ago

I'm not getting it either, nor have I seen it in other sites. I wonder if this is because of Firefox not having neutered uBO?

arcanemachiner | 18 hours ago

That is correct, uBO Lite is A Chrome-only thing since they finally neutered uBO recently.

thedday | 18 hours ago

Interesting. I'm using Firefox Focus and the page loads and is ridiculously free of distractions, err, ads.

kotaKat | 15 hours ago

i've seen it personally on Orion on iOS, their adblocker seems to be unable to get around it.

lobo_tuerto | 18 hours ago

uBlock Origin + NoScript does the trick.

Dwedit | 18 hours ago

Using uMatrix/nuTensor to block JS from respawnfirst.com also lets you ignore the nasty script.

shevy-java | 18 hours ago

Ah, I was complaining about the modal slide-in and other pester-widgets.

I am glad to not be the only one who hates that. Modern websites are so scummy.

Bengalilol | 18 hours ago

Or one could find the original post here <https://news.ycombinator.com/item?id=50412766>, which leads to <https://ram-altman.lol>

Brian_K_White | 17 hours ago

Looks fine to me.

Firefox, ublock origin. (on linux but I don't think that matters)

No noscript or special filters.

Jamesbeam | 20 hours ago

All your RAM are belong to us

I am an old-school guy. I don’t send them emails with unused RAM, I just fax them a printout of the script so they have to physically look at it and remove it before it goes in the trash. Bonus points if you send it to legal. Legal always has a fax machine.

With what people at OpenAI make per hour, every fax costs them thousands of dollars in labor costs, wasting all their precious resources one toner cartridge at a time in the process.

I am just making proper use of all that underutilised toner.

kraken_cult | 19 hours ago

This guy knows what's up.

spearfish | 19 hours ago

No toner on fax machines, just forever chemical paper that slowly muders their employees.

Jamesbeam | 19 hours ago

Obviously you do not know my trusty battle fax. The Brother Laser Fax 2840.

22 direct-dial and 200 speed-dial entries. Broadcast to up to 272 participants. Sexy.

Lots of companies still use Laserfax. dr2200 toner cartridge is 40 bucks for 12k pages.

peri-cl | 19 hours ago

> "Broadcast to up to 272 participants."

256 + 16? How do you get a number like that? Some trick with variable-width binary codes?

Jamesbeam | 19 hours ago

Not a binary encoding trick. It's just the sum of the fax machine's recipient capacities.

22 One-Touch numbers + 200 Speed-Dial numbers + 50 manually dialled numbers = 272

If you do not store a Group on any of your Brother machine's One Touch or Speed Dial locations, you can Broadcast a fax to as many as 272 different numbers.

Which comes in especially handy for keeping their SI from exfiltrating via fax to a remote location one baud at a time. You just keep all their landlines busy until the army flattens the building.

It wasn’t nukes or bombs that saved mankind from Skynet. It was a single fax machine keeping all of OpenAIs landlines busy for 25 minutes, sending hundreds of pages of hand drawn A4 sized dicks.

Avicebron | 18 hours ago

This guy faxes.

subarctic | 19 hours ago

If you're going to that trouble you may as well create a DOI number for it so they think it's a rare book and scan and destroy it.

Jamesbeam | 19 hours ago

I think my signature will do for now.

Regards,

https://fbi.cults3d.com/uploaders/15196480/photo-file/19c974...

ChrisArchitect | 19 hours ago

dmitrygr | 19 hours ago

I am sad that it is not configured to actually email him by default
I would hesitate to say the memory used by the filesystem cache is unused.

port11 | 8 hours ago

The audacity of thinking you need your frequently accessed files cached is… I mean, come on, you can put your files in the cloud!
Just what is the point?

AnimalMuppet | 19 hours ago

To rub Altman's nose in the fact that we have RAM that he wishes he had.

Or, more likely (since I doubt he's ever going to see one of these emails), to make us feel a bit better about ourselves after Altman said (in effect) that what we want doesn't matter.

ModernTimes | 18 hours ago

Have you not seen the endless posts pointing out that the RAM story was fake exaggerated nonsense?

anonymous908213 | 18 hours ago

"A lot of people want local inference. And somehow, they assume that like the problem is solved now. Because we are going to have open-source models. We're going to be able to run them on our computers. And so we're not gonna need all the stuff in the data center. But from a global allocation perspective, actually, it's quite terrible to have everybody, like, have a bunch of the world's limited supply of DRAM sitting in their own computer. And being used 5% of the time."

I've seen the video where he says those words out loud, on mic.

port11 | 8 hours ago

I’d never heard the first part, I think that makes it even worse because it’s in the context of people breaking free from the feudal AI system. Yikes.

soraminazuki | 10 hours ago

"The party told you to reject the evidence of your eyes and ears. It was their final, most essential command."

https://www.youtube.com/watch?v=iMsUcCYNKqY&t=1765s

tomcatfish | 19 hours ago

Is this a script-kiddy DDOS (when many users run it) of someone's email? This doesn't seem very HN.

Edit: No, the email is blank, so it's just a regular DOS, unless his email is public somewhere and everyone will fill in the same email. Still not very HN, but just bad, not malicious.

iAMkenough | 18 hours ago

Is you determining what is and isn’t HN, simply by if it’s “many users” vs “many companies” spamming someone?

Based on your argument, I would assume YC-funded AI crawlers spamming a website with requests is “very HN” and “not DOS.”

ErroneousBosh | 19 hours ago

I have no unused RAM; if any shows up I spin up some nested Alpine VMs. I got 20 layers deep the other day.

Fucking Cry Harder, AI bros.

Dwedit | 18 hours ago

Watch out in case someone wants to SSH into those nested Alpine VMs using any 257 character password.

ErroneousBosh | 16 hours ago

Joke's on them, there's 20 of them and they're really fucking slow. It'll take them a week to type a 257 character password.
So, the guy who built an AI company that thrives on your personal information to sell you ads and your idea of fighting the said guy is voluntarily emailing him everyday more personal information?
It doesn't actually email anyone anything, does it?

It's satire.

leecommamichael | 18 hours ago

Isn’t this kind of an illegal crowd-sourced DDoS?

axegon_ | 18 hours ago

We should allow it. I have around 15 computers across my home lab, desktop computer and laptop(excluding the toys like pi zeros). Letting him know that I'm not utilizing several hundred GBs of ram seems reasonable.

sophacles | 18 hours ago

No

shevy-java | 18 hours ago

I think Sam owes us money.

Also - this will probably age as well as Bill Gates and the 640kb statement, which he never stated in that way, but will forever be linked to him.

Sam RAM-boy Altman. Or Sam-RAM-man.

mindwok | 18 hours ago

IMO his comments are blown way out of proportion. He says "from a global allocation perspective" it's better to have RAM in the cloud where it can be used much more efficiently. I think there's an argument to be made that this is more than just economics to most people, it's about ownership and freedom, but he's clearly just talking economics.

clintonc | 18 hours ago

Sure, but he's also insinuating that the economics of the situation is more important than the other, unmentioned aspects. In short, that his interests weigh more in what "best" means.

stinkbeetle | 18 hours ago

Everybody believes their interests weigh more. Fortunately we have capitalism, so at the end of the day you have to put your money where your mouth is and pay for what you think your interest is worth.

mihaic | 18 hours ago

Not sure if your arguments here is for capitalism. Having 1 vote = $1 is not a system most people would agree with today.

stinkbeetle | 16 hours ago

Sure. Better the capitalism that has Altman complaining about the peasants getting the RAM that he deserves better, than having the corrupt incompetent government and bureaucrats bought and paid for by him decide to allocate it "for the greater good" (i.e., his data centers).

mihaic | 15 hours ago

Because these are literally the only two options?

stinkbeetle | 6 hours ago

That's not an argument.

mihaic | 3 hours ago

Yes it is. It calls out that you're doing a false dilemma, which is a quite known type of fallacy. The burden is still on you to prove better, instead of asking me to work in your system.

cowlevel | 8 hours ago

That did happen but with extra steps, one of the extra steps being money.

stinkbeetle | 6 hours ago

No it literally did not because he is complaining about not being allocated these things for the greater good by some corrupt politburo.

godelski | 17 hours ago

  > Everybody believes their interests weigh more
I don't. I believe I have to weigh my benefits to collective ones. Sometimes I do things that offer me no benefit whatsoever but does for others. Just the other day I offered to take a picture for a couple who was trying to get a selfie together. Last week I bought an intern lunch. Why? Because they were an intern (grad student) and I'm sympathetic to that.

Fun fact: I'm not a "rare outlier". People like me are pretty common and can be found all over. We usually just don't openly talk about it because we're not looking for a reward. I'm not speaking up now because I'm looking for self-gratification or anything. I'm speaking up to push back against your claims. I'm speaking up because we live in an increasingly selfish period of time. I'm speaking up because we're also at cultural turning point and many people are saying "enough is enough." I sure as hell don't care how rich you are, but I do give a damn about where the economic floor is. If you take from that floor to lift yourself up, I'm upset. If you do this to lift yourself when you already have more money than you could possibly spend in several generations? I'm furious.

mindwok | 17 hours ago

I believe you. I'd challenge you though to consider Sam Altman would make the same claim about himself. The difference between you is not that you are good and he is bad, it's that you likely have very different beliefs of what the "good" course of action is. He likely believes successful adoption of AI means advances in science, medicine, freeing people up for more meaningful things, etc.

godelski | 17 hours ago

Sure, most people don't view themselves as the villain of their own story, but that's not what my comment was addressing. My comment was narrower

mindwok | 16 hours ago

Fair, maybe I should say I think he wouldn't see his actions as taking from the economic floor, he would argue he is raising it. E.g. more effectively utilising resources (like RAM) means RAM is cheaper, which means more people can use it for their businesses and ideas.

godelski | 10 hours ago

Sure, EA people claim this all the time. But we all know their argument doesn't add up. Personally I find it odd that so many of them are AI doomers, because that illustrates that you can't rely on the future for your ethical credits to mature.

We all tell ourselves stories, but it is more important that people in power tell themselves realistic stories. It is important that we hold people in power accountable. Left unchecked they, like everyone else, will delude themselves. But it is easier for them to delude themselves because they become detached from the lives of the average person.

So I'm sure he does, but what he believes doesn't matter as much as what actually happens.

stinkbeetle | 16 hours ago

Maybe a billion people would view you as having and owning and spending more than several generations of their families, maybe more. Yet you see wealth accumulation as a problem because there are those with much more than you. Are you the villain of your own story?

godelski | 10 hours ago

If I was then wouldn't I be a lesser villain? By your own logic?

I'm sorry, I'm not going to buy into this. It's literally a textbook fallacy argument. Don't make lazy arguments. Especially to defend those who clearly live in a completely different world than you and me.

stinkbeetle | 7 hours ago

> If I was then wouldn't I be a lesser villain? By your own logic?

No, not by my logic. I don't think people are necessarily villains for prioritizing their own interests, for being born into fortunate circumstance, for having good fortune along the way, or even for having some self-centered myopia and hypocritical opinions. It's a very normal part of the human condition.

But by your logic, perhaps.

> I'm sorry, I'm not going to buy into this. It's literally a textbook fallacy argument. Don't make lazy arguments. Especially to defend those who clearly live in a completely different world than you and me.

Are you talking about the billion people living in poverty in 3rd world countries? I was not "defending" them or anybody else, just observing a factual reality of the world we live in. I don't know what you think the "lazy argument" was that I was apparently making.

cykros | 2 hours ago

He would. These effective altruists are fucking scum, just like Sam Bankman Fried of FTX (who funded them), and hopefully they'll all end up in the same place.

stinkbeetle | 16 hours ago

Well I congratulate you for finally having the courage to speak up about offering to take a picture for some people that's very commendable, but that doesn't really address what I wrote. I didn't say everybody weighs their own interests at 100% and everybody elses' at 0%.

godelski | 10 hours ago

Clearly you missed the point. I could show you my donations but you and I both know there would have been an argument about tax benefits. So I gave simple, unambiguously selfless acts.

  > I didn't say everybody weighs their own interests at 100% and everybody elses' at 0%.
 
In context you said something very close to that. Which is why multiple people have responded as such.

stinkbeetle | 7 hours ago

No I did not, I said they prioritize their own interests. That is is very different.

kelnos | 17 hours ago

> Everybody believes their interests weigh more.

I don't. When I make decisions that might benefit me but affect others, I consider the impact on others before deciding what to do. Sometimes (often?) I choose the option that benefits me less (or is neutral, or hurts me), if I believe the negatives to others are too high.

stinkbeetle | 17 hours ago

> I don't. When I make decisions that might benefit me but affect others, I consider the impact on others before deciding what to do. Sometimes (often?) I choose the option that benefits me less (or is neutral, or hurts me), if I believe the negatives to others are too high.

I didn't say that means they don't consider others, and I haven't taken a survey of everybody on the planet.

Obviously people believe their interests weigh more.

zombot | 10 hours ago

My unusual opinion: Not everything in life can be measured by the dollar.

stinkbeetle | 6 hours ago

Yes that's very true. RAM can be though. In a much better way than some corrupt "expert decider" deciding their friends' needs are much greater than everybody else's.

cykros | 2 hours ago

That's true. But money is a great way to measure and allocate scarce resources, especially given that the alternative is war, or war's little brother, government (either way it's men with guns using violence).

The dollar is a shitty measuring stick though, given that its size is not fixed, and that newly printed dollars mean that those closest to the printer see their dollars count for more than those who are further. See: The Cantillon Effect.

If only we had some form of money with a fixed supply...

sift3r | 18 hours ago

People at his level are typically mindful of how their words are perceived when doing interviews to the public at large.

thatsabadlook | 18 hours ago

That went out the window a few years ago. These tech oligarchs are getting more and more comfy with their optics being full psychoticism. They don't even know how to hide it anymore because all they think about and talk about and plan long short and medium term is extracting capitol at all costs for themselves.

godelski | 18 hours ago

Okay? So what's your argument, that we should just ignore them when they are being openly pathological? Sounds like that just let's them continue being crazy.

thatsabadlook | 12 hours ago

I'm not arguing anything. Just talking.

throw10920 | 12 hours ago

HN is a place for thoughtful discussion that gratifies intellectual curiosity. "Just talking" that has no point or argument or anything beyond one's unfounded personal opinion is profoundly boring and has no place here. Not even joking, that's what Reddit is for.

qweqwe14 | 6 hours ago

You must be fun at parties

throw10920 | an hour ago

Yes, I am, because I'm capable of using my brain and judging the appropriate topics to bring up in a time and place.

Your comment is the exact opposite of both of those things. You really belong on Reddit.

Sharlin | 17 hours ago

They watched Trump being able to say absolutely anything comes to his mind and figured that maybe they don’t have to pretend to be humans either.

saturn_vk | 18 hours ago

Maybe we should be talking about the global allocation perspective of wealth then. Since Altman is so keep to optimize allocation, perhaps he should start with this aspect first, and then move to RAM, as wealth would impact a wider area of economics than RAM.

xlayn | 18 hours ago

Absolutely, I agree that money is better centralized in the goverment where it can be put to use for the benefit of all society instead of being concentrated in billionares.

mindwok | 15 hours ago

While I agree there's certainly a better in between, if you go the other way you have moral hazard. If people aren't bearing the risks (or rewards) for how they allocate resources, history shows they allocate them poorly.

HWR_14 | 12 hours ago

> If people aren't bearing the risks (or rewards) for how they allocate resources, history shows they allocate them poorly.

That certainly sounds like it should be true. But are there any papers that can actually prove it?

cowlevel | 8 hours ago

Billionaires don't bear risks for their resource allocation. The worst they can do is lose their right to allocate resources, i.e. run out of billions and only have a normal person amount of money.

zombot | 10 hours ago

Except that his cloud is exclusively controlled by a billionaire and all profits g to to a billionaire.

pfannkuchen | 8 hours ago

I’m really confused when people talk like this. I don’t disagree that concentration of economic power to the degree that we have right now is concerning. But from a purely economic perspective I don’t understand how their “money” does much of anything to what is benefitting whom.

Most of billionaire wealth consists of assets. That isn’t money being stored as assets, assets can’t be turned into food or shelter, and the “money” that they represent doesn’t affect prices or resource allocation, except for in a first order sense (e.g. another person can’t own that particular stock for company X, or that particular land, etc).

But if we take “money” from them and “give it” to the government, from a 10,000 foot view that will just cause price inflation because their “money” isn’t currently competing for goods and services that other people use, but if the government uses their “money” to pay workers, then it would be competing for those things.

So I don’t understand it when people act like billionaires could just buy everyone food or medicine or whatever with their money, that would just cause price inflation because it would represent an injection of money into an area of the economy where it wasn’t previously. Is everybody just economically illiterate, or am I missing something?

cowlevel | 8 hours ago

The current economy treats stocks as a form of money. Following the convention maybe we could call them M5 or M6 money.

pfannkuchen | 7 hours ago

Sure I agree stocks are essentially money. This doesn’t change anything.

If you have a huge amount of money sitting idle in a bank account, and suddenly you start spending it all, this applies upward price pressure wherever you spend it, yes?

Confiscating “money” from people who weren’t going to “spend” it will just cause price inflation.

Confiscating money from people who were going to spend it (most taxes) mostly does not do this (except medicine, education, military companies and infrastructure companies) because the people who were going to spend it and the people who do spend it (after the first round of spending) mostly spend it in the same part of the economy (normal goods and services).

What am I missing here?

dns_snek | 2 hours ago

> Is everybody just economically illiterate, or am I missing something?

> “money” that they represent doesn’t affect prices or resource allocation,

Ownership of assets (primarily stocks) = private ownership of capital = private resource allocation = capitalism. To say that those assets don't affect resource allocation when they are resource allocation is absurd.

As we speak these assets are being allocated towards massive buildouts of data centers. Millions of people will spend billions of hours building them. On top of that, they're inflating the prices of everything else, like energy and electronics.

I'm not saying that these specific examples are necessarily a better use of those resources, but what if those people instead spent those billions of hours on, I don't know, building real world infrastructure? Housing? Solving world hunger? Implementing measures to prevent or reduce the damage caused by climate change to local communities?

nicoburns | 18 hours ago

> IMO his comments are blown way out of proportion

The context for people's reaction to this is that he has single-handedly caused the current spike in RAM prices.

gizmodo59 | 18 hours ago

How? Elon and Dario aren’t responsible? It’s all AI companies and hyper scalers. Let’s not forget how 3 companies in memory industry have got caught in colluding to keep things high.

nicoburns | 17 hours ago

Because he (on behalf of Open AI) made deals with 2 of the 3 major manufacturers of RAM to buy a significant proportion of their output, in the same week, without either of the manufacturers knowing that he was also making a deal with the other one. This directly led to the current RAM shortage.

mindwok | 17 hours ago

This problem is far bigger than one individual. He's making rational decisions is his capacity as CEO of an AI company. If he didn't make large compute deals, all his customers would be upset when they're hitting usage limits 10 times a day and all his investors would be doubting his decisions, especially when competitors are also trying to hoover up all the compute.

10111001 | 10 hours ago

> This problem is far bigger than one individual. He's making rational decisions is his capacity as CEO of an AI company.

That is called "Being greedy as fuck, as greedy as you can possibly get away with. Fuck everyone any anything else."

cowlevel | 8 hours ago

We live in an economic system designed around the assumption that everyone does this all the time.

cykros | 2 hours ago

The problem, if anything, is that the RAM companies aren't in this case. If they did, they'd get more profits which they could plow back into ramping up manufacturing and the shortage would be less acute.

It wouldn't be immediate of course. Ramping up RAM production does take some time; it's not flipping a switch. But this exclusivity deal almost definitely resulted in a situation where they are making below market returns to lock in guaranteed revenue rather than take their chances with a market that would absolutely pay up for more.

cykros | 2 hours ago

Honestly I'd not hold securing assets for his company against him.

Now, I'm curious if it was the best deal for the memory manufacturers in retrospect.

Sam's a shitty guy, but simply doing his job well isn't why.

gizmodo59 | 17 hours ago

Is there actual evidence that these deals caused the RAM shortage? Seems like a stretch to pin a global supply problem on one person when demand is coming from across the entire industry.

And if one person can indeed cause it then blame the system? I go back to the proven legal case of them fixing prices. Now there is just a scapegoat because it feel good?

anonymous908213 | 15 hours ago

The system shares some blame, but the individual is also the one exploiting a confluence of factors. Should the system prevent one person from purchasing 40% of global RAM production with fake money, yes, it should. But our systems are glacial to respond to edge cases they were not prepared for, and this is an extreme edge case - people who are not Sam Altman could not pull off purchasing 40% of the world's RAM production capacity on an IOU. Only a very few individuals in the world could have exploited this gap in the system, and the one who actually did deserves blame for it.

eptcyka | 18 hours ago

This is typically the best argument for using cloud - it is the environmentally beneficial thing to do. And yet, knowing what I know of spotify, I do believe that me serving my own music library is a tad less wasteful than most commercial music streaming operations are.

RAM in the cloud ends up being used by GitHub actions runners that fetch and install the world anytime a shmuck pushes a commit to his confobulator feature branch for the paper clip factory. Multi-cloud deployments of a service nobody asked for. Enterprise architects deploying a service mesh to deliver what can be done in 50MB of memory on a raspi. Running some vectors representing natural language through gigabytes of noise only made useful by some arcane math only to be unable to count letters in words.

I am sure there's also lots of actually efficient use of memory out there. But when enterprises are willing to burn cash, efficient processes or methods are nowhere to be found.

anonymous908213 | 18 hours ago

> he's clearly just talking economics

...just economics that benefit him. The economics of rental for consumers are horrific. It doesn't even have to be about an abstract sense of ownership and freedom, even if it's "just economics" this is still an insanely self-serving to say because he's talking about economics that benefit 00.01% at the expense of the other 99.99%.

usef- | 17 hours ago

It's not necessarily "at the expense of" if people want to use those products every day.

Imagine if we had a shortage of cars: your city only had 20% of its current vehicles. It would be accurate to say "in this global shortage, new cars are more efficiently used by groups/taxis/uber than sitting idle in an individuals home". A car used by a group share would allow more individuals in the city to have access to vehicle transport. If cars instead all went to individuals, only a privileged 20% would have transport.

There simply isn't enough ram in the world for every individual to do local inference right now: one person having a 512GB RAM system means others don't. Data centers can batch the processing and serve many, many more at once.

That's not to say individuals shouldn't have it! individuals can buy a 512GB mac right now. Or that it should go to Open AI. Your org or group could do the same batching (OpenAI is only a minority of compute, still). But saying "it's more efficiently used" is trivially true

Brian_K_White | 17 hours ago

This falls apart because of the simple fact that the people who had to contribute to create the pooled resource do not get to say how the pooled resource gets used.

This argument that only considers the one positive dimension of centralization and pooling is never valid.

usef- | 17 hours ago

What model are you suggesting that gives them more access/control?

Currently AI providers are hyper competitive and almost all of the world has access to it quite cheaply. If people had to buy hardware for local inference, it would only be a tiny percentage of the world's affluent tech enthusiasts with access to AI, wouldn't it?

We're currently managing the shortage with a hybrid model, where enthusiasts can still buy (more expensive) individual systems and the broader shared hardware goes to many providers. OpenAI is something like 15% of data center power in the US I think? That's a lot but we still have choice.

HWR_14 | 12 hours ago

I'm pretty sure you can find censored results in any AI model. That's probably the control that was being talked about.

8note | 18 hours ago

kinda bad economica though - the ai bubble eating all the RAM is bad for many industries worth of useful production, including the infrastructure that makes gaming and movie industries possible nowadays

agile-gift0262 | 18 hours ago

If we the people collectively owned "the cloud", then sure. But since we don't, I can only take it as him tryng to become a RAMlord seeking to extract rent from the rest of us

testing22321 | 18 hours ago

Economically speaking, I’m sure it would be better if all energy were routed to him directly.

Probably water too, even food, money and air.

Obviously better.

gobdovan | 17 hours ago

Esp. for ML inference he's right, and not just for RAM. I think this should be thought out seriously instead of mocked, or else open models and local inference won't be able to compete with big data centers with exclusive contracts with hyper scalers. There ought to be some sweetspot where one pooled server could serve 50-100 people, with let's say 25 doing concurrent inference and seeing good throughput.

If DeepSeek-sized models will be required in the future to get Opus 5.5 quality, they're not feasible to run for a single person. Pooling usage is necessary to make it efficient.

But even that is pretty painful to sustain efficiently with current hardware prices:

Concurrent requests 25

Aggregate generation 1,000–1,250 tokens/s

Model DeepSeek V4.1 Flash, 552B MoE

Active parameters during decoding 16B

Candidate hardware 4 × H200, 564 GB HBM

Continuous rental at $2.90/GPU-hour $8,352/month

Cost per registered user $84–167/month

Brian_K_White | 17 hours ago

The efficiency of centralization is not enough excuse to deny individual agency.

The argument for saying that ram is put to better use collected into central hands vs distributed among individuals is the same as for any and all other resources, and it's invalid.

Humans are not ants and should not aspire to the efficiency of ants at the expense of having to be ants.

You get some centralization, and you get some distribution, and it's completely invalid to be jealous of the portion of all resources that is in distribution.

This should indeed be "thought out seriously" and the result is either mockery or torches and daggers. Think that out seriously.

usef- | 17 hours ago

I think there's a divide here in people who hear the words "it's more efficient than" and are interpreting that statement on its own (it's a true statement), and people who are assuming the statement also implies "we should only give it to data centers" (which I don't think anyone agrees with)

gobdovan | 17 hours ago

You misinterpreted my comment. I'm advocating for a middle ground where we may pool hardware in small groups for attacking the hyperscaler moat, specifically for ML inference.

jimmyjazz14 | 17 hours ago

Yeah, Altman and the people in that world are utilitarians, which you would think they would have learned by now doesn't translate well to public conversation (or reality if we are being honest).

Alwayshasbeeb | 17 hours ago

Ah yes, I'm sure my RAM would be more economically useful if it were used to generate slop videos for Sora and inappropriate child content bty Grok rather than running VS Code and postman on my laptop.

ares623 | 16 hours ago

Nah. OpenAI themselves are wasting tons of RAM by doing frivolous stuff like providing ChatGPT for free for millions upon millions of people so they can ask what rocks go well with pizza. And wtf was Sora for.

No, if compute/memory was _that_ scarce that you begin thinking about what a waste it is that a decent chunk of it is sitting in people's homes, then why aren't you dedicating every atom of silicon that you already own to more productive efforts first.

mrheosuper | 12 hours ago

While his statement can somewhat be true, it's hard to accept from someone who has more money than he can reasonably spend.

port11 | 8 hours ago

The number of Altman apologists in this conversation is ridiculous.

The man who largely created a component shortage, is sitting on unused hardware, and is leading a company with extremely questionable ethics, well… he said some stupid stuff, didn’t he? He does that a lot.

Now, we can try to find angles to apologise for his behavior, or we can be upset and stop making apologies for billionaires, at least for the ones whose actions are more damaging than philanthropic.

Voultapher | 6 hours ago

From a global allocation perspective it's quite inefficient to allocate multiple kidneys inside Sam.

thefz | 6 hours ago

From a global allocation perspective some people have many houses, some have zero. Some have several cars. Some own lots of land, so much that they never stepped on every square meter of it. Some other men have many women... See how detached it sounds?

samrus | 4 hours ago

Yes but the layer beneath that is if ram is centralized then companies like openAI get to decide how they are used. Also centralization doesnt work for anything that needs low latency. Like gaming in third world countries with bad internet

The "you will own nothing and you will be happy" meme struck a chord for a reason. Billionaires want to create a power imbalance and screw regular people and we are jsut expected to be ok with it. Thats not ok. If these people hadnt done thing like made local governments sign NDAs about datacenter contruction, disenfranchising voters from their right to decide on the matter, then people would trust them more

Billionaires are a low trust people. Simple as. I dont want to rent ram from sam altman given the shit these people pull

cykros | 2 hours ago

Centrally planned communist economics.

I'd expect nothing less from the likes of this guy.

variety8675 | 18 hours ago

Seller of cloud inference warns you should not have your own local inference

nekusar | 18 hours ago

More like SCAM Altman.

Eliah_Lakhin | 17 hours ago

> Your country is not allowed to access this resource

Well, maybe the country where I currently stay in is not allowed to access this resource. But I don't see any connection of this message to me.