A lukewarm defense of LLMs

15 points by Tygrak 20 hours ago on tildes | 9 comments

In a magical perfect world there'd be enough teachers to be able to pay enough attention to every student to make sure they are doing the work, but we are nowhere near that world.

My kid's school is bringing back handwritten essays and computer labs. You get your lab time to do research and what not, but you'll need to take notes and remember it in order to get it out in a coherent way.

This is much cheaper than buying every kid a Chromebook and then all the software to use it.

Edit: A completely seperate thought, but also don't want to make 5 top-level posts as they come up.

The amoral grounds one in particular is tricky, as I think a lot of the stuff they are doing is the culmination of many of our other moral problems. A talisman of so many other things wrong with society balled up in one, which will then also feed back into the other things that it leverages. Climate change being the single biggest problem. Without a hard demand for 110% capacity carbon-free power production being built onsite to power the datacenter and the community it was thrust upon, it's just undoing much of the progress that has been made. No, building onsite natural gas plants and buying carbon offsets does not count.

[OP] Tygrak | 20 hours ago

This is a blogpost (I guess? idk what to call it) that sort of tries to say that LLMs maybe aren't the worst thing ever created. If you are just tired of the infinite discourse about "ai", I completely understand not wanting to see anything more related to it, so to be honest just have a nice day and don't read it. I wrote it after arguing with people about LLMs too much online, which caused me to want to instead organize my thoughts about LLMs in some more productive way. It's probably way too long for the not very revolutionary points it brings. I am not a good writer, but I tried my best for quite a lot of hours to finish it, it probably still has a lot of issues but I could probably keep on rewriting it forever and maybe even just making it worse over time.

The article is as I said too long, but I feel like yapping about something related to this topic a bit more here, I am sorry. I sort of also thought that writing this article is something to do to make me feel like I did more for Timasomo than just make a Ludum Dare game in one weekend. And I am mentioning that because Ludum Dare also reminded me of being conflicted about LLMs too. Basically, the way LD is setup is that to get ratings on your own game you have to rate games other people made. That means I've been playing a lot of random games. Most games are basically the same as all the LDs I did before, some incredible, some... not so incredible. That is completely normal, and every LD I did was like that.

But then there were also a couple that were noticeably "ai" assisted. One didn't even bother to mention it anywhere, which just really annoyed me and made me refuse to play it. According to LD rules you should at minimum opt out of categories you didn't make by yourself, so if you didn't put substantial effort into making the art, or the music, you should opt out of the audio or graphics categories. But this person didn't care at all. And I just don't know what it is, is it that these people are actually just jackasses and always were jackasses? I've seen some people say that it really is "ai" itself that causes this. Anyway, that is alright, I saw 1 game fully slop vibed out with no respect for anyone out of many games, whatever.

The game that actually made me feel really conflicted is a game that I just played. It was honestly quite pretty, I liked quite a lot about it. It had a really good mood. The author of it disclosed that they used "ai" to create the engine for the game. I am ok with that. But where I started being confused is when I saw this middot character (this thing -> "·") in way too many places in the UI of the game. I feel like this thing is such an obvious tell of LLM written text and UIs. I feel like it's much more of a tell than for example em-dashes ever were, I definitely used to see some people use em-dashes normally even before LLMs were a thing. Meanwhile this middot thing I literally never saw anyone use in normal text, literally maybe like ever. Now it's everywhere in every vibecoded UI that exists. But the thing is that the UI and text in the game didn't really feel like stereotypical vibecoded stuff. But seeing that middot thing and also knowing that the author already disclosed they used LLMs elsewhere just made me start thinking about if other stuff might be LLM generated, or even just affected by LLMs. The only character in the game had a name that I feel like is basically what LLMs always pick by default as their very first choice when you ask them to suggest a name of a certain kind. Is it still perfectly plausible that the dev just picked that name? Yes it's definitely possible. In fact I think it's much more likely than that they asked a LLM to help them choose a name. But it just makes me really annoyed at myself that I am thinking about all this. I hate that I am by myself sort of going on this witch hunt in my head when I am playing this random game that I even feel like is one of the better ones I played in this game jam. The creator of the game really could have even used the middots, its not like it isn't a unicode character that exists for a long time, I am guessing someone even here on Tildes will tell me that they used to use it in normal text. And even if they did ask a LLM to help them pick out a name for a character, or even in general write the text, would it be that bad? I just don't know. I really don't know. I also don't really have any point where I am going with this.

blastedheath | 19 hours ago

Did you write this?

I enjoyed it quite a bit and the points all resonate with my own lived experience. I've sadly become the "AI guy" in most of my social circles since I work at a tech company and have heavily embraced LLMs because I have to in order to survive in my career field. Plus I'll be honest, its a new technology, and the reason I got into this field is because I like learning about and using new technology. I'm far from a fanboy of the dominant players in the space or the way these things are created & run. But also - that doesn't mean they're not an incredibly useful tool when applied correctly.

It seems impossible to have a nuanced conversation about this topic since the (objectively bad) side effects and ownership model of LLMs make people so emotional. I like how you laid out each emotional reaction and then responded to it in a thoughtful and pragmatic way.

Your Photoshop example resonates with me. We've seen these immorally created tools used to immoral ends, but they don't have to be. Hopefully going forward we'll start to see the pendulum swing towards these tools empowering people to throw off the power structures that led to their immoral creation in the first place.

RoyalHenOil | 19 hours ago

I'm a frequent user of em dashes (as well as semicolons, etc.), and I've never used that dot symbol. I've rarely ever even seen it used, to the extent that I didn't recognize it at first and wondered if you were talking about bullet points. But then I remembered that Word uses that dot to represent spaces when you set it to markdown mode.

I wonder why LLMs like to latch onto certain obscure things so much.

Part of my day job involves editing text written by SMEs. Recently, some of the SMEs I work with have started using LLMs to help write the text, and I can very easily tell which parts the LLMs have written and which parts they wrote themselves. I still have to heavily edit both kinds of text; I'm just correcting different problems — more typos and grammatical errors with the human text (quick and easy to spot and fix), more structural issues with the generated text (more challenging to fix, especially since I'm not an expert on the subject matter myself). I hope it saves them time, because it sure doesn't save me any.

I've been using LLMs to help me edit, and I've found they also do much better editing human-written text than LLM-generated text. With editing human text, an LLM can halve the time it takes me to get through the work, but with editing LLM text, I can't tell that there's any time savings to be had. LLMs mostly don't notice the issues I'm seeing, and I have to hand-hold them through the process.

Ironically I had to use AI to understand what you were talking about. You used the acronym SME which is not common outside of your trade, and acronyms are famously difficult to figure out because anyone can use the same letters to represent anything. When I searched the most common meaning was Small to Medium Enterprise. Siri AI told me it was Subject Matter Experts. Is it right? Maybe not, but it makes a heck of a lot more sense.

Subject Matter Expert is correct

For future reference, acronymfinder.com is still a perfectly cromulent way to find information without invoking a few hundred billion artificial neurons. The top results were "Sony Music Entertainment", "Small and Medium Enterprises", and "Subject Matter Expert".

(edit) I've also heard the term in a couple other fields, so maybe it's moreso a regional thing? Although IIRC RoyalHenOil and I are about as physically distant as is reasonable on this continent.

I use middots all the time in web design. I've always loved them as separator characters over pipes or hyphens. They feel much cleaner — almost elegant.

I've never seen an LLM use one before, though, and I don't even know how you'd use them in conversational text. I consider the middot a typographic tool, not a grammatical one.

Landhund | 2 hours ago

I hope I interpret your "I feel like yapping about something related to this topic a bit more here" correctly as an invitation for well meaning discussion. If not, please don't pressured to respond (even though I hope do :) ).

Originally I planned to comment on most if not all of your points, but seeing as that would end up probably being almost as long as your blog post, I'll only comment on the first point.
But I want to assure you that I have read the entire post, spent plenty of time thinking about it and I very much appreciate you sharing your thoughts with us :)

Also, I hope I got this to sound as well meaning and in good faith as it is meant, but I wrote this to avoid having to deal with an annoying client, so hopefully no hostility that truly wasn't meant for you hasn't bled through.

With that out of the way, here are my thoughts… (on only the very first chapter)

These companies literally stole the whole of internet and more. [...] If a normal person tried to steal this much shit they'd get jailed immediately.

My issue here is, people do get away with it? I just had a cursory look at r/datahoarder (simply because that’s the first places that came to mind), and the 4th highest post this year is a link to 300TB of scraped Spotify content. Also, the entire existence of Anna’s Archive and similar websites. And that’s just actually pirated content. Please don’t misunderstand me, I am in no way excusing those companies using pirated media/content, merely questioning whether what they are doing is actually unprecedented.

Which brings me to my next point: how does one steal the internet, specifically regarding all the public content? Because, well, it’s public, it’s openly available for anyone to see. Nobody needs my permission to take this comment or my own (very poorly written and not well maintained) blog and do whatever they want with it, except republish it. You could do a study looking at all the personal blogs out there, analysing the way they set up their footers or how they structure their links, etc., without needing their permission. Or I could go to the train station in my city with a clipboard and marking all the colors of all the jackets I see in order to… design a new jacket, I guess? That one kinda got away from me. Anyway, my point is, if something is publicly available, you don’t need permission to analyse it. If Google is allowed to scan books in order to index them and display snippets of them, I don’t see how scraping all of Reddit in order to analyse how people write is somehow not ok.

Another point I highly disagree with, is this:

its clear that these companies are building way too many data centers, way too fast [...] to meet some magical future hypothetical demand that just doesn't currently exist.

Funnily enough, I talked about this exact point with a close friend of mine just yesterday. Because the demand very clearly exists, right this moment. It’s why so many AI-Startups just die because of ever rising token costs. We are in a truly massive supply shortage of raw compute. Because LLMs effectively made raw computational power useful for any task that involves a computer of any kind. That’s why I truly don’t understand how the “AI Bubble” is supposed to burst. Because those datacenters will still be there. Because raw compute is now valuable. Because even if all those big evil AI companies (again not saying they aren’t evil, just that it doesn’t matter for this argument) go belly up tomorrow, open weight models will still be out there. GPUs and probably even specialized tensor processors will still be produced. Meaning that nothing is stopping anyone with some money to spare to keep tinkering with those models, trying to improve them, making them more efficient or better at specific tasks. Nothing is stopping my friend from using his newly bought 64GB RAM mini-PC to run 20T open weight models at 10 tokens per second for a week to see if it can spit out some digital prototype for his next new idea.
Yes, I agree that the current pace with which the big AI companies run through their money in order to train ever bigger models is definitely not sustainable. But it doesn’t need to be. Open weight models that I could run on my 5070 right now are already way beyond any threshold where I could see LLMs simply disappearing into obscurity. Deepseek and the like have continuously proven that what is currently only possible with the most bleeding edge of proprietary models is not even a year away from being the mere baseline that any open weight model has to be able to provide.