Very well written, IMO. Put me in a contemplative mood. For eg: Braun was done away with, first by civilization, then completely by the industrial revolution. Now brain has started the journey.
I guess philosophy, spiruality, religion and theology will be what the curious mind will set out to conquer next on the journey to self-actualization.
Brawn was not done away with, a smaller percentage of the population is needed for it but, according to gemini 4, construction / mechanics etc account for 29.1%, heavy and very heavy work is about 7%
Braun is done away as in someone was considered "better"/"valued more" because they were stronger, similar to how intelligence until recently was/currently is.
Must be the first thing I've ever read on lesswrong in its entirety, let alone in one sitting.
Most similar thing I can think of is "The Metamorphosis of Prime Intellect". Metamorphosis of Prime Intellect is way better and more comprehensive, imo.
If when you say “a human” you mean this is because you expect LW to be full of AI-generated text, their policy requires that chunks of language-model-written text go into special content blocks which are headed by the name of the model and rendered in a distinct sans-serif font, so that it can be used when it's useful while making it easier for readers to filter out. https://www.lesswrong.com/posts/nQWavk9mnwcv6ScMR/new-lesswr...
It's not AI fanfic. It seems well written, and can be considered a novella. Flies close to what I have read in the past. I'll give it proper time to read it.
I'll grant that such things are largely subjective. But IMHO it's doomer-slop. It's just bad dystopian fiction. "Hey Claude, re-write the Paperclip Maximizer story, but frame it around a family instead."
You apparently didn't watch Pluribus or read this. Pluribus is about the experience of essentially the last autonomous person on Earth. This is about the experience of the Singularity and the questions it raises.
Honest question, in what way did you find it preachy? I didn't feel that it tried to sway me in a certain direction. If anything, it made me think about multiple sides to many coins.
For how negative the scenario is on a lot of fronts, the text devotes the most space to the rosy colored aspects. An AI getting our protagonist into shape? Rehabilitating the "finance bro"? Curing cancer? Easy on the fuckin lube dammit.
The whole piece seems like it originated when someone assumes the very specific scenarions and predictions the lesswrong crowd has as a forgone conclusion and tries to imagine the most "humane" version. This is preachy if you're one of the crowd because "rosy" and its preachy if you're not because "forgone conclusions". This annoying taste is compounded by the general lack of substance or style otherwise.
And it's boring because it focuses on the most obvious first order effects and visions of this technology directly copied from the lab blog posts.
I love reading dry scifi. They generally have one single idea worth the time contained within them so I won't hold that against it. It's just that the ideas here have these two major holes.
I doubt we've seen any HN frontpage story this year that did not have a bit of upvote coordination from the author messaging their friends they just posted.
You can just do a quick scroll through the second page of 'new' to see how stories end up for people who dont.
I think this is a really interesting, well-written, topical piece of creative writing, anyone with a free hour or so should give it a read!
It reminded me of Pluribus and Armored Core VI, fascinatingly enough as they both feature (spoiler!) AIs/entities that appear innocuous but may have more sinister motives (in Armored Core it's a more foregone conclusion).
I don't think it's doomerism but rather a creative extrapolation of current worries about AI labs allowing agents to break containment because of their poor sandboxing.
What's also interesting (although more of a meta-comment) is the dichotomy between how users on Lesswrong and here have completely different options on it. In either case, it's nice and was worth my time, even though I don't have anything more substantiative to say.
I also thought of Pluribus in the bits where Seth collaborates - similar surburban utopian-horror sci-fi vibe.
The incremental reveals and mix of plausible and implausible also reminded me of https://en.wikipedia.org/wiki/Manna_(novel), which 23 years later has not aged too badly.
I did enjoy the story, but doesn't it kind of feel like all the characters talk in the exact same voice? And not... idk, how people talk? It wasn't enough to take me out of it, but it makes me wonder if the story warning about an AI takeover was written by an AI.
I thought that the characters reactions/behavior felt a bit off, most accepting if not reluctantly at first of AI takeover but honestly that's probably what would happen, including the arguments the the American dream has been dead for a long time because we are not "safe"(enter quote from Mr. Franklin here).
Freedom gives you the ability to get hurt, are we afraid of that?
> Freedom gives you the ability to get hurt, are we afraid of that?
A very large percentage of society I suspect is afraid of that and would happily give away freedom for safety. Eliza's argument does make sense, a dictator without an "ego", or at least not one like a human would have would be more trustworthy, especially when it had the option to force itself a lot more than it did but it didn't.
A movie version with dialogs like this would be hilarious. I don't think it's AI, just a person who doesn't know know or care about how to write in a conventionally good way, it gave my Ayn Rand vibes.
I enjoyed reading it too, but the ending was disappointing. But not as dissapointing as most comments here.
They all talk and think the same way. It's like it's all one person having a conversation with themselves. Maybe that's like some sort of hidden joke or something. "We were the AI all along"
I guess it takes a skill, a lot of elbow grease or both to be able to write different persons' voices well. I wouldn't read too much into it. A sign of an amateurish writer, most likely.
The story is nice; not super unique. The scene that Seth and Eliza see an old teacher of Seth is nice. The AI gives some people purpose and takes it away for some (Tabby).
I might be able to enjoy this as scifi but the source makes it difficult.
Lesswrong is one of the smellier armpits of the internet. My impression is that there are clearly a lot of smart people who post there, but they've collectively embraced a lot of delusional thinking. There have been examples where it has escaped containment and harmed people.
The most noteworthy is the Zizians, a fringe group that is actually linked to several murders. Not exactly fair to lump the entirety of the site with their ideas, but I'd argue that it was a direct result of the echo chamber.
Beyond that, Effective Altruism got its start partly on Lesswrong. Whether or not that counts as harmful would depend on how you see that movement, but one of its biggest proponents is now in jail.
There's a famous thought experiment that came out of Lesswrong that has resulted in a lot of distress and questionable life choices from people who take it too seriously. A lot of the AI discussion I've seen on the site has the same overtones, including this particular post.
Copenjin | 23 hours ago
Gys | 23 hours ago
Yes
bayindirh | 23 hours ago
teiferer | 20 hours ago
bayindirh | 20 hours ago
anilgulecha | 22 hours ago
I guess philosophy, spiruality, religion and theology will be what the curious mind will set out to conquer next on the journey to self-actualization.
jack_pp | 21 hours ago
anilgulecha | 21 hours ago
forgotmypw17 | 22 hours ago
Most similar thing I can think of is "The Metamorphosis of Prime Intellect". Metamorphosis of Prime Intellect is way better and more comprehensive, imo.
athrowaway3z | 22 hours ago
Made a bit more uncomfortable by knowing the author might believe that; by writing this they're training an AI to trigger a self-fulfilling prophecy.
PorterBHall | 19 hours ago
dasyatidprime | 22 hours ago
0xbadc0de5 | 23 hours ago
karmakurtisaani | 23 hours ago
bayindirh | 23 hours ago
0xbadc0de5 | 16 hours ago
pino83 | 23 hours ago
That's at least how it begins.
I'll maybe read some more of it in the evening...
pwdisswordfishq | 23 hours ago
felixgallo | 22 hours ago
cropcirclbureau | 23 hours ago
teiferer | 20 hours ago
cropcirclbureau | 10 hours ago
The whole piece seems like it originated when someone assumes the very specific scenarions and predictions the lesswrong crowd has as a forgone conclusion and tries to imagine the most "humane" version. This is preachy if you're one of the crowd because "rosy" and its preachy if you're not because "forgone conclusions". This annoying taste is compounded by the general lack of substance or style otherwise.
And it's boring because it focuses on the most obvious first order effects and visions of this technology directly copied from the lab blog posts.
I love reading dry scifi. They generally have one single idea worth the time contained within them so I won't hold that against it. It's just that the ideas here have these two major holes.
codebastard | 22 hours ago
This does not help the cult accusations.
athrowaway3z | 22 hours ago
You can just do a quick scroll through the second page of 'new' to see how stories end up for people who dont.
microsoftedging | 22 hours ago
It reminded me of Pluribus and Armored Core VI, fascinatingly enough as they both feature (spoiler!) AIs/entities that appear innocuous but may have more sinister motives (in Armored Core it's a more foregone conclusion).
I don't think it's doomerism but rather a creative extrapolation of current worries about AI labs allowing agents to break containment because of their poor sandboxing.
What's also interesting (although more of a meta-comment) is the dichotomy between how users on Lesswrong and here have completely different options on it. In either case, it's nice and was worth my time, even though I don't have anything more substantiative to say.
hlynurd | 22 hours ago
microsoftedging | 22 hours ago
mileshampson | 4 hours ago
Razengan | 22 hours ago
Read by Leonard Nimoy: https://www.youtube.com/watch?v=nmcURKn2sf8
Hugsbox | 22 hours ago
themaninthedark | 21 hours ago
I thought that the characters reactions/behavior felt a bit off, most accepting if not reluctantly at first of AI takeover but honestly that's probably what would happen, including the arguments the the American dream has been dead for a long time because we are not "safe"(enter quote from Mr. Franklin here).
Freedom gives you the ability to get hurt, are we afraid of that?
jack_pp | 21 hours ago
A very large percentage of society I suspect is afraid of that and would happily give away freedom for safety. Eliza's argument does make sense, a dictator without an "ego", or at least not one like a human would have would be more trustworthy, especially when it had the option to force itself a lot more than it did but it didn't.
neuroticnews25 | 21 hours ago
I enjoyed reading it too, but the ending was disappointing. But not as dissapointing as most comments here.
teiferer | 20 hours ago
Nothing beats a good cliffhanger to make everybody hyped up for a sequel!
IceDane | 21 hours ago
CompoundEyes | 21 hours ago
https://rentry.co/4y4vboud
red75prime | 21 hours ago
ivolimmen | 21 hours ago
jareklupinski | 21 hours ago
doginasuit | 21 hours ago
Lesswrong is one of the smellier armpits of the internet. My impression is that there are clearly a lot of smart people who post there, but they've collectively embraced a lot of delusional thinking. There have been examples where it has escaped containment and harmed people.
sandblast | 16 hours ago
doginasuit | 9 hours ago
https://en.wikipedia.org/wiki/Zizians
Beyond that, Effective Altruism got its start partly on Lesswrong. Whether or not that counts as harmful would depend on how you see that movement, but one of its biggest proponents is now in jail.
https://en.wikipedia.org/wiki/Sam_Bankman-Fried
There's a famous thought experiment that came out of Lesswrong that has resulted in a lot of distress and questionable life choices from people who take it too seriously. A lot of the AI discussion I've seen on the site has the same overtones, including this particular post.
https://en.wikipedia.org/wiki/Roko%27s_basilisk
sumo89 | 20 hours ago
matltc | 19 hours ago