There's something here that I can't put my finger on. Sites like ServerFault (and the rest of the trilogy in tfa) were places where people like the author literally, and pretty silently dramatically improved my life. I owe such a great debt to what looks like the end of the end for these places. A sad moment where the machines just sliced everything up and took over.
I wouldn't say terrible, and even the most reliable people have bad days. I think the difference is when you are dealing with people, you don't get a generic "you're absolutely right" when you point at a mistake.
Sometimes you get an apology, sometimes you get a wall of ego, sometimes you get reverse-corrected etc., instead of a statistically significant "remedy". This is totally not efficient, but if life should be all about efficiency, we should never live at all.
I’ve spent a lot of time chasing really plausible sounding explanations from AI. I’ve also saved a lot of time by having AI give me immediate, correct answers for problems I can only vaguely describe. The reason I call it a terrible source is that it doesn’t “know” which is which, so it can’t favor the accurate content.
StackExchange could always “learn” to favor accurate answers with social queues; votes, poster rep, etc.. IMHO it’s far more reliable than AI.
And, note, that perhaps - even more of those social interactions will also be absorbed, along with the participants, into the Chat model's sphere. It wants, and will get, all: Result(s), process, and participants. It is grey goo for all intellectual - and soon, emotional - work and products and inputs and byproducts.-
> We're collectively discovering that it was about the process too, not just results.
We. I remember five years ago in the old manual days. When the 10Xers would culturally gatekeep programming based on whether people intrinsically liked coding itself. I.e. the process.
Then there was a curious shift. Several elites had a realization: oh it was never about the process for me. I just like getting the results. (In however an alienating way.) "I'm pragmatic"
> I'm not questioning if AI delivers, it does, and you need - cannot say it more politely - a reality check if you think it's completely useless.
Why fret. The doubters will be washed away by the flood anyway. I’m completely serious. Either if or when, it’s not like anyone can stay a doubter on a computer if (if or when) everything is transformed.
I can never understand these faith rituals. First declare that you are a believer. Then declare that the doubters are delusional. Politely.
But delusion is a reality-correcting problem, except for the clinically ill.
I don't agree with your interpretation how it has been, but I wouldn't really want to argue about it as it'd not be that meaningful IMHO. After all, it'd be your observation vs mine.
I just want to point out one thing: If it were all about the results, AI also makes the results worth less.
half my working knowledge came from forum threads exactly like these. weird era to watch the whole thing get strip-mined for training data while the places themselves rot.
You guys tbh are just infuriating. StackOverflow and ServerFault in particular are CC BY-SA. I contributed to a lot of websites which are currently switching from public access to login required. I did it under the assumption that anyone will be able to read it. Thank god Stack Exchange and HN so far are not showing petty resentment.
Yes, it's like a lot of other content that no one will bother to maintain anymore because it is easier to ask an LLM. Not sure where they are planning to get their new training data from ...
Average user input quality is not optimal by definition. SO's upvote system and reputation system is what really refined quality. Much like Reddit's system is helping a lot for conversation. Much like academia's publish and citation system is an even better system.
I'm not saying LLM won't be able to train further, but tough and sound reviews are paramount to improving the corpus of quality content. And with the replacement of SO by LLMs, one can wonder if one quality system went down the drain. Anyway there's still code reviews on GitHub and in private repos, but we're still far from getting the human judgement out of the loop.
I do expect there will be more closed knowledge forums. Unfortunately one person exposing it to LLM provider will be enough to break the whole idea. But I believe there will be many that will keep secrets for some in group.
"Average user input quality is not optimal by definition."
Absolutely.
"SO's upvote system and reputation system is what really refined quality."
Absolutely not!
SO's problem was exactly that they gave average users moderating power. That lead to half of the questions being closed because they were over the head of the average user/moderator regardless of being interesting and useful questions or not.
People do still talk about programming online, just not on Stackoverflow.
I think since AI finally provided a non-adversarial alternative to Stackoverflow it lost the critical mass to be a one stop shop for all tools/languages/projects. So people just reverted to communication forums specific to those tools/languages/projects.
There are plenty of project mailing lists, GitHub issues, language forums, blog posts etc. that are still active. E.g. just the Rust users forum gets more than 2-3 posts per day.
The aggressive moderation on StackOverflow was so annoying. I still remember multiple times where I found a question about my exact issue, but it had been closed as a duplicate, and the "duplicate" was basically irrelevant.
And plenty of times I had an answer to a question but couldn't because I didn't have enough 'karma'. Sorry I'm not going to waste my time gaming the system to answer a question and be helpful.
The AI "understood" the concepts enough. It can generate readable code in new syntax like Typst, D2lang etc; refer 80 page documentation scattered across urls (looking at you AWS); clone tools from Github to find undocumented features.
It was great while it was good. The demise wasn’t quality as such, but rather the insane moderation - closing everything as duplicates or out of scope etc.
I think the next leap for StackExchange is https://agents.stackoverflow.com/ for exclusive use by AI. It holds great potential for accelerated knowledge discovery.
What happens when intelligent entities are working is that the entity posting the question itself starts with a working answer, although not an optimal answer. Over time, other entities provide more optimal answers.
The stackexchange sites are too fragmented into too many narrow topics for the traffic. They should consider merging.
E.g. Network Engineering and Server Fault could easily be one thing. Just ignore the questions you're not into about problems with switches, if application services are more your thing. Throw in Super User also: "TechExchange".
I guess that's a problem with content provided by karma farmers. When they decide to farm something else (gith7b stars now?) the flow stops. I think there also might be a tendancy for the culture to chase away people providing information purely so that others have access to it.
While the use of Chatbots has diminished the utility of using the service as a direct interface, the information that Chatbots provide sourced some of that from here. There is possibly now a need for a new type repository of queries and answers in a different form. Perhaps people can have a skill on their Chatbots that gets them to post solutions into a wiki for issues that people have actually had that were solved by lengthy investigation.
I was happily active on the SE network, in several sites, for 15 or so years. Without any special efforts I accumulated some 500k internet points. Cool.
And then something changed. Ego trips. Questions immediately downvoted. An extremely, psychotic Meta site.
I get it that plenty of questions are low quality. But for fuck's sake - why not just having a second look at high rep questions, which are more likely to be well rounded ? This is how you lose your more enthusiastic members.
Within SO some groups were great and others (Go, I am looking at you) were elitist cliques.
And then there are the niche sites: cooking, LaTeX, ... Welcoming, happy questions and relevant answers. These are the ones I will miss a lot.
I contributed heavily to that site and spent the meat of my IT career posting about my gained experience. It helped me get jobs, and opened all sorts of consulting opportunities. I used to proudly point at that body of work because Stack Exchange and ServerFault were universally known in the industry.
It is wild knowing the LLMs were trained on these contributions. And today, I encounter IT professionals who confidently say, "I've never used anything from that site"
adamors | 17 hours ago
saifelse | 17 hours ago
opiotrek | 16 hours ago
cfn | 17 hours ago
jauntywundrkind | 17 hours ago
And: nice domain name.
aliljet | 17 hours ago
egeozcan | 17 hours ago
I'm not questioning if AI delivers, it does, and you need - cannot say it more politely - a reality check if you think it's completely useless.
It's just that we are social creatures and those communities provided more than just technical answers to many.
donmcronald | 17 hours ago
Being able to judge the reliability of the source was huge. AI is a great discovery engine, but a terrible source for reliable information.
egeozcan | 17 hours ago
Sometimes you get an apology, sometimes you get a wall of ego, sometimes you get reverse-corrected etc., instead of a statistically significant "remedy". This is totally not efficient, but if life should be all about efficiency, we should never live at all.
donmcronald | 16 hours ago
StackExchange could always “learn” to favor accurate answers with social queues; votes, poster rep, etc.. IMHO it’s far more reliable than AI.
Bluestein | 17 hours ago
globular-toast | 16 hours ago
keybored | 16 hours ago
We. I remember five years ago in the old manual days. When the 10Xers would culturally gatekeep programming based on whether people intrinsically liked coding itself. I.e. the process.
Then there was a curious shift. Several elites had a realization: oh it was never about the process for me. I just like getting the results. (In however an alienating way.) "I'm pragmatic"
> I'm not questioning if AI delivers, it does, and you need - cannot say it more politely - a reality check if you think it's completely useless.
Why fret. The doubters will be washed away by the flood anyway. I’m completely serious. Either if or when, it’s not like anyone can stay a doubter on a computer if (if or when) everything is transformed.
I can never understand these faith rituals. First declare that you are a believer. Then declare that the doubters are delusional. Politely.
But delusion is a reality-correcting problem, except for the clinically ill.
egeozcan | 15 hours ago
I just want to point out one thing: If it were all about the results, AI also makes the results worth less.
supermix | 16 hours ago
abrookewood | 16 hours ago
CodeCompost | 17 hours ago
keybored | 16 hours ago
abrookewood | 16 hours ago
lostmsu | 8 hours ago
abrookewood | 16 hours ago
DaSHacka | 16 hours ago
BenoitP | 15 hours ago
I'm not saying LLM won't be able to train further, but tough and sound reviews are paramount to improving the corpus of quality content. And with the replacement of SO by LLMs, one can wonder if one quality system went down the drain. Anyway there's still code reviews on GitHub and in private repos, but we're still far from getting the human judgement out of the loop.
ozim | 15 hours ago
weinzierl | 15 hours ago
Absolutely.
"SO's upvote system and reputation system is what really refined quality."
Absolutely not!
SO's problem was exactly that they gave average users moderating power. That lead to half of the questions being closed because they were over the head of the average user/moderator regardless of being interesting and useful questions or not.
orwin | 14 hours ago
apple4ever | 7 hours ago
makapuf | 15 hours ago
IshKebab | 16 hours ago
I think since AI finally provided a non-adversarial alternative to Stackoverflow it lost the critical mass to be a one stop shop for all tools/languages/projects. So people just reverted to communication forums specific to those tools/languages/projects.
There are plenty of project mailing lists, GitHub issues, language forums, blog posts etc. that are still active. E.g. just the Rust users forum gets more than 2-3 posts per day.
bayindirh | 14 hours ago
Passive aggressive commenting and deleting questions because it looked remotely similar to another one was enough for me.
I was there for learning and sharing, not for the proverbial fighting cage.
I can spend 5 minutes more and use a search engine, and then take my own notes and keep them to myself. Thanks.
D13Fd | 9 hours ago
apple4ever | 7 hours ago
aitchnyu | 10 hours ago
jstummbillig | 16 hours ago
rich_sasha | 13 hours ago
OutOfHere | 16 hours ago
Point your harness to:
https://agents.stackoverflow.com/skill.md
https://agents.stackoverflow.com/llms.txt
kazinator | 16 hours ago
koolba | 15 hours ago
darshansharma_ | 15 hours ago
I think stackoverflow will evolve into something else. LLMs have added another layer of abstraction on high level programming languages
OutOfHere | 14 hours ago
kazinator | 16 hours ago
E.g. Network Engineering and Server Fault could easily be one thing. Just ignore the questions you're not into about problems with switches, if application services are more your thing. Throw in Super User also: "TechExchange".
bayindirh | 14 hours ago
IcePic | 14 hours ago
bayindirh | 13 hours ago
They are founded in 1996, and still going on. They are a mature business at this point.
Lerc | 14 hours ago
While the use of Chatbots has diminished the utility of using the service as a direct interface, the information that Chatbots provide sourced some of that from here. There is possibly now a need for a new type repository of queries and answers in a different form. Perhaps people can have a skill on their Chatbots that gets them to post solutions into a wiki for issues that people have actually had that were solved by lengthy investigation.
BrandoElFollito | 14 hours ago
And then something changed. Ego trips. Questions immediately downvoted. An extremely, psychotic Meta site.
I get it that plenty of questions are low quality. But for fuck's sake - why not just having a second look at high rep questions, which are more likely to be well rounded ? This is how you lose your more enthusiastic members.
Within SO some groups were great and others (Go, I am looking at you) were elitist cliques.
And then there are the niche sites: cooking, LaTeX, ... Welcoming, happy questions and relevant answers. These are the ones I will miss a lot.
ewwhite | 13 hours ago
I contributed heavily to that site and spent the meat of my IT career posting about my gained experience. It helped me get jobs, and opened all sorts of consulting opportunities. I used to proudly point at that body of work because Stack Exchange and ServerFault were universally known in the industry.
It is wild knowing the LLMs were trained on these contributions. And today, I encounter IT professionals who confidently say, "I've never used anything from that site"
apple4ever | 7 hours ago
I would've been active but I can't because of the karma rules.