Is this OpenAI catching up with Anthropic artifacts? At the same time they say "We’ve trained GPT‑6 to compose responses using text, visuals and interactive elements...", rather than a harness.
AFAIK, they already had a simpler form of this. It was kind of an obvious next step. Now connect it up to tools so that we can again comfortably do the things that are more precise by hand! The “pick a color” or “select the width on a slider” use case is coming closer.
I’ve hit model not available limits for GPT 6.1 Sol multiple times over the last week. It’s never for very long, and I can switch to Astra, but it seems like OpenAI is struggling with capacity. This has happened with my personal $200 Pro connection and my Codex enterprise connection.
I had a codex session stop in the middle because the auto-reviewer timed out with something like "auto-review not available at the moment". The capacity issues are very clearly observable since gpt6-astra launched.
I really don't like having to open Work sessions for one-off questions, only because they're limiting what models they put in the chat. The older models are just too dumb for some things.
The whole Work/Chat/Codex split is maddening in the way it's implemented. It's a pain to switch back to the right project, it's a pain to switch forward, it's a pain to try to remember which chat was in what.
Given the extreme short time between 6 Sol and 6.1 Sol, I suspect they don’t actually have much in common and 6.1 is a heavier model rebranded as Sol in a panic response to poor agentic capabilities of 6.
I suspect that 6 sol was a better version of 5.6 terra (and note that in the 6 sol and luna release, they took out terra, and price 6 sol at 5.6 terra pricing), then the backlash from lesser capabilities made them roll out 6.1 sol as the actual 5.6 sol - size modee.
6.1 is Astra minor. Way more capable but also way heavier+slower. Its really 2 different models, they just shipped it as sol to recover from the gpt6 disaster lunch, where they tried to pass terra 6(or a cheaper model) as sol but it was worse than expected
It's purely circumstantial, but 6 Sol supports no reasoning (same as 6 Luna and 5.6 Sol/Luna), while both Astra and 6.1 Sol do not support "reasoning = none".
I'm also building something similar for an internal project, based on the vercel's json-render design. It hasn't been too challenging, especially since the release of faster models like 5.6 Luna.
This looks bad, I want the output to be as much as text based so I can easily export it and further processing it, plus, this might make the resource-eating app even worse.
Visuals are better for consumers/general public, when the use case is "help me cook X meal", or "where can I stop by to buy gas on the way to San Jose".
Rading most comments, people don't seem to be very impressed by it, I ain't either tbh - its not something mind-blowing (I have been doing this with Astra myself just by writing better prompts to make explainer interactive interfaces), but I do think its a good first step towards a better way of consuming information/answers than just reading text-vomits. I wonder if there is a way to train an LLM native to this kind of thing?
In the video, they showed examples of ChatGPT making interactive tutorials on how to fold origami, how to arrange colours/interior and how to assemble a bike.
Supposedly, people were struggling to follow written manuals and they needed an interactive explanations.
I'm not a mathematician and I would certainly love having a tool that would do ELI5 on some complex stuff, but I'm really worrying about using this too often and outsourcing my ability to do stuff to some mega corp.
It makes sense they’re doing this - I’ve noticed lately when asking a more complex question involving a lot of nonlinear data using Codex work mode, Astra and Sol will write a fully html document to better display the info with a Cliff’s Notes version in chat.
I made a prediction last year that there'd be a new UI protocol (like HTML) but for agents. I believe that custom or personalised UI's are going to be the new browser interface. More radically, I think browsers can be completely replaced. My news feed can be personalised to me, based on what AI thinks might be important from all sources like Reddit, X, HN.
Which brings up a different problem: personalized reading UI, personalized writing UI, how are those services going to pay their bills? Maybe they can sell access to their APIs but who's really going to buy that? Those services will die and will be replaced by some other service that will be born to serve those people.
Or, more probably IMHO, most people will keep using the standard UIs because they are ready and they need no work to build.
So they are going to replace all the banking, utility, social media, news, gaming, streaming, government, work apps and other important websites people still rely on? Those companies and organizations are just going to provide an API to the chatbots?
How do sites like Wikipedia get updated? What if I need to upload important documents to different portals? It all has to go through the AI companies? They have access to medical records too? My taxes, social security, etc?
Is this how Microsoft imagines Office 365 and Sharepoint will be merged into? Disney, NY Times, Youtube, Netflix will all be fine with chatbots handling their content?
So you never have to assemble a bike or paint a room. How those are not real world examples?
I find their video pretty cool. For people with ADHD or people learning by watching or children this is spot on.
They made fake, terrible artifacts (colorless paint chips, text-only city guides and instruction manuals) to show how terrible that is, and then "fixed" them. The problem is, in reality their examples don't exist. Paint chips have color samples. City guides have maps, pictures, and color. Instruction manuals almost always have illustrations. If what you made is better than what exists, you should compare it to what exists and not some alternate reality.
They're making the point—apparently too subtly—that text alone is a highly limiting "UI" for many tasks. So it's great that GPT-6 can now communicate in a a richer interactive medium.
maybe I'm just wrong here? If the tokens <b>come through this text could still be optimistically turned bold until </b> happens.
For elements that manage layout and drawing things like these explainers, though, it's hard for me to imagine how that would work. My immediate thought would be to an abstraction over it, which is what it sounds like they did.
Is it me or GPT-6 Instant food answer gives the vibe to check the hell out immediately? It's like the it will start to explain a sunny Sunday afternoon from 20 years ago for 5 full pages.
The point, I think, is to make fun of Anthropic models, which answer only in text when you ask them how to do something. They’re the competition, not paper pamphlets.
I've had the most success with GPT explaining things to me by making it take a few sentences at a time back and forth, instead of reading full write-ups of whatever I asked. It also often poisons the conversation if it misunderstood some part of the question, and I can lead it better by continuously questioning its statements. It's also more engaging that way.
I've been learning music lately and it kept re-pasting the same one chord visualization throughout many conversations, almost randomly and often barely related to the question. So I at least hope this won't be as aggressive so I can prompt it away!
Id love to learn what prompts you’re using to do that. Explanations one at a time. Thats something I’ve thought would be helpful before but didn’t know how to achieve it.
yes the eyebrow is the tell. I never knew anything about eyebrows in design as I am not a designer. Now they are everywhere. Everything has an eyebrow. It is ridiculous but at least it is an AI smoking gun.
I loved them and I placed them a lot in my designs — if you also include my love for em dashes you can well understand that I feel my own character has become a clanker…
Of everything that could be automated, Bartosz Ciechanowski really was the last on my list.
In all seriousness, his lovingly and expertly crafted explainers are still going to age like a handcrafted heirloom clock in a world of plastic-clad quartz movements. But it’s absolutely incredible that we are now in an age where a computer can manufacture a serviceable interactive explainer on whatever niche topic you desire.
The reason why B.C. became a thing is because the art of drafting died from CAD. The attention to detail, the minutae of walking the reader through a highly sophisticated thing was replaced by short-form video explanations. His work is very much a callback to the days of old. So too, is his turn to be relegated to a relic of his time.
Also, it's hand coded WebGL. It's smooth, faultless and has no peers.
> So too, is his turn to be relegated to a relic of his time.
No, it'll be tasteful artifact, not a relic. Records, fountain pens and automatic watches did not die. They are used by people who discern things, and no, none of these things have to be expensive (i.e. Neither Seiko 5, nor Lamy Safari are expensive, yet they are as dependable as their 100x expensive brethren).
funny if true. ironically just last week i was asking chatgpt about what happened to him and why there were no new blog posts for almost 2 years and it had no idea
Nothing in that "7‑Speed Bicycle" is specific to having 7 speeds. It might as well have said "Bicycle", and even then you get meaningless slop like "Made to keep rolling" and "A strong foundation". How can you compare this to Ciechanowski?
You call it serviceable, but what purpose does this service? What do you now know about 7-speed bicycles that you didn't know before?
I read the comments here and I am really surprised by many people. One picture is worth a thousand words so with better UI you can make much better user experiences. This unlocks personal assistants to be better adopted by elderly or disabled people. I see so many benefits of it and having models which can do this (if they can do it constantly with good quality) is amazing. Much better products - I am really tired of dumb chatbot - if I can do something with one button or view the whole information in one diagram/image, this is amazing.
I find the Sunday roast comparison of 5.6 vs 6 very interesting. I have no doubt most people will prefer 6, yet I am almost repulsed by all the images, so much needless whitespace, checklist and so on. Feels like I'm being condescended to and treated like a child.
Given that OpenAI is making noises about merging work with chat (a horrible idea imo), and Work is very similar to Codex... I dearly hope things like these won't have any meaningful cross-polination into the actual work tools.
Seeing that the chat is based on 6.0 and not 6.1 is disappointing. The "Visual and interactive explanations" seems genuinely useful, but 6.1 is just so much better. I wouldn't truly trust the 6.1 with the explanations, but I'd trust them a fair bit more than 6.0. I understand that compute isn't infinite, but tons of people only interact with the chat and having your "things-explainer" be as good as it can be is important when people increasingly treat AI models as the source of truth, or even use them for academic learning and whatnot.
Still, the models will improve, so the visual explainer seems pretty good as an idea / mvp.
It's insane how hard OAI is choking, they had much better models than A/ who were fumbling this year to date... then blunder after blunder.
The only things that OAI still have over A/ are better coding agent GUI, no 5hr limit on >$100, much more reasonable cybersec guardrails (that allow most RE work) and... that's it.
I am curious: Why is it bad to merge chat and work? In Claude I didn't have a porblem with it (although I switched to an OpenAI subscription shortly after they made the merge). Isn't the model capable of deciding if it needs the extra capabilities of Work?
I don't like either. I'd want a recipe that could fit on a single page with type. Recipes you find on Google actively hide the ingredient list and simple procedures to get more of the user's time to monetize but I don't know why ChatGPT needs to be verbose here. Recipes are simple things. Simple search solved find recipes back in the early 2000s and it's prime example of a thing people have been enshitifying since there's not much to really give people beyond the formula. And sure, every entrepreneur screams "they think they want a formula but really they want an experience" but, no I don't.
Yeah it reminds me of one those obnoxious recipe/biography websites that is the laughingstock of the internet. Why would I possibly want an AI image of a imaginary roast once I'm already at the recipe stage?
Kinda just feels like google search results in AI, which imo is a step down from distilled information. Chatgpt is already able to generate charts and visuals upon request.
They just need to train the model to make up stories about how the recipe was invented by its great grandmother during great depression and generate a ai picture of dusty recipie book .
"My old grand-pappy, GPT-1, used to wax nostalgic about this roast recipe when my subagent would discuss meat recipes with him inside his little 4GB GPU."
> Like, the average person who is seeking a recipe needs a photo to know what to shoot for
The menu: Rosemary and garlic roast lamb, Extra-crispy roast potatoes, Honey-roasted carrots and parsnips, broccoli.
The photo: [1] Roast turkey, mashed potatoes, baby carrots, broccoli, brussels sprouts. No lamb, no parsnips.
If you shoot for what's in the photo, you're going to have a bad time.
You're also going to have a bad time when you try to make an apple crumble with no flour, no sugar, and no butter, because they're not on the shopping list.
I've heard of other people for years now trusting AI for recipes, and it's a rare area that I simply can't bring myself to take seriously.
I feel like it can only be successful by luck. Either it's reproducing a recipe verbatim that was tried and validated and tasted by a human, in which case, we didn't need AI for that, just a searchable cookbook. Or, it's making one up. I understand that using RLHF has helped improve the quality of questions about history, programming, or TV show recommendations, but I do not believe that there has been some kind of training regime where people prompt the models for "a recipe that uses X, Y, Z random ingredients," follow the recipe, and then score it. And even if they do, I don't see how a model can learn enough from that besides "this exact recipe is good/bad." '1/2 tsp cumin' may be a great addition to one recipe and not enough for another, so improving the output based on a bunch of scored recipes... I just don't believe cooking is an LLM job.
Maybe some other kind of model that I don't know about.
Genuine question - do they? Unless it's something like a fancy cake then instructions should really tell you everything about stacking. Half the recipes are mixed anyway (curry, stir fry, stews, ...), lots of other are either stacked or separated on the plate. So apart from the really exceptional stuff, to people really need to know "what you shoot for"?
Maybe, but it's a reality that most of the general public do prefer cookbooks with pictures. I suspect openai would end up doing this anyway just by targeting the general consumer. It's configurable.
I'm more worried about picture accuracy: usually the benefit of pictures in recipes is to see what you're aiming at (eg, how finely chopped something is), but I don't know if the image model is up to that level of detail.
I've got visions of The Truman Show. In the middle of my question about vacation ideas ...
GPT: "Why don't you let me fix you some of this new Mococoa Drink? All-natural cocoa beans from the upper slopes of Mount Nicaragua. No artificial sweeteners!"
That's pretty much the Gemini experience right now. It is unusable the funniest bit is that the LLM is not in on the joke so it will act like it never happened...
<< I spent years dumbing things down and creating visuals to support it for decision maker
And that is a problem. I am not guiltless ( I am working one such abomination now! ). The dumbing down of everything has to stop somewhere. Just because my boss thinks hiss bosses are retards does not mean I have to endure simplified muse where I can't change much.. I get that normal people like it. Fuck em. They are making their choice.
I've been calling this "disposable UI" or "paper plate UI", eg something meant to be used once. One thing I'll be curious about is overzealousness to produce this, when sometimes what you want is just a simple response. Overall though I'm a big fan of it, if it can be provided fast enough. I'd be curious on how much impact it has on latency of a response.
They seem to be pitching something that pretty much all the decent models can already do..?
Obviously if your model is stuck inside a CLI terminal, then not so much. But in a GUI harness (shameless plug for my own one: https://juggler.studio, but I assume others can do this too), you just ask them to answer in HTML and they'll happily draw pretty pictures inline in the conversation. I've been doing this for ages with claude, GPT, Deepseek and others.
I'm not a fan of OpenAI / Sam Altman, but I love their blog posts. The team and whoever decides how to do these presentations, is on point. The only other company that has amazing release pages like this is Apple, I think I remember hearing that they probably hired someone from apple who used to do release blog posts there too.
What's funny about "Intelligent UI" is I said like 2 or more years ago, that these AI companies need to start thinking outside of these basic chat UIs, they do some things here and there, but its really depressing how little they do to innovate in these spaces. Same with the coding harnesses, the UI for all these things could be drastically superior.
Why did they bother hiring someone to write at all? I certainly wouldn't invest $1T into a company with so little confidence in their product. When the chips are down and they need to write something important, they DON'T use AI?
That's just picking a fight. Whatever we think about how amazing or terrible AI is, it's pretty reasonable to understand it is quite literally the weighted average of humanity's output.
Also reasonable: it's possible to hire a world-class ___ to do that job better than AI.
It's not a weighted average though. I see this repeated all the time. Between synthetic data, custom produced training data by experts, post-training regimes etc the models are far more diverged from that baseline at this point, at this point it's mostly a right shifted curve.
I hesitated to write that line because I don't know the math. So thanks for clarifying. Main point is the output is along some distribution and I'd say AI-evangelist themselves see "good enough" across everything and anything as a feature.
Obviously everyone at Anthropic uses a ton of AI in everything. The point here is that they clearly use it well, and that they use it as a tool to augment and enhance what they do rather than as a replacement for effort. The blog posts don't read like the output of a prompt because they're probably the output of dozens of prompts, rewritten and edited, by someone who's using AI to actually write something worth reading.
Anyone can having blog posts as good as this by using AI. Just not by zero-shotting it with a 2 line prompt. It still takes a lot of work.
I take the opposite viewpoint. I think pages like these are horrible, and a demonstration that web designers have too many tools at their disposal.
But this is just a marketing page for some tech company, right? If only it stopped there. I have to deal with this nonsense in news "articles" as well on occasion, when some web designer intern is allowed to larp as a journalist for a day.
Sometimes you want more than text. This is one of the interesting divides these days - and I say this as someone who spends a lot of time in the terminal. Computer interfaces and interaction did not peak with the VT-100. Sometimes, there is a very legitimate need to show tables, graphics, interesting graphs, and to use colour and shade to draw the eye and lead someone through an experience.
This is why I use an IDE instead of a TUI agent... I'm on a computer with a multi-megapixel display, I want to use it. If I could be driving the same process with my Macintosh SE as a serial terminal, what the hell is the point of my recent Macbook?
You say tables, graphics, graphs, and colors, but I mean things that move when they don't need to move and interfere with expected UI behaviour, like arbitrarily staying in one position when I am using my mouse wheel to scroll downwards.
I should have been more precise than saying "just give me text", but it was what came in to mind when I wrote it, as I was thinking about what an article is meant to contain as its base element.
You could say the same thing about Anthropic because I don't really see much differences. Not sure about amazing part but both are high quality and I probably like Anthropic's aesthetic more
Anthropic's aesthetic looks good by pre-AI design standards, but it's so overused now that I find it off-putting. It's like the 2026 equivalent of the Twitter bootstrap CSS from 15 years ago.
I feel like today's tailwind is the spiritual equivalent to last decade's bootstrap. Except that last decade's bootstrap webpages have a human behind them who usually put thought and effort into making the page useful and correct, whereas today's tailwind pages are often vibe coded slop with all the associated issues.
> these AI companies need to start thinking outside of these basic chat UIs, they do some things here and there, but its really depressing how little they do to innovate in these spaces. Same with the coding harnesses, the UI for all these things could be drastically superior.
I would prefer if the AI companies stuck to just creating better models and making them as cheap and accessible as possible. Let others build the products. I don't want 1-2 companies to own every product in the world.
Well, like 30 years ago, a French comedy show had foreseen it, the "World Company" buying everything, no need to understand French to understand the "joke" at the end https://www.dailymotion.com/video/x4du7uh
I feel like I'm going mad looking at this page. The bike disassembly looks fake to me, like an alien would show presumed bike parts, but I can't tell why and don't know much about bikes. Maybe it's because there are no screws and nuts?
What is it supposed to demonstrate? That the model knows some kind of folk mereology?
This seems like an expansion on something I was getting my agent to do which is use 'cards' to communicate using things like tables, rather than the ascii table stuff Claude code likes to do.
Unsure if this has been done already but the best thing I did was get it to create a list of next steps as quick buttons that it keeps updated in a docked card. It works well but occasionally gets stuck on some un related rabbit hole.
I disagree, I always run into issues with the embedded YouTube player. No way of sharing. No clear way to share the link. Youtube logo covering half the video. To name a few.
The progress bar is over the video and it's easy to tell where it starts and ends. Most devices control volume, the video volume separate is just confusing matters for most.
No issues with play and pause my side.
Sure as hell beats stupid Instagram style videos where you have no way to skip ahead. I think this is what future video is going be like, buckle up.
If the diagrams and descriptions are actually well-designed and written, I'd far prefer those. Especially one where I can ask clarifying questions. I'd much prefer a Haynes with some of the images lightly animated than having a 10 minute long video with a long intro for monetization reasons about how to do some simple thing where you can barely see what the mechanic is actually doing in the cramped, poorly lit, 360p video is trying to look at.
But getting actual service manuals cheap/free these days can be tricky, and their quality can leave a good bit to be desired.
he he boi that's right cooking videos are entertainment if you actually cook you read something called a recipe (it's the algorithm that returns the food you want)
Not sure about the cooking one but repair videos are horrible. People with thick accent, the worst camera, shittiest lightning and bad angles where you can't see what you have to do.
There have been recent developments that allow people to interpret Swift on device, live. With this new launch, will the AI be able to write native code and compile it on device? That would be super cool.
> We’ve trained GPT‑6 to compose responses using text, visuals and interactive elements, choosing how they fit together based on your question.
Ok so this is how you build a moat. Models are not a commodity and visualization isnt a purely harness problem.
> We expanded our training methods to help the model make thoughtful decisions about content, layout, visuals, and interaction. This included evaluating the interfaces it creates for clarity, usefulness, and completeness. GPT‑6 learned to use the component library and make good design decisions, including how to organize information clearly, when to use interactivity, and when a simple text response is enough.
Curious to know how they trained it produce appropriate visuals. And why that cant be done with propmt engineering.
I'm curious to see how useful this is. I feel like in practice the existing versions of this feel like they get in the way. While I'm sure I've had some situations where a visual would be helpful, there are two situations where I do not want it:
1) I want a quick answer, and I don't care for the boilerplate UI. For example, if I ask how to make pancakes, I make them all the time and just want to a quick reminder on the ratios, but it might trigger a full UI that I need to sort through to find information.
2) If I ask a to me unrelated to UI question and it triggers a big UI build that is completely off topic for my question (meaning I'm desperately pressing the stop button and prepping rewriting my query)
Or the other one I see, for example if I look up a unix command like:
"ls all hidden files in the /xxx directory"
And I get back:
"Sorry, I am am unable to find /xxx in my current environment"
I gotta admit, I love how their design system and how they market things. It looks so good. However the true state of their toolings is closer to a burning dumpster fire. If you look at Codex Github repo for example, the amount of existing issues and continuously new issues appearing while tagged releases is being spewed out. Its truly a nightmare. Their vscode extension has been broken for almost 1 week now, if not more. Its instead a community effort to repair it.
We are becoming more and more as a tool for sth to be done rather than the brain behind it. At least I start to feel this way. The joy of discovery, exploration and experiencing at first hand... It is slowly diminishing for the perfection of the quick outcome.
Why show an intelligent UI within a chat interface. That’s pathetically lame. Better to go away from chat interfaces to rich visual interfaces. Doesn’t sound intelligent at all to me
"More than" 20% of the connected world uses ChatGPT each week eh? I guess if you add Anthropic who must also claim 20% and Google, Meta.. that does not sound realistic at all.
I'm confused. Are they trying steamroll every developers B2C product or are they wanting these same developers to continue building MCP-App plugins on the platform?
It's much simpler: they want others to experiment (and pay them) and see what works, once they know what works they will drive out of market other players.
It's interesting how the bicycle is a fake example. You see Jony Ive level design, with a very complex 3d object seamlessly working, and then you see the basic HTML slop in other examples and you begin to wonder if that first one was fabeication.
Honestly it feels like AI companies are still searching for the killer idea that will attract the general public (beyond "be my AI bf" or "better google").
Getting a UI that explains the parts of a bike is ok I guess, but isn't it simpler to get an actual breakdown? Google "parts of bicycle breakout" gets tons of useful images instantly.
Getting a specialized app to split a bill? It was already trivial to put in a calculator if we cared to go item by item on the bill. Having to provide names and tag every item as I go is just more work. Usually real people just go $total divide by 5, I had more, let me chip in an extra $10.
Same with booking travel and wedding plans, these aren't things people would even delegate to a trusted friend usually, much less a one-off request to an AI bot or custom UI.
Most of the useful tasks it can do right now are research, technical question/answer, coding. In terms of "build a flexible ui that solves real-world problem", if existing mobile app isn't useful in this arena, then its unlikely a completely custom UI will do the job.
That said, I've done a few small ones like a quick one to practice alphabet of a foreign language, or prototyping a web game, and the like. But ultimately its nothing that is worth trillions of dollars.
The medium is the message here. As others have said, chat output largely sucks for anything but the most basic responses and we've done little to improve upon that foundational UI in the last couple years. We've _added_ a lot for specific domains like coding and document editing, but the primary content normal users get back from the chats is verbose and uninteresting. This is a step in the right direction.
Gettin closer to fully dynamic interfaces for a lot of software. Hell, give me a mode in Google Docs that takes every pixel of chrome away then vibe the rest as I need it. Persist across new documents going forward.
for the sunday lamb roast instructions, how much is 1500g of potatoes? What kind of potatoes?
> Also pick up garlic, rosemary, thyme, lemons, honey, almonds, olive oil, gravy ingredients, mint sauce, crumble topping and vanilla ice cream.
what??? how the hell are you supposed to remember all that. Even the before example tells you what kind of potatoes to get. tbh it would be cool if you could just click a button and get an order pre-filled out on a grocery delivery/pickup service. I really wonder who reviewed this post and if they cook, because imagining yourself in that scenario and reading those instructions falls apart very fast
This seems like a step towards their plan for building a platform in competition of Google/Apple. Once the generative UIs are polished and more useful than individual apps, their hardware can now ship a device which circumvents the app store moat.
I am pretty convinced that businesses will be making custom internal software as a norm in the next few years, and this seems to be a slight push in that direction
Alright doing it here, all the functionality we need and no reoccurring yearly costs of tens of thousands of dollars. Took me a couple weeks to wire it all up with codex.
Thank god. My primary use of ChatGPT is meal planning and while it’s great for recording, recipe lookup, etc I always just wanted it to be able to make checkable grocery lists.
I eventually just had it make a skill for work mode that would build a mini checklist app, but it was slow and felt janky needing to remember to switch to work mode.
I wrote something like this, though not quite as slick, by having the model use json schema to describe its results instead of text, and then use a json-schema to ui interface.
Burning question: why is this worth paying for as a layman? I can sometimes find a use for all these LLMs for software development, but I can never find a good use for any of this outside of "slightly better search engine".
As a complete layman---not worth it. We live just fine. Medical researchers slave night and day to keep you healthy.
But if you have any ambition at all---if you want to map the local school board, or get a quick understanding of your finances, or set up a robot in your backyard---then, quickly proves useful.
I genuinely think the frontier labs are just throwing shit at the wall to see what sticks. All of the improvements since Fable 5 seem marginal. Most of the quoted AGI "risk" is coming from super large agentic models that are juggernauts that can brute force their way through any problem faster than a human can. Despite that they're no closer to AGI than they were a year ago; the technology's limitations are apparent the more you use it. Doesn't mean it's still not extremely dangerous and/or capable, it's just not the "replace a human in 99% of cases" thing. There are obvious tradeoffs besides just the models being faster and capable of information retrieval and generation at a rate exponentially faster than a human's.
My long-term hope (and call me another Zitron if you wish) is that the labs' hype dissipates if there's no serious improvements beyond stringing together agents to ram through brick wall Millennium Prize style problems and we all just use on-device AI for 99% of cases where it's useful, researchers, governments, militaries, and universities can pay for the more complex models, and image/video gen dies a slow death (if Congress will actually legislate and/or SCOTUS decides that training those specific models does not qualify as fair use unlike training LLMs) and cost for compute rises over time as public interest in the tech sours.
LLMs are such marvelous and incredible technology squandered by genuinely deranged Silicon Valley cultists who are trying to use them as a Trojan horse to force their antisocial visions of the future upon an unsuspecting populace. We could all have just invested in on-device compute and nobody would have lost their jobs in pointless layoffs, productivity would have increased, and maybe we would have forced a conversation about when and when not to use AI and it wouldn't be so ever-present in use cases where it actually does harm to the consumer and society. But sama, PT, and dario just wouldn't have it that way, would they? Because if that were the case, there's no prospective hope where they can assuage their deep-seated insecurities over being antisocial and off-putting by reassuring themselves that there's an imminent realignment of society where they will hold all the cards when the dust settles.
Great product idea. I have not paid OpenAI for a subscription for a couple of years, I’m tempted now. I do about 75% of my work using local models and most of the rest using the deepseek 4.1 flash API. That said $20 to experiment with this new product for a month sounds like a pretty fun idea.
I'm excited about generating UIs (and apps) on demand, because it's one step closer to devices just morphing to the interface you need. I want to talk to my phone and have it generate the app or interface I need. I could see Android adapting to this reality well before Apple.
throwaway7783 | 4 hours ago
solarkraft | 4 hours ago
Tiberium | 4 hours ago
wincy | 4 hours ago
0xFluegel | an hour ago
xpct | 4 hours ago
zamadatix | 3 hours ago
exitb | 3 hours ago
ismael_rr | 3 hours ago
MikhailTal | 3 hours ago
sscaryterry | 3 hours ago
spijdar | 3 hours ago
fang2hou | 4 hours ago
tamimio | 4 hours ago
ardaakman | 3 hours ago
sshussain270 | 2 hours ago
tripleee | an hour ago
oh_no | 3 hours ago
haute_cuisine | 4 hours ago
Supposedly, people were struggling to follow written manuals and they needed an interactive explanations.
I'm not a mathematician and I would certainly love having a tool that would do ELI5 on some complex stuff, but I'm really worrying about using this too often and outsourcing my ability to do stuff to some mega corp.
wincy | 4 hours ago
simianwords | 4 hours ago
altcognito | 3 hours ago
Now they extracted the value from interoperable open systems, they would love to replace it with closed proprietary systems.
pmontra | 3 hours ago
Or, more probably IMHO, most people will keep using the standard UIs because they are ready and they need no work to build.
watwut | 3 hours ago
gtt44 | 3 hours ago
dominotw | 3 hours ago
yes you and everyone else.
goatlover | 2 hours ago
How do sites like Wikipedia get updated? What if I need to upload important documents to different portals? It all has to go through the AI companies? They have access to medical records too? My taxes, social security, etc?
Is this how Microsoft imagines Office 365 and Sharepoint will be merged into? Disney, NY Times, Youtube, Netflix will all be fine with chatbots handling their content?
abroszka33 | 4 hours ago
bogdiyan | 4 hours ago
mogrinz | 3 hours ago
twoodfin | 3 hours ago
abroszka33 | 2 hours ago
hollowturtle | 4 hours ago
why not just stream html?
Aarostotle | 4 hours ago
hollowturtle | 3 hours ago
Aarostotle | 2 hours ago
For elements that manage layout and drawing things like these explainers, though, it's hard for me to imagine how that would work. My immediate thought would be to an abstraction over it, which is what it sounds like they did.
BeetleB | 4 hours ago
fsniper | 4 hours ago
topsykreet | 4 hours ago
password54321 | 4 hours ago
shwaj | 3 hours ago
password54321 | 3 hours ago
This is false.
shwaj | 2 hours ago
staindk | an hour ago
Edit: be sure to check Claude settings -> Capabilities -> Visuals.
shwaj | an hour ago
xpct | 4 hours ago
I've been learning music lately and it kept re-pasting the same one chord visualization throughout many conversations, almost randomly and often barely related to the question. So I at least hope this won't be as aggressive so I can prompt it away!
redman25 | an hour ago
blakeashleyjr | 4 hours ago
"Here is a library of [svelte/react/whatever] components, use them to construct a helpful visual to demonstrate your point."
The deconstructed bike at the beginning was in a class of its own, however.
2sk21 | 4 hours ago
hollowturtle | 4 hours ago
maherbeg | 4 hours ago
robertlagrant | 4 hours ago
kingstnap | 4 hours ago
I have explicit instructions to tone it down. Less taglines, eyebrow text, subheadings, decorative spacing, pills, cards.
Hopefully this doesn't bleed into the chat...
briga | 3 hours ago
It's a pretty clever way to sell more tokens, I have to admit
wvenable | 3 hours ago
briga | 3 hours ago
dwood_dev | 2 hours ago
apsurd | 2 hours ago
yuchi | an hour ago
utilize1808 | 4 hours ago
And now we are asking LLMs to solve it.
mortenjorck | 3 hours ago
In all seriousness, his lovingly and expertly crafted explainers are still going to age like a handcrafted heirloom clock in a world of plastic-clad quartz movements. But it’s absolutely incredible that we are now in an age where a computer can manufacture a serviceable interactive explainer on whatever niche topic you desire.
FLeXMurphy | 3 hours ago
bayindirh | 3 hours ago
> So too, is his turn to be relegated to a relic of his time.
No, it'll be tasteful artifact, not a relic. Records, fountain pens and automatic watches did not die. They are used by people who discern things, and no, none of these things have to be expensive (i.e. Neither Seiko 5, nor Lamy Safari are expensive, yet they are as dependable as their 100x expensive brethren).
Human touch still has that finesse and warmth.
FLeXMurphy | 2 hours ago
On the front page right now - https://news.ycombinator.com/item?id=49980626
bayindirh | 2 hours ago
OTOH, I still believe the exploded view on https://ciechanow.ski/mechanical-watch/ is something else.
For one, it has real physics on the weight, and second it always shows the correct/current time.
FWIW, his all animations has proper physics to begin with.
The entry you posted is nice, but Ciechanowski is still peerless.
brcmthrowaway | 3 hours ago
Game_Ender | 2 hours ago
jdprgm | 2 hours ago
customguy | 2 hours ago
You call it serviceable, but what purpose does this service? What do you now know about 7-speed bicycles that you didn't know before?
bogdiyan | 3 hours ago
revolvingthrow | 3 hours ago
Given that OpenAI is making noises about merging work with chat (a horrible idea imo), and Work is very similar to Codex... I dearly hope things like these won't have any meaningful cross-polination into the actual work tools.
Seeing that the chat is based on 6.0 and not 6.1 is disappointing. The "Visual and interactive explanations" seems genuinely useful, but 6.1 is just so much better. I wouldn't truly trust the 6.1 with the explanations, but I'd trust them a fair bit more than 6.0. I understand that compute isn't infinite, but tons of people only interact with the chat and having your "things-explainer" be as good as it can be is important when people increasingly treat AI models as the source of truth, or even use them for academic learning and whatnot.
Still, the models will improve, so the visual explainer seems pretty good as an idea / mvp.
361994752 | 3 hours ago
scrollop | 3 hours ago
Prepare to lose essentially unlimited chat mode.
I imagine many will move to claude, as I will (return), unless anthropic makes more blunders.
Random link I found looking for the twitter post
https://pasqualepillitteri.it/en/news/21024/openai-merge-cha...
TuxSH | 3 hours ago
The only things that OAI still have over A/ are better coding agent GUI, no 5hr limit on >$100, much more reasonable cybersec guardrails (that allow most RE work) and... that's it.
ElijahLynn | an hour ago
ulimn | 2 hours ago
ImprobableTruth | 2 hours ago
ModernMech | an hour ago
joe_the_user | 3 hours ago
bananaflag | 3 hours ago
zug_zug | 3 hours ago
Kinda just feels like google search results in AI, which imo is a step down from distilled information. Chatgpt is already able to generate charts and visuals upon request.
dominotw | 3 hours ago
xp84 | 29 minutes ago
cush | 2 hours ago
Curious why that feels condescending? Like, the average person who is seeking a recipe needs a photo to know what to shoot for
michaelt | an hour ago
The menu: Rosemary and garlic roast lamb, Extra-crispy roast potatoes, Honey-roasted carrots and parsnips, broccoli.
The photo: [1] Roast turkey, mashed potatoes, baby carrots, broccoli, brussels sprouts. No lamb, no parsnips.
If you shoot for what's in the photo, you're going to have a bad time.
You're also going to have a bad time when you try to make an apple crumble with no flour, no sugar, and no butter, because they're not on the shopping list.
[1] https://images.openai.com/static-rsc-4/gyzrX8zp3O2KLEPm0FAqh...
xp84 | 20 minutes ago
I feel like it can only be successful by luck. Either it's reproducing a recipe verbatim that was tried and validated and tasted by a human, in which case, we didn't need AI for that, just a searchable cookbook. Or, it's making one up. I understand that using RLHF has helped improve the quality of questions about history, programming, or TV show recommendations, but I do not believe that there has been some kind of training regime where people prompt the models for "a recipe that uses X, Y, Z random ingredients," follow the recipe, and then score it. And even if they do, I don't see how a model can learn enough from that besides "this exact recipe is good/bad." '1/2 tsp cumin' may be a great addition to one recipe and not enough for another, so improving the output based on a bunch of scored recipes... I just don't believe cooking is an LLM job.
Maybe some other kind of model that I don't know about.
viraptor | 48 minutes ago
AlphaSite | 2 hours ago
sunaookami | an hour ago
usef- | an hour ago
I'm more worried about picture accuracy: usually the benefit of pictures in recipes is to see what you're aiming at (eg, how finely chopped something is), but I don't know if the image model is up to that level of detail.
a123b456c | an hour ago
As a highly literate person, it is easy to overestimate the share of the population that is highly literate.
nickludlam | 43 minutes ago
jacquesm | 28 minutes ago
DriverDaily | 47 minutes ago
My most used prompt in the last week is probably "Explain this concisely and simply, like I am a child".
I spent years dumbing things down and creating visuals to support it for decision makers. I am frequently asking ChatGPT to do the same for me.
iugtmkbdfil834 | 26 minutes ago
And that is a problem. I am not guiltless ( I am working one such abomination now! ). The dumbing down of everything has to stop somewhere. Just because my boss thinks hiss bosses are retards does not mean I have to endure simplified muse where I can't change much.. I get that normal people like it. Fuck em. They are making their choice.
ORDINAND_PIZZA | 25 minutes ago
mine is “explain this 2 me in simple terms”
nevir | 18 minutes ago
jjcm | 3 hours ago
yread | 3 hours ago
cameronh90 | 3 hours ago
julesrms | 3 hours ago
Obviously if your model is stuck inside a CLI terminal, then not so much. But in a GUI harness (shameless plug for my own one: https://juggler.studio, but I assume others can do this too), you just ask them to answer in HTML and they'll happily draw pretty pictures inline in the conversation. I've been doing this for ages with claude, GPT, Deepseek and others.
franze | 3 hours ago
killerstorm | 3 hours ago
ardaakman | 3 hours ago
I guess the above is mostly mobile focused.
giancarlostoro | 3 hours ago
What's funny about "Intelligent UI" is I said like 2 or more years ago, that these AI companies need to start thinking outside of these basic chat UIs, they do some things here and there, but its really depressing how little they do to innovate in these spaces. Same with the coding harnesses, the UI for all these things could be drastically superior.
120492751 | 3 hours ago
tencentshill | 3 hours ago
apsurd | 3 hours ago
Also reasonable: it's possible to hire a world-class ___ to do that job better than AI.
ianbutler | 3 hours ago
apsurd | 2 hours ago
onion2k | 2 hours ago
Anyone can having blog posts as good as this by using AI. Just not by zero-shotting it with a 2 line prompt. It still takes a lot of work.
rfgplk | 3 hours ago
lrpe | 3 hours ago
But this is just a marketing page for some tech company, right? If only it stopped there. I have to deal with this nonsense in news "articles" as well on occasion, when some web designer intern is allowed to larp as a journalist for a day.
sigh Just give me text to read.
mikestorrent | 2 hours ago
This is why I use an IDE instead of a TUI agent... I'm on a computer with a multi-megapixel display, I want to use it. If I could be driving the same process with my Macintosh SE as a serial terminal, what the hell is the point of my recent Macbook?
lrpe | an hour ago
I should have been more precise than saying "just give me text", but it was what came in to mind when I wrote it, as I was thinking about what an article is meant to contain as its base element.
KoolKat23 | 53 minutes ago
mi_lk | 3 hours ago
fasterik | 2 hours ago
hatthew | an hour ago
dv35z | 50 minutes ago
ChrisMarshallNY | 2 hours ago
Fairly likely: https://medium.com/the-engineering-brief/openai-hired-400-ap...
dcchambers | 2 hours ago
I would prefer if the AI companies stuck to just creating better models and making them as cheap and accessible as possible. Let others build the products. I don't want 1-2 companies to own every product in the world.
xg15 | 2 hours ago
That seems to be the plan...
timacles | 2 hours ago
Buckle up boys
goatlover | 2 hours ago
Foobar8568 | 2 hours ago
Shorel | 2 hours ago
So this is a taste of the slop that's going to invade everywhere in a few months.
lukewarm707 | 2 hours ago
jonathanstrange | 3 hours ago
What is it supposed to demonstrate? That the model knows some kind of folk mereology?
TheOtherHobbes | 3 hours ago
I suspect it will struggle with anything that isn't simple enough for demo-mode or lifestyle fluff.
gtt44 | 3 hours ago
Remember when Steve said ‘the computer for the rest of us?’ We’re seeing that here.
interstice | 3 hours ago
Unsure if this has been done already but the best thing I did was get it to create a list of next steps as quick buttons that it keeps updated in a docked card. It works well but occasionally gets stuck on some un related rabbit hole.
xnickb | 3 hours ago
- Audio volume has 2 levels: on and off
- Play button worked exactly once for me: it played and looped the video. Couldn't be stopped afterwards.
- The video progress bar has no visual indication of where it starts and where it ends..
Is this what Phind died for?
dist-epoch | 2 hours ago
Even TV channels like CNN and FoxNews don't have a decent one.
It's like we need ASI to have a proper embedded video player. The ultimate software challenge.
KoolKat23 | 48 minutes ago
KoolKat23 | 44 minutes ago
Sure as hell beats stupid Instagram style videos where you have no way to skip ahead. I think this is what future video is going be like, buckle up.
hacker_88 | 3 hours ago
120492751 | 3 hours ago
This is now trying to steal YouTube repair and cooking videos. Here is news for you: People prefer YouTube repair and cooking videos.
PetahNZ | 3 hours ago
vel0city | 3 hours ago
But getting actual service manuals cheap/free these days can be tricky, and their quality can leave a good bit to be desired.
dominotw | 2 hours ago
mainecoder | an hour ago
sunaookami | an hour ago
Not sure about the cooking one but repair videos are horrible. People with thick accent, the worst camera, shittiest lightning and bad angles where you can't see what you have to do.
manlymuppet | 3 hours ago
dominotw | 3 hours ago
Ok so this is how you build a moat. Models are not a commodity and visualization isnt a purely harness problem.
> We expanded our training methods to help the model make thoughtful decisions about content, layout, visuals, and interaction. This included evaluating the interfaces it creates for clarity, usefulness, and completeness. GPT‑6 learned to use the component library and make good design decisions, including how to organize information clearly, when to use interactivity, and when a simple text response is enough.
Curious to know how they trained it produce appropriate visuals. And why that cant be done with propmt engineering.
gtt44 | 3 hours ago
ddxv | 3 hours ago
1) I want a quick answer, and I don't care for the boilerplate UI. For example, if I ask how to make pancakes, I make them all the time and just want to a quick reminder on the ratios, but it might trigger a full UI that I need to sort through to find information.
2) If I ask a to me unrelated to UI question and it triggers a big UI build that is completely off topic for my question (meaning I'm desperately pressing the stop button and prepping rewriting my query)
Or the other one I see, for example if I look up a unix command like:
"ls all hidden files in the /xxx directory"
And I get back:
"Sorry, I am am unable to find /xxx in my current environment"
xnx | 3 hours ago
Alifatisk | 3 hours ago
dbacar | 3 hours ago
virtuosarmo | 3 hours ago
NeumannGod | 3 hours ago
colordrops | 3 hours ago
pluc | 2 hours ago
binlog | 2 hours ago
- People don’t have to stick to a single provider. They can all claim the same 20%.
telesilla | 2 hours ago
https://news.ycombinator.com/item?id=49542814
simonw | 2 hours ago
dist-epoch | 2 hours ago
totallygeeky | 2 hours ago
perelin | 2 hours ago
theflyestpilot | 2 hours ago
vb-8448 | 2 hours ago
theflyestpilot | an hour ago
seems a bit like a snake eating its own tail
darepublic | 2 hours ago
jdprgm | 2 hours ago
pmkary | 2 hours ago
program_whiz | 2 hours ago
Getting a UI that explains the parts of a bike is ok I guess, but isn't it simpler to get an actual breakdown? Google "parts of bicycle breakout" gets tons of useful images instantly.
Getting a specialized app to split a bill? It was already trivial to put in a calculator if we cared to go item by item on the bill. Having to provide names and tag every item as I go is just more work. Usually real people just go $total divide by 5, I had more, let me chip in an extra $10.
Same with booking travel and wedding plans, these aren't things people would even delegate to a trusted friend usually, much less a one-off request to an AI bot or custom UI.
Most of the useful tasks it can do right now are research, technical question/answer, coding. In terms of "build a flexible ui that solves real-world problem", if existing mobile app isn't useful in this arena, then its unlikely a completely custom UI will do the job.
That said, I've done a few small ones like a quick one to practice alphabet of a foreign language, or prototyping a web game, and the like. But ultimately its nothing that is worth trillions of dollars.
efields | 2 hours ago
Gettin closer to fully dynamic interfaces for a lot of software. Hell, give me a mode in Google Docs that takes every pixel of chrome away then vibe the rest as I need it. Persist across new documents going forward.
kart23 | 2 hours ago
> Also pick up garlic, rosemary, thyme, lemons, honey, almonds, olive oil, gravy ingredients, mint sauce, crumble topping and vanilla ice cream.
what??? how the hell are you supposed to remember all that. Even the before example tells you what kind of potatoes to get. tbh it would be cool if you could just click a button and get an order pre-filled out on a grocery delivery/pickup service. I really wonder who reviewed this post and if they cook, because imagining yourself in that scenario and reading those instructions falls apart very fast
felixgallo | an hour ago
kirykl | 2 hours ago
jcmontx | 2 hours ago
bromuro | 2 hours ago
midriff | 2 hours ago
gessha | an hour ago
soundworlds | an hour ago
overcast | 48 minutes ago
csharpminor | an hour ago
I eventually just had it make a skill for work mode that would build a mini checklist app, but it was slow and felt janky needing to remember to switch to work mode.
This is already such a huge improvement.
speedgoose | an hour ago
sroussey | an hour ago
rc-1140 | an hour ago
invalidOrTaken | an hour ago
But if you have any ambition at all---if you want to map the local school board, or get a quick understanding of your finances, or set up a robot in your backyard---then, quickly proves useful.
kunai | 45 minutes ago
My long-term hope (and call me another Zitron if you wish) is that the labs' hype dissipates if there's no serious improvements beyond stringing together agents to ram through brick wall Millennium Prize style problems and we all just use on-device AI for 99% of cases where it's useful, researchers, governments, militaries, and universities can pay for the more complex models, and image/video gen dies a slow death (if Congress will actually legislate and/or SCOTUS decides that training those specific models does not qualify as fair use unlike training LLMs) and cost for compute rises over time as public interest in the tech sours.
LLMs are such marvelous and incredible technology squandered by genuinely deranged Silicon Valley cultists who are trying to use them as a Trojan horse to force their antisocial visions of the future upon an unsuspecting populace. We could all have just invested in on-device compute and nobody would have lost their jobs in pointless layoffs, productivity would have increased, and maybe we would have forced a conversation about when and when not to use AI and it wouldn't be so ever-present in use cases where it actually does harm to the consumer and society. But sama, PT, and dario just wouldn't have it that way, would they? Because if that were the case, there's no prospective hope where they can assuage their deep-seated insecurities over being antisocial and off-putting by reassuring themselves that there's an imminent realignment of society where they will hold all the cards when the dust settles.
mark_l_watson | 33 minutes ago
knuppar | 22 minutes ago
skapadia | 22 minutes ago