Disney erased FiveThirtyEight

205 points by 7777777phil 2 hours ago on hackernews | 102 comments

dionian | 2 hours ago

Call me a skeptic, but it's certainly odd all the errors always lean to one side. Maybe this has to do with the leftward trend of the mainstream press.

> What happened in 2024 isn’t something I’d have scripted, though. Basically, their new election model was literally broken, continuing to show Joe Biden virtually tied with Trump even after his disastrous debate. (Evidently because Morris’s design for it had been overcomplicated. These models are hard to design, by the way.)

tkzed49 | 2 hours ago

Why would a left-leaning press engineer errors predicting the victory of the left? Wouldn't this lull supporters of the Democrats into a false sense of security and enable Republican wins?

LanceH | 2 hours ago

It seems calling a state purple is just using a synonym for red.

Octoth0rpe | 2 hours ago

> Maybe this has to do with the leftward trend of the mainstream press.

What mainstream press outlet has moved leftwards? I can't think of any, and I certainly am interested in knowing which those might be. Inversely, cbs, the ny times, and the washington post have all shifted rather noticeably rightward in the last 10 years.

CGMthrowaway | an hour ago

>cbs, the ny times, and the washington post have all shifted rather noticeably rightward

As the Overton window or activist left moves further left on issues like identity politics, crime and free speech (1619 Project era at NYT, staff revolts etc), steady coverage can appear "righter" by comparison without actually changing

rc_kas | an hour ago

Remember when Net Nuetrality was the priority of hackernews and slashdot and basically all people in tech. Now it's a "leftist policy". We live in crazy times.

Overton window has definitely shifted to the right. Beign a normal person who values science is now considered "leftist". Its nuts.

There's also a bloc that's been working to try to retroactively redefine what "Net Neutrality" means.

Instead of "consumers have rights" or "ISP monopolies are bad" or "utilities should just provide the product and not spy and manipulate", they want it to mean something like "no online community can moderate itself."

And that's the charitable version! The less-charitable one involves hypocrisy and selective enforcement, where everyone must be "Neutral" to nazis but it's OK to permaban for insulting Dear Leader.

Octoth0rpe | an hour ago

Where is the steady coverage? Again, I see coverage moving rightward at every major publication (including the ny times)

notahacker | an hour ago

Apparently it's "steady coverage" for CBS to be taken over by a culture warring op-ed writer who singlehandedly spikes investigative journalism if the Trump administration don't want to offer their comments on the story, and for WaPo op-eds writers to tweet that "we're now a conservative opinion section"...

wredcoll | an hour ago

Wait, so your argument is that people being against censorship or discrimination are now considered to be left wing? That's literally the overton window moving to the right, you're contradicting yourself!

armchairhacker | an hour ago

According to AllSides, many outlets moved left, although some did move right: https://www.allsides.com/blog/AllSides-Media-Bias-Rating-Ove...

It and https://mediabiasfactcheck.com say NYTimes “leans left” and is “left-center” respectively.

What’s an example that you believe highlights NYTimes moving rightward?

laweijfmvo | an hour ago

you should scroll through AllSides' twitter before trusting them to be impartial.

armchairhacker | an hour ago

https://xcancel.com/AllSidesNow

Again, which one of these tweets highlights their bias? Most of them are event headlines from a “left”, a “center”, and “right” source.

jcranmer | an hour ago

> What’s an example that you believe highlights NYTimes moving rightward?

Look at their coverage of Alexandria Ocasio-Cortez's response to a question about Taiwan versus Trump's response to a question about Taiwan. In the first case, their quote included all of the um's and other similar pauses in answering the question. In the second case, their quote of Trump cleaned up all of those artifacts. The end result is that it looks like AOC is flailing to come up with an answer while Trump has a clean, polished answer. But if you compare the actual audio clips of both answers, Trump's answer is the one that involves far more flailing to come up with a response.

There is a general pattern in the more subtle aspects of presentation and framing that generally excuse the behaviors of right-wing politicians compared to the same actions being done by a left-wing politician.

armchairhacker | 56 minutes ago

I assume you mean this article for AOC quotes: https://archive.ph/gmvBy

And this for Trump quotes: https://archive.ph/staNQ

You’re right about the quotes.

But also consider this article that was published after Trump’s, not even labeled “editorial” or “opinion”: “Trump’s Taiwan Gambit is Already a Gift to China” (https://archive.ph/lwBWD)

Octoth0rpe | an hour ago

> What’s an example that you believe highlights NYTimes moving rightward?

The treatment of Mamdani for one, or Hochul/Cuomo.

>say NYTimes “leans left” and is “left-center” respectively.

That can be true and at the same time it can be moving rightward.

armchairhacker | an hour ago

I’ll give you that one: Madmani is treated unusually different by the news and social media, and his opponents were bizarrely overtly flawed.

wredcoll | an hour ago

NYTimes constantly deletes parts of Trump's comments or outright rephrases them in an attempt to make him seem smarter, or at least, less insane. They rarely to never do that for other people.

thaumasiotes | 34 minutes ago

> They rarely to never do that for other people.

They do that to everyone. That's how all quotation in journalism is done.

bryanlarsen | 54 minutes ago

That same result would also be achieved by the Overton window moving right.

jdlshore | 2 hours ago

Are you sure you aren’t experiencing selection bias? The article only mentions one modeling error (the one you quoted), so “all the errors” must be the ones you’ve noticed elsewhere.

convolvatron | 2 hours ago

its this really what we're left with, people sharing their skepticism? without any dint of rationale, just stories about how these obviously bad people did all this stuff that everyone knows.

I'm not going to defend Silver's predictions, but what was really refreshing about his work was some lovely diagrams, and real intent behind exposing his methodology. it was never 'trust me I'm the expert', but 'wow, this is hard and these are the problems and this is how I tried to deal with them'

jandrese | an hour ago

> leftward trend of the mainstream press

Oh yeah, venerable institutions like the Washington Post, New York Times, LA Times, Chicago Tribune, and the like? Or maybe you mean the TV news organizations owned by Sinclair Broadcasting, Nexstar, or Hearst? Or maybe cable news organizations like CNN or Fox News?

The narrative of the "liberal media" is so out of date it makes you look out of touch. The mainstream media is captured by billionaire interests and has been so for years now.

burnte | an hour ago

> Maybe this has to do with the leftward trend of the mainstream press.

What? Media in the USA has staggered to the right over the past ten years. The only reason it was called liberal before that was because one party used facts and data and the other preferred to rig the system against the common people. While Stephen Colbert made the joke "Reality has a well known liberal bias" it's joke only in that the conservative viewpoint today seems focused on imaginary problems and denying the existence of real ones.

joshstrange | an hour ago

> Stephen Colbert made the joke "Reality has a well known liberal bias"

Video (queued up): https://youtu.be/IJ-a2KeyCAY?t=270

It's always pretty depressing to go back and watch this or old Colbert Report episodes and realize how parts are incredibly "evergreen", sometimes you don't even need to change out the names.

Maybe there were no errors and a certain techbro helped with the counting machines so right wing could win?

ilamont | 2 hours ago

A Pew study of a random sample of Internet links conducted in October 2023 found significant “link rot”: almost 40 percent of links that had been active 10 years earlier were broken. And that’s probably an underestimate: the study was based on the Common Crawl web archive (the same one that AI labs use to train their models), which is quite comprehensive but probably contains some bias toward more prominent sites.

"Random sample of Internet links" is going to include a lot of absolute garbage.

If we're talking about news sites, or commentary, or blogs, or magazines, or newspapers, or other publishers, the number of dead links will be far higher. Those are the types of sites that are likely to fail, be acquired, get migrated, or become paywalled.

I worked as a technology journalist for years starting in the late 90s. I did a lot of freelance work as well, and almost nothing survives online. There were media brands that were shut down, content migrated to another site, the CMS was migrated from Drupal to Wordpress to something else, there were two or three acquisitions, and so on. Last week, I checked some articles that I worked on between 3 and 10 years ago and they were either 404s or paywalled.

When I left one of the higher-profile pubs in the aftermath of the 2008 financial crisis, I knew my articles wouldn't last even though they were migrated to a sister publication. I made PDF copies of every single one. I still have them in a folder somewhere, not sure what to do with them.

My personal blogs are still up, but even those will die at some point.

toomuchtodo | an hour ago

https://blog.archive.org/2026/04/23/introducing-vanishing-cu...

https://archive.org/details/vanishing-culture-2026

(when able, please consider donating to the Internet Archive; they are the durable, long term storage system of last resort)

> Yes, you can still access (for now) Disney-era FiveThirtyEight content via the invaluable Internet Archive, and pre-Disney-era content from The New York Times (which I partnered with from 2010 through 2013). And obviously, we’re trying to recreate some of the most popular parts of FiveThirtyEight at Silver Bulletin. The election models and polling averages are here, and new-and-improved versions of the sports models (PELE, ELWAY, COOPER) are gradually returning too.2 Galen Druke, Clare Malone and I have even been getting the old podcast crew back together for live shows.

With regards to:

> When I left one of the higher-profile pubs in the aftermath of the 2008 financial crisis, I knew my articles wouldn't last even though they were migrated to a sister publication. I made PDF copies of every single one. I still have them in a folder somewhere, not sure what to do with them.

May I suggest:

https://help.archive.org/help/uploading-a-basic-guide/

You can upload them all as a single item, or as individual items per piece and asking IA Patron Services to create a collection for you.

> My personal blogs are still up, but even those will die at some point.

Drop links, and they will be queued for crawling, if not already archived. If you would like to self serve, https://web.archive.org/save

ilamont | an hour ago

Thank you!

duskwuff | an hour ago

> "Random sample of Internet links" is going to include a lot of absolute garbage.

It's also likely to include a lot of non-content links, e.g. links to index and navigation pages, interstitials, search results, user profiles, image galleries, etc. These sorts of links don't reliably address specific content, and it's natural that they'll change or die over time. This doesn't necessarily mean that anything valuable has been lost.

SilverElfin | 2 hours ago

It’s what happened to Star Wars. Figures.

superfrank | an hour ago

How so? To me it seems like the exact opposite of what's happened with Star Wars in the last 20 years.

538 was purchased and then left to wither and die where as Disney seems intent on squeezing every last penny from the Star Wars franchise by using the IP as much as possible

SilverElfin | an hour ago

Disney removed a lot of the earlier IP from the official Star Wars storyline shortly after acquiring it. That IP was much better than the complete mess and politicization of Star Wars that happened in the sequels. Sure they are trying to squeeze money out of it - and maybe some of the TV shows are tolerable - but they killed the brand and its best content in the process.

mholm | an hour ago

Content quality and content monetization are very different. The EU had exceptionally low monetization and brand recognition.

wredcoll | an hour ago

Good point, Star Wars was famously not about politics. Very apolitical.
The politics of the original trilogy Star Wars was essentially “dictators and fascists with big armies are bad”. It was naïve and simplistic; a simple storytelling device, nothing more. There was no conscious choice behind it. If it had been made 40 years earlier, the enemies would have been savage indigenous people, as was the style at the time. The politics of modern Star Wars are… specific. Pointed. Winking at the camera. I suspect they may not age well.

hobofan | 19 minutes ago

The Viet Cong parallels in the original Star Wars about as much "winking at the camera" as current Star Wars is to current politics.

divbzero | an hour ago

Some of Disney’s most valuable properties—ESPN, Pixar, Marvel, Star Wars—were acquired. FiveThirtyEight may be smaller, but it should be in Disney’s self-interest to set things right and earn a reputation for being a good home for acquisitions.
> ESPN, Pixar, Marvel, Star Wars

And all of those have declined in reputation since their acquisition or soon after.

chasil | an hour ago

Berkshire Hathaway has this attitude, with the proviso that the corporate management at the acquired firm must be competent, and the firm be profitable and protected by a "moat."

It's amazing that they trot out Sees Candy every year for the shareholders' meeting when they own GEICO.

It seems that Disney isn't doing this quite right.

fuzzfactor | an hour ago

For one thing See's Candy is fundamentally a value-added operation and GEICO is a positive cash flow financial structure which remains competitive by trying not to remove as much value from the customer as the next guy.
Sees Candy made the wiki.

Services & retailing: Ben Bridge Jeweler, Business Wire, Dairy Queen, McLane Company, NetJets, Oriental Trading Company, Pampered Chef, See's Candies, Star Furniture, WPLG

Manufacturing: Benjamin Moore & Co., Clayton Homes, CTB International, Duracell, Fruit of the Loom, Johns Manville, Lubrizol, Precision Castparts Corp, Scott Fetzer Company, Garan Inc

https://en.wikipedia.org/wiki/Berkshire_Hathaway

browningstreet | an hour ago

They're running with their heads down, for at least as long as the current administration exists.

ConceptJunkie | an hour ago

> earn a reputation for being a good home for acquisitions.

It's way too late for that to be possible any more.

chao- | an hour ago

>The Times was also in the midst of a leadership transition, and new management tends to want to move on from the old regime’s pet projects, even if they were successful.

Learning about B2B sales over the years, the size of this leadership-change factor has been among the most eye-opening (and among the most disappointing).

It cuts both ways: You can have a successful pilot that doesn't proceed because this-or-that VP was replaced, and to show off their bold new direction, the new VP cancels almost everything novel the previous person started. Or you can reach out just at the moment the new guy or gal comes in, right when they're looking for the pieces of their bold new direction, and you become part of that.

I would love to have later learned that leaders who evaluate opportunities separate from personal attachment are seen as more efficient, better, and selected favorably; that more successful companies are less subject to this sort of political/careerist whimsy. Alas. At least I have been fortunate enough to experience both directions in quantities that roughly balance out.

nostrademons | an hour ago

> I would love to have later learned that leaders who evaluate opportunities separate from personal attachment are seen as more efficient, better, and selected favorably; that more successful companies are less subject to this sort of political/careerist whimsy.

My experience is that it's the opposite: the more successful the company is, the more prone it is to flights of executive whimsy. At more successful companies, it basically doesn't matter what the executives do, because the company's moat is so big that it can tolerate grotesque mismanagement and still make money. (This is the converse of the old aphorism "When a management with a reputation for brilliance tackles a business with a reputation for bad economics, it is the reputation of the business that remains intact."). Executives seem extremely uncomfortable with the idea that they are being paid tens of millions of dollars and yet nothing they do matters, and so they're intent on leaving their mark. Thus, they cancel all the pet projects of the past management, instill their own ideas, and boldly take the company in a new direction. Except not really, because the fundamental parts of the business that make it work are all handled by people 8 levels down in the org chart whose job functions are considered common sense by everybody and never really up for discussion.

At least, this was my experience at Google, which is perhaps the best money-making machine ever invented and yet is grotesquely mismanaged by mid-level VPs that cancel every promising new product that comes out, only to start their own initiatives that themselves get canceled by their successors.

daedrdev | 11 minutes ago

Once you look, you see this all the time when new CEOs join large companies, they feel the need to mark their territory by taking a dump on it.

nashashmi | an hour ago

> Founder Nate Silver left in 2023, taking the rights to his forecasting model with him to his website Silver Bulletin.[7][8][9] The site's new owner, Disney, hired G. Elliott Morris to develop a new model.[7][8] On September 18, 2023, the original website domain at fivethirtyeight.com was closed, with web traffic becoming redirected to ABC News pages, and its logo was replaced, with the name 538 used instead of FiveThirtyEight.[2] On March 5, 2025, 538 was shut down by ABC News and its staff were laid off.[10] On May 15, 2026, ABC redirected thousands of archived 538 articles to the politics section of their news website, making them inaccessible.

From Wikipedia.

cm2012 | an hour ago

What a delightfully educational article on how the corporate world works

doctorpangloss | an hour ago

it was super interesting. My gut was like, jesus christ, if you don't live in New York City, seriously, absolutely nobody gives a single flying fuck about any of this stuff!

simonw | an hour ago

In situations like this I always wonder if there's a decision maker somewhere in the pipeline who just has values and a mental model of the world that's entirely foreign to me - for whom the idea of deleting a decade+ of content from the web doesn't strike them as bad in the slightest.

outside1234 | an hour ago

I would actually say that for most business people this is all "about numbers" and aren't in the slightest worried about deleting something.

This is why efforts like Internet Archive and others are so important. Whatever you think of 538, it _is_ history, and in this digital world it needs to be preserved.

legitster | an hour ago

> The thinking at Disney is presumably that they invested a lot of money in FiveThirtyEight and were left with nothing to show for it. But to my mind, however much they spent on FiveThirtyEight, they never invested a dollar in it. There was never really any effort, or even any pretense of trying, to make it a profitable unit of the company. At one point, other senior staffers and I basically begged Disney to turn on a paywall, figuring this could provide some security, and were told, essentially, that it just wasn’t worth Disney’s bandwidth to figure out the mechanics of one.

I cannot tell you how much of my professional career I have seen this play out again and again and again.

There is an "executive class" in this country that has never had a real job or done real work. They were born to privilege, they went to elite schools, got their first check from a major consultancy, and then spend their whole career bouncing from C-suite to C-suite. They stare at slides all day, occasionally make a meaningful decision, and more or less spend their time insulating themselves from failure.

This may not describe everyone in charge at every major company, but it describes enough to explain why everything in our economy just feels like it's piggybacking off of a handful of actually good businesses.

forshaper | an hour ago

Insulation in our society has gone all the way up and down.

underlipton | 50 minutes ago

It's not the full story, but it's certainly a large part of it.

I'll chime in tangentially with another large part: the disproportionate share of both asset and liquid wealth held by people who are some combination of a) Baby Boomers, b) in the top percentiles of wealth/income, c) politically- or socially-connected. As you say, it's not all of them, but enough of them. At the confluence of the two groups is a desire not to invest in potentially risky ventures, or to spend on consumption, but instead to put as much money as possible into a narrow band of low-risk, often passive investments, and to pull every lever possible to protect those investments, even when they become outmoded in some regard and the income stream or economic activity that supports their high (growing) valuation dries up.

Supporting this paradigm (ostensibly so that seniors don't die in poverty, so that strategically-important businesses and ventures are backstopped, etc., but, crucially, to the detriment of all other concerns) means an erosion of a sort of "constructive inefficiency": "wasted" spending on ventures that might not work out, on employees who are not the best and most productive, on niche services and products, which altogether represent a massive share of potential economic activity that is much better at involving and supporting a diverse population with diverse needs and diverse skill sets that perhaps have not yet found the correct outlet to produce maximal value.

Your C-suite goons and my rich, highly networked seniors don't care about the potential of a paradigm shift to support and enable short-term losers, though. They just want to pile into the sure-thing of your "actually good businesses" (which, in many cases, aren't actually that good).

ninth_ant | an hour ago

> I did too much bragging in the media and didn’t anticipate the extent to which public opinion toward FiveThirtyEight would shift once we became a corporate-backed incumbent rather than an eccentric upstart

Can’t speak for everyone else, but it wasn’t this for me. It was about 2016 presidential that lost me.

He tries to justify this later about how theirs was better than other outlets but I don’t care. Call it emotional, naive, unfair or whatever you want, but regardless I had zero interest in reading any of their predictions or analyses after that.

Not even mad, just that to my experience they had one job and they didn’t fulfill it at the most important time. They went from appearing insightful to just one opinion amongst so many others.

shawabawa3 | an hour ago

Because they said trump only had a 30% chance to win?

What if they had said 49%? Would that have made their prediction worthless?

bellowsgulch | an hour ago

I mean everyone said he had a snowball’s chance in hell and then we ended up with him for two terms because the Democrats can’t stop fighting over the worse possible candidates to back that no one is asking for.

palata | an hour ago

I find it interesting to blame it on the democrats. We ended up with him because enough people voted for him.

kjkjadksj | 54 minutes ago

The blame is put on democrats because when they lose its because they don’t turn out and when they win its because they do. It is quite simple really. Republicans are far more reliable voters. You can look at vote totals and see this pattern. Massive delta for democrats election over election and usually half that delta for republicans.

dwoldrich | 26 minutes ago

And he won the popular vote if you believe that all U.S. elections are secure and sacrosanct. He is diabolical at getting people to talk about him and think about him constantly.

Joe Biden on the other hand was a senile wrecker for Build Back Better and the party finally made "the switch" to unelected Harris far too late in the process. Even if she was a great candidate, with her odd laughter and fascination with buses, there was not enough time to shape her candidacy. Her VP candidate choice was hobbled by rising anti-semitism in the party against Shapiro and perhaps concerns of being outshined by him. No, the Democrats did not do themselves any favors in the '24 election.

Carter, Clinton and Obama were media creations, vaulting to national prominence out of nowhere. It helped that Clinton and Obama were great, charismatic choices.

Now the traditional media is fragmented and weak. You're not seeing furtive vaulting attempts for potential phenoms like Newsome gain any traction. Who is the media going to be stuck with next time? Will it be take-two for Harris?

WHEN, not if, Harris loses bigly to Vance, then the Democrats will absolutely be to blame. Where are their all new shiny, beautiful, erudite candidates that would need all four years to gestate and promote? Shouldn't we be getting acquainted with them now? I wager they're not going to appear, and we'll get more flunkies. My theory as to why is that those currently in power in the party do not share; they're aging out and hollowing out the party in the process. We're to the point now of collapse. I'm surprised a third party on the left hasn't yet formed.

doctorpangloss | an hour ago

do you think nate silver is part of the problem or part of the solution?

the turnout-of-demographic-groups-based election model is surely the underlying intelligence failure here.

ntonozzi | an hour ago

Everyone said that except for 538. That's why 538 was worth reading.

coliveira | 44 minutes ago

Democrats will not let people choose candidates because that may be too dangerous for their interests. We'll never get good candidates as long as the current leadership is in control.

amanaplanacanal | 41 minutes ago

Do you not have primaries where you are?

bachmeier | 54 minutes ago

When pressed before the election, Silver did not explain where Trump's much higher probability of winning came from. He predicted a Trump loss, Trump won, and he claimed victory because he gave Trump a better chance of winning. There's no way that strategy could have failed.

hungryhobbit | 37 minutes ago

Nate Silver is not a magician! He can't magically make polls reliable!

All he (or anyone) can do is interpret or analyse poll results, and then surface their findings in a way a larger audience can understand. 538 did that better than any other poll analyst ... but they all got it wrong because the polls themselves were faulty.

TLDR; You can't get water from a stone, and no one (not even Nate Silver) can get perfectly accurate predictions from (inherently flawed) polls!

bonzini | 14 minutes ago

Silver claimed that his model was better because it predicted a high correlation between PA/MI/WI.

A model that predicts a 30% chance of winning the election will be wrong 1 out of 3 times, which is not quite a coin flip but close enough.

fabian2k | an hour ago

FiveThirtyEight gave Trump a 30% chance. Their reporting did make clear that with margin was within the range of a normal polling error. And sometimes you get more than a normal polling error.

It doesn't help that the US has a terrible election system that often leads to small margins in some states being decisive.

kypro | an hour ago

> FiveThirtyEight gave Trump a 30% chance.

I know I'm being super conspiratorial here but why wouldn't all forecasters predict just between 30% - 70%? That way if they're "right" they can take the credit for it and if they're wrong they can say "well, we weren't that wrong". That's probably what I'd do anyway...

fabian2k | an hour ago

Of course there's more than that. Predicting higher uncertainty than warranted would be a different failure in the model. But that didn't really happen in that election.

volkl48 | 53 minutes ago

It implies a close race or a strong reason to believe there's some sort of systemic polling miss, and if it's a blowout you still look pretty bad. Especially if you don't have some kind of good explanation for the miss/you keep making those kinds of misses frequently.

Also there's more going in those forecasts besides just the "% chance to win". There's expected results in terms of %'s of the vote for the candidates, and that's what people tend to focus on for actually analyzing your performance and credibility after the fact.

You getting the outcome correct but being off by 20 points on the margin is a much worse performance than you getting the outcome wrong but being within 0.5 points of the margin. (ex: Results are 49.75/50.25, you predicted 30/70, another outlet predicted 50.25/49.75).

coliveira | 42 minutes ago

You're completely right, although I believe this number was not decided personally. They just happened to pick algorithms that have this "nice" property because it will lead to the same result.
I had complaints about 538, especially the early days, but don't understand this critique at all. A 30% chance hitting is completely unremarkable, and it was a perfectly reasonable reading of the evidence at the time. Nate isn't wrong that conventional wisdom was way off, with even supposedly statistical models giving Hillary a 99% chance of winning.

Elections, like many things, have some inherent uncertainty. A several point polling error is normal, so a candidate who is down a couple points on election day has a decent shot of winning.

Retric | an hour ago

Not just that, predictions also impact voter participation.

munchler | an hour ago

I think this is all true, but it dodges the bigger issue. A presidential election has a binary outcome: yes/no, win/lose. If your statistical model doesn’t contain this single bit in its output, then it doesn’t meet the minimum requirement for being a prediction.

Now you might say that it was on me as a consumer to understand this in 2016, but I remember the look of total shock on Nate Silver’s face when he called the winner on live TV that night, so clearly he didn’t really understand it either. Lesson learned for all of us, I guess.

lacewing | 59 minutes ago

I don't understand why this is surprising. People didn't go to FiveThirtyEight to marvel the science behind it. The science was just supposed to give you what you came there for: the actual election results.

In the end, it turned out that predicting elections is still very hard, and that for all the fanfare, FiveThirtyEight performed only slightly better than what you could find in any other reputable newspaper, so it kinda lost its appeal.

hungryhobbit | 42 minutes ago

538 was never about magically making polls more reliable, and only people that don't understand what polls are could think that (caveat: lots of people don't understand how polls work).

538 was about analyzing and communicating the information from those polls in an easily accessible form. If you came to the site for that, you weren't mad that they "predicted poorly something that was impossible to predict from the data sources they used" ... you were just mad at Trump for winning (despite polls suggesting otherwise).

lacewing | 13 minutes ago

Again, I don't think any of this matters. People were not coming there to have "information communicated to them". They were coming there for the satisfaction of knowing the results before everyone else. And FiveThirtyEight couldn't realistically deliver on that.

ghostbrainalpha | 31 minutes ago

Polls became much less interesting as an Entertainment category once we all had experience with how unreliable they are.
> FiveThirtyEight performed only slightly better than what you could find in any other reputable newspaper

FiveThirtyEight gave Trump double the odds of the next highest reputable prediction, which was The New York Times Upshot (15%). Princeton Election Consortium gave Trump less than 1%.

That is not "only slightly better" to anyone who's statistically literate.

ngriffiths | 57 minutes ago

Discussion of stats models is always complicated by the fact that a lot of people will read "30%" as a "no" prediction and claim your model is wrong if the thing happens. On the one hand, one strategy is to "hide" the numbers a bit behind a blaring headline that says "we are not sure!!" It's a bit of an art to decide when to be "sure" or not. On the other hand, in research for example you can just say screw it, I care if the correct people are correct, not if a bunch of wrong people are wrong.

I feel like the correct strategy for 538 when it was actually niche was to be precise, but then it went viral and maybe should've hit the IDK button much harder and more often after that.

The real caveat is that 538 was a Monte Carlo model, and is only as good as its inputs. "Here's what the current spread in polling numbers is *given our model and the current polling and their reported uncertainties.*" Polling uncertainties are themselves computed under certain models, and those models are subject to errors. I don't think 538 hid this, but it's a difficult caveat for people to reason about because the sorts of modeling errors that have the most influence usually represent "unknown unknowns".

Sparkle-san | 13 minutes ago

I can't find the source anymore since 538 is no more, and I recall Nate even describing what could (and did) happen, which was that one swing state moving to the right had a high likelihood of them all moving to the right.

FergusArgyll | 10 minutes ago

It was 30% in the end, before the nomination it famously gave him a 2% chance of getting nominated. All the talk about 30% is disingenuous

https://en.wikipedia.org/wiki/FiveThirtyEight#2016_U.S._elec...

legitster | an hour ago

If I say you have a 50% chance to win a coin flip and you lose it, that doesn't mean I'm wrong.

A key thing though is 538 did regularly test the calibration their models: https://web.archive.org/web/20190410030104/https://fivethirt...

> "What you’ll find, though, is that our calibration has generally been very, very good. For instance, out of the 5,589 events (between sports and politics combined) that we said had a 70 chance of happening (rounded to the nearest 5 percent), they in fact occurred 71 percent of the time. Or of the 55,853 events that we said had about a 5 percent chance of occurring, they happened 4 percent of the time."

tekla | an hour ago

> Call it emotional, naive, unfair or whatever you want

Yep definitely all those.

Why is it so hard to admit 30% is not 0%?

jackmott42 | an hour ago

Nate was a huge outlier in that prediction, he gave trump a better chance than almost anyone else that I can recall, so why are you mad at him about that?

What made me mad is Nate seemed to turn into a MAGA troll himself after that election.

I really think a majority of NYTimes and ABCnews consumers don't know the difference between a 2/3 chance (super close) of winning and 2/3 of the vote (a landslide).

Traster | 17 minutes ago

Apparently neither do a big chunk of HN readers.

tombert | an hour ago

A dice roll has a 16.6% chance of landing on any given side, meaning an 83% chance of not landing on that side.

If you guessed a "two", and it landed on "two, I wouldn't really be that impressed, even though there was an 83% probability going against you.

bryanlarsen | an hour ago

538 used the example of Trump having approximately the same chance of winning the 2016 presidential election as the Cavaliers had of winning the NBA championship round vs the Warriors. Both Trump and the Cavaliers won with a ~25% predicted chance.

538 made very clear with this analogy that both Trump and the Cavs were underdogs, and that both had a solid chance of winning.

afavour | 55 minutes ago

I think this gets to the core of why a lot of this election prediction stuff doesn't work. People just don't parse the numbers the way the authors intend.

FiveThirtyEight had Trump at a 30% chance of winning, and he won. The model wasn't wrong. The less likely of two outcomes occurred. Even if they'd had him at 1% they still wouldn't technically have been wrong though I think complaints might be more warranted.

If they had Trump at 49% would you have still been angry? What about at 51%? Would it have been okay then?

coliveira | 49 minutes ago

Technically this is right. But if that is the case (and it seems to be), then a coin flip is better than their models. Because we only care about the current election, not a sequence of 1000 elections (which will not happen, by the way).

afavour | 43 minutes ago

I don’t disagree, I think the tea leaf reading is ultimately pretty futile.

But at the same time I do think it’s valid to say it’s more than a coin flip. The polling data over the election cycle showed that Trump had a smaller but still legitimate chance of winning. The data was different in 2020, when he lost.

dogleash | 40 minutes ago

> But if that is the case (and it seems to be), then a coin flip is better than their models.

If a coin flip is the necessary mental model to remind you both things can happen, then sure.

People just love horse race coverage. Silver gave us the most accurate horse race coverage. Maybe the lesson is stop following horse race coverage.

But most people went back to the tea leave readers. That way when the election was over, it can justifiably be the charlatan's fault that viewers got over-invested in their predictive capabilities.

softwaredoug | 50 minutes ago

We should have a drinking game in Nate Silver thread anyone complains about 2016 prediction. Then everyone piles on to point out how probabilities work.

carlcortright | an hour ago

This is quite sad.

grebc | an hour ago

No wonder Disney won’t bother giving him his domain back.

ChrisArchitect | an hour ago

sbxfree | an hour ago

It feels a little disingenuous to call out your opponent's model failures when Silver's model on Live Election Night also completely bugged out showing Kamala as more favored as she lost state after state: https://web.archive.org/web/20241109030935/https://www.theda...
RIP 538's burrito bracket from 2014