FiveThirtyEight

Last updated on 22 July 2017

FiveThirtyEight, sometimes referred to as 538, is a website that focuses on opinion poll analysis, politics, economics, and sports blogging. The website, which takes its name from the number of electors in the United States electoral college,[538 1] was founded on March 7, 2008, as a polling aggregation website with a blog created by analyst Nate Silver. In August 2010, the blog became a licensed feature of The New York Times online. It was renamed FiveThirtyEight: Nate Silver's Political Calculus. In July 2013, ESPN announced that it would become the owner of the FiveThirtyEight brand and site, and Silver was appointed as editor-in-chief.[3] The ESPN-owned FiveThirtyEight began publication on March 17, 2014. In the ESPN era, the FiveThirtyEight blog has covered a broad spectrum of subjects including politics, sports, science, economics, and popular culture.

During the U.S. presidential primaries and United States general election of 2008 the site compiled polling data through a unique methodology derived from Silver's experience in baseball sabermetrics to "balance out the polls with comparative demographic data."[4] Silver weighted "each poll based on the pollster's historical track record, sample size, and recentness of the poll".[5]

Since the 2008 election, the site has published articles – typically creating or analyzing statistical information – on a wide variety of topics in current politics and political news. These included a monthly update on the prospects for turnover in the U.S. Senate; federal economic policies; Congressional support for legislation; public support for health care reform, global warming legislation, LGBT rights; elections around the world; marijuana legalization; and numerous other topics. The site and its founder are best known for election forecasts, including the 2012 presidential election in which FiveThirtyEight correctly predicted the vote winner of all 50 states. FiveThirtyEight miscalculated the 2016 election, predicting Hillary Clinton with as high as an 81% chance of winning as of June 2016.[6]

During its first five and a half years FiveThirtyEight won numerous awards – both when it was an independent blog and when it was published by The New York Times. These included "Bloggie" Awards for "Best Political Coverage" in 2008 and "Best Weblog about Politics" in 2009, as well as "Webbies" for "Best Political Blog" in 2012 and 2013. In 2016, while under the ownership of ESPN, FiveThirtyEight won the "Data Journalism Website of the Year" award from the Paris, France based Global Editors Network.

The website's logo depicts a fox, in reference to a phrase attributed to Archilochus: "The fox knows many things, but the hedgehog knows one big thing."[538 2]

FiveThirtyEight Logo.svg
FiveThirtyEight Logo.svg

Genesis and history

When Silver started FiveThirtyEight.com in early March 2008, he published under the name "Poblano", the same name that he had used since November 2007 when he began publishing a diary on the political blog Daily Kos.[7] Writing as Poblano on Daily Kos, he had gained a following, especially for his primary election forecast on Super Tuesday, February 5, 2008.[8][9] From that primary election day, which included contests in 24 states plus American Samoa, "Poblano" predicted that Barack Obama would come away with 859 delegates, and Hillary Clinton 829; in the final contests, Obama won 847 delegates and Clinton 834. Based on this result, New York Times op-ed columnist William Kristol wrote: "And an interesting regression analysis at the Daily Kos Web site (poblano.dailykos.com) of the determinants of the Democratic vote so far, applied to the demographics of the Ohio electorate, suggests that Obama has a better chance than is generally realized in Ohio".[10]

FiveThirtyEight.com gained further national attention for beating out most pollsters' projections in the North Carolina and Indiana Democratic party primaries on May 6, 2008. As Mark Blumenthal wrote in National Journal, "Over the last week, an anonymous blogger who writes under the pseudonym Poblano did something bold on his blog, FiveThirtyEight.com. He posted predictions for the upcoming primaries based not on polling data, but on a statistical model driven mostly by demographic and past vote data.... Critics scoffed. Most of the public polls pointed to a close race in North Carolina.... But a funny thing happened. The model got it right".[11] Silver relied on demographic data and on the history of voting in other states during the 2008 Democratic primary elections. "I think it is interesting and, in a lot of ways, I'm not surprised that his predictions came closer to the result than the pollsters did", said Brian F. Schaffner, research director of American University's Center for Congressional and Presidential Studies.[12]

On May 30, 2008, Silver revealed his true identity for the first time to his FiveThirtyEight.com readers.[538 3] After that date, he published just four more diaries on Daily Kos.[7]

As the primary season was coming to an end, Silver began to build a model for the general election race. This model, too, relied in part on demographic information but mainly involved a complex method of aggregating polling results. In 2008, Rasmussen Reports had an apparently short-term partnership with FiveThirtyEight.com in order to include this unique methodology for generating poll averages in their "Balance of Power Calculator".[13] At the same time, FiveThirtyEight.com's daily "Today's Polls" column began to be mirrored on "The Plank," a blog published by The New Republic.[14]

By early October 2008, FiveThirtyEight.com approached 2.5 million visitors per week, while averaging approximately 400,000 per weekday.[538 4] During October 2008 the site received 3.63 million unique visitors, 20.57 million site visits, and 32.18 million page views.[538 5] On Election Day, November 4, 2008, the site had nearly 5 million page views.[15]

On June 3, 2010, Silver announced that in early August the blog would be "relaunched under a NYTimes.com domain".[538 6][16][17] The transition took place on August 25, 2010, with the publication of Silver's first FiveThirtyEight blog article online in The New York Times.[538 7]

In July 2013, it was revealed that Silver and his FiveThirtyEight blog would depart The New York Times and join ESPN.[18] In its announcement of its acquisition of FiveThirtyEight, ESPN reported that "Silver will serve as the editor-in-chief of the site and will build a team of journalists, editors, analysts and contributors in the coming months. Much like Grantland, which ESPN launched in 2011, the site will retain an independent brand sensibility and editorial point-of-view, while interfacing with other websites in the ESPN and Disney families. The site will return to its original URL, www.FiveThirtyEight.com".[19]

According to Silver, the focus of FiveThirtyEight in its ESPN phase would broaden: "People also think it’s going to be a sports site with a little politics thrown in, or it’s going to be a politics site with sports thrown in.... But we take our science and economics and lifestyle coverage very seriously.... It’s a data journalism site. Politics is one topic that sometimes data journalism is good at covering. It’s certainly good with presidential elections. But we don’t really see politics as how the site is going to grow".[20]

FiveThirtyEight launched its ESPN webpage on March 17, 2014. The lead story by Nate Silver explained that "FiveThirtyEight is a data journalism organization.... We’ve expanded our staff from two full-time journalists to 20 and counting. Few of them will focus on politics exclusively; instead, our coverage will span five major subject areas – politics, economics, science, life and sports. Our team also has a broad set of skills and experience in methods that fall under the rubric of data journalism. These include statistical analysis, but also data visualization, computer programming and data-literate reporting. So in addition to written stories, we’ll have interactive graphics and features".[538 2]

2008 U.S. elections

Methods

One unique aspect of the site is Silver's efforts to rank pollsters by accuracy, weight their polls accordingly, and then supplement those polls with his own electoral projections based on demographics and prior voting patterns. "I did think there was room for a more sophisticated way of handling these things," Silver said.[12][21]

FiveThirtyEight.com weighs pollsters' historical track records through a complex methodology[538 8] and assigns them values to indicate "Pollster-Introduced Error".

At base Silver's method is similar to other analysts' approaches to taking advantage of the multiple polls that are conducted within each state: he averaged the polling results. But especially in the early months of the election season polling in many states is sparse and episodic. The "average" of polls over an extended period (perhaps several weeks) would not reveal the true state of voter preferences at the present time, nor provide an accurate forecast of the future. One approach to this problem was followed by Pollster.com: if enough polls were available, it computed a locally weighted moving average or LOESS.

However, while adopting such an approach in his own analysis, Silver reasoned that there was additional information available in polls from "similar" states that might help to fill the gaps in information about the trends in a given state. Accordingly, he adapted an approach that he had previously used in his baseball forecasting: using nearest neighbor analysis he first identified "most similar states" and then factored into his electoral projections for a given state the polling information from "similar states". He carried this approach one step further by also factoring national polling trends into the estimates for a given state. Thus, his projections were not simply based on the polling trends in a given state.

Furthermore, a basic intuition that Silver drew from his analysis of the 2008 Democratic party primary elections was that the voting history of a state or Congressional district provided clues to current voting. This is what allowed him to beat all the pollsters in his forecasts in the Democratic primaries in North Carolina and Indiana, for example.[11] Using such information allowed Silver to come up with estimates of the vote preferences even in states for which there were few if any polls. For his general election projections for each state, in addition to relying on the available polls in a given state and "similar states," Silver estimated a "538 regression" using historical voting information along with demographic characteristics of the states to create an estimate that he treated as a separate poll (equivalent to the actually available polls from that state). This approach helped to stabilize his projections, because if there were few if any polls in a given state, the state forecast was largely determined by the 538 regression estimate.

In July 2008, the site began to report regular updates of projections of 2008 U.S. Senate races. Special procedures were developed relying on both polls and demographic analysis. The projections were updated on a weekly basis.[538 9]

Final projections of 2008 elections

In the final update of his presidential forecast model at midday of November 4, 2008, Silver projected a popular vote victory by 6.1 percentage points for Barack Obama and electoral vote totals of 349 (based on a probabilistic projection) or 353 (based on fixed projections of each state).[538 10] Obama won with 365 electoral college votes. Silver's predictions matched the actual results everywhere except in Indiana and the 2nd congressional district of Nebraska, which awards an electoral vote separately from the rest of the state. His projected national popular vote differential was below the actual figure of 7.2 points.

The forecasts for the Senate proved to be correct for every race. But the near stalemate in Minnesota led to a recount that was settled only on June 30, 2009. In Alaska, after a protracted counting of ballots, on November 19 Republican incumbent Ted Stevens conceded the seat to Democrat Mark Begich, an outcome that Silver had forecast on election day.[22] And in Georgia, a run-off election on December 2 led to the re-election of Republican Saxby Chambliss, a result that was also consistent with Silver's original projection.

After the 2008 U.S. election

Focus

During the first two months after the election, no major innovations in content were introduced. A substantial percentage of the articles focused on Senatorial races: the runoff in Georgia, won by Saxby Chambliss; recounts of votes in Alaska (won by Mark Begich), and Minnesota (Al Franken vs. Norm Coleman); and the appointments of Senatorial replacements in Colorado, New York, and Illinois.

After President Obama's inauguration, Sean Quinn reported that he was moving to Washington, D.C., to continue political writing from that locale.[538 11] On February 4, 2009, he became the first blogger to join the White House press corps.[538 12] After that time, however, he contributed only a handful of articles to FiveThirtyEight.com.

During the post-2008 election period Silver devoted attention to developing some tools for the analysis of forthcoming 2010 Congressional elections,[538 13][538 14] as well as discussing policy issues and the policy agenda for the Obama administration, especially economic policies.[538 15][538 16] He developed a list of 2010 Senate races in which he made monthly updates of predicted party turnover.[538 17]

Later, Silver adapted his methods to address a variety of issues of the day, including health care reform, climate change, unemployment, and popular support for same-sex marriage.[23] He wrote a series of columns investigating the credibility of polls by Georgia-based firm Strategic Vision, LLC. According to Silver's analysis, Strategic Vision's data displayed statistical anomalies that were inconsistent with random polling. Later, he uncovered indirect evidence that Strategic Vision may have gone as far as to fabricate the results of a citizenship survey taken by Oklahoma high school students.[24][538 18][538 19][538 20][538 21][538 22][25][a] FiveThirtyEight devoted more than a dozen articles to the Iranian presidential election in June 2009, assessing of the quality of the vote counting. International affairs columnist Renard Sexton began the series with an analysis of polling leading up to the election;[538 23] then posts by Silver, Andrew Gelman and Sexton analyzed the reported returns and political implications.[538 24]

FiveThirtyEight covered the November 3, 2009, elections in the United States in detail.[538 25][538 26] FiveThirtyEight writers Schaller, Gelman, and Silver also gave extensive coverage to the January 19, 2010 Massachusetts special election to the U.S. Senate. The "538 model" once again aggregated the disparate polls to correctly predict that the Republican Scott Brown would win.[538 27]

In spring of 2010, FiveThirtyEight turned a focus on the United Kingdom General Election scheduled for May 6, with a series of more than forty articles on the subject that culminated in projections of the number of seats that the three major parties were expected to win.[538 28] Following a number of preview posts in January,[538 29] and February,[538 30] Renard Sexton examined subjects such as the UK polling industry[538 31][538 32][538 33] and the 'surge' of the third-party Liberal Democrats,[538 34] while Silver, Sexton and Dan Berman[b] developed a seat projection model. The UK election was the first time the FiveThirtyEight team did an election night 'liveblog' of a non-US election.[538 35]

In April 2010, the Guardian Newspaper published Silver's predictions for the 2010 United Kingdom General Election. The majority of polling organisations in the UK use the concept of uniform swing to predict the outcome of elections. However, by applying his own methodology, Silver produced very different results, which suggested that a Conservative victory might have been the most likely outcome.[27] After a series of articles, including critiques and responses to other electoral analysts, his "final projection" was published on the eve of the election.[538 36] In the end, Silver's projections were off the mark, particularly compared with those of some other organizations, and Silver wrote a post mortem on his blog.[538 37] Silver examined the pitfalls of the forecasting process,[538 37] while Sexton discussed the final government agreement between the Conservatives and the Liberal Democrats.[538 38]

Controversy over transparency in pollster ratings

On June 6, 2010, FiveThirtyEight posted pollster rankings that updated and elaborated Silver's efforts from the 2008 election. Silver expanded the database to more than 4,700 election polls and developed a model for rating the polls that was more sophisticated than his original rankings.[538 39][28]

Silver responded on 538: "Where's the transparency? Well, it's here [citing his June 6 article], in an article that contains 4,807 words and 18 footnotes. Every detail of how the pollster ratings are calculated is explained. It's also here [referring to another article], in the form of Pollster Scorecards, a feature which we'll continue to roll out over the coming weeks for each of the major polling firms, and which will explain in some detail how we arrive at the particular rating that we did for each one".[538 40]

As for why the complete 538 polling database had not been released publicly, Silver responded: "The principal reason is because I don't know that I'm legally entitled to do so. The polling database was compiled from approximately eight or ten distinct data sources, which were disclosed in a comment which I posted shortly after the pollster ratings were released, and which are detailed again at the end of this article. These include some subscription services, and others from websites that are direct competitors of this one. Although polls contained in these databases are ultimately a matter of the public record and clearly we feel as though we have every right to use them for research purposes, I don't know what rights we might have to re-publish their data in full".

Silver also commented on the fact that the 538 ratings had contributed to Markos Moulitsas's decision to end Daily Kos's use of Research 2000 as its pollster.[29]

Subsequently, on June 11, Mark Blumenthal also commented on the question of transparency in an article in the National Journal titled "Transparency In Rating: Nate Silver's Impressive Ranking Of Pollsters' Accuracy Is Less Impressive In Making Clear What Data Is Used".[30] He noted that in the case of Research 2000 there were some discrepancies between what Silver reported and what the pollster itself reported. Other researchers questioned aspects of the methodology.[31]

On June 16, 2010, Silver announced on his blog that he is willing to give all pollsters who he had included in his rating a list of their polls that he had in his archive, along with the key information that he used (poll marginals, sample size, dates of administration); and he encouraged the pollsters to examine the lists and the results to compare them with the pollster's own record and make corrections.[538 41]

In September 2014, Silver put into the public domain all of his pollster ratings,[538 42] as well as descriptive summary data for all of the more than 6,600 polls in his data collection for the final three weeks of U.S. Presidential primaries and general elections, state governor elections, and U.S. Senate and U.S. Congress elections for the years 1998–2012.[32] In addition to updating his pollster ratings, he published an updated methodological report.[538 43]

Partnership with The New York Times: 2010–2013

On June 3, 2010, The New York Times and Silver announced that FiveThirtyEight had formed a partnership under which the blog would be hosted by the Times for a period of three years.[33] In legal terms, FiveThirtyEight granted a "license" to the Times to publish the blog. The blog would be listed under the "Politics" tab of the News section of the Times.[34] FiveThirtyEight would thus be subject to and benefit from editing and technical production by the Times, while FiveThirtyEight would be responsible for creating the content.

Silver received bids from several major media entities before selecting the Times.[34][35] Under terms of the agreement, Silver would also write monthly articles for the print version of both the newspaper and the Sunday magazine.[538 6] Silver did not move his blog to the highest bidder, because he was concerned with maintaining his own voice while gaining the exposure and technical support that a larger media company could provide. "There's a bit of a Groucho Marx quality to it [Silver has said].... You shouldn't want to belong to any media brand that seems desperate to have you as a member, even though they'll probably offer the most cash".[36]

The first column of the renamed FiveThirtyEight: Nate Silver's Political Calculus appeared in The Times on August 25, 2010, with the introduction of U.S. Senate election forecasts. At the same time, Silver published a brief history of the blog.[538 44] All columns from the original FiveThirtyEight.com were also archived for public access.[37]

Shortly after 538 relocated to The New York Times, Silver introduced his prediction models for the 2010 elections to the U.S. Senate, the U.S. House of Representatives, and state Governorships. Each of these models relied initially on a combination of electoral history, demographics, and polling. The 538 model had forecast a net pickup of 8 seats by the Republicans in the Senate and 55 seats in the House, close to the actual outcome of a pickup of 6 seats in the Senate and 63 seats in the House.[538 45]

Writers

When the transition to The New York Times was announced, Silver listed his staff of writers for the first time.[37] However, of the seven listed writers, only three of them had published on 538/New York Times by late December 2010: Silver, Renard Sexton and Hale Stewart. Andrew Gelman contributed again in early 2011.[538 46] Brian McCabe published his first article in January 2011.[538 47][c]

Beginning in 2011, one writer who emerged as a regular contributor was Micah Cohen. Cohen provided a periodic "Reads and Reactions" column in which he summarized Silver's articles for the previous couple of weeks, as well as reactions to them in the media and other blogs, and suggested some additional readings related to the subject of Silver's columns. Silver identified Cohen as "my news assistant".[538 48] Cohen also contributed additional columns on occasion.[538 49]

On September 12, 2011, Silver introduced another writer: "FiveThirtyEight extends a hearty welcome to John Sides, a political scientist at George Washington University, who will be writing a series of posts for this site over the next month. Mr. Sides is also the founder of the blog The Monkey Cage,[39] which was named the 2010 Blog of the Year by The Week magazine".[538 50]

In 2016, Columbia Journalism Review published information on Harry J. Enten and identified him as the "whiz kid" of FiveThirtyEight and an example of a new generation of political journalists who are very analytical and data-based.[40]

Beyond electoral politics

While politics and elections remained the main focus of FiveThirtyEight, the blog also sometimes addressed sports, including the March Madness[538 51][538 52][41] and the 2012 NCAA Men's Basketball tournament selection process,[538 53] the B.C.S. rankings in NCAA college football,[42] the NBA,[538 54][538 55][538 56] and Major League Baseball matters ranging from the 2011 attendance at the New York Mets' Citi Field[538 57] to the historic 2011 collapse of the Boston Red Sox.[538 58]

In addition, FiveThirtyEight sometimes turned its attention to other topics, such as the economics of blogging,[538 59] the financial ratings by Standard & Poors,[538 60] economists' tendency to underpredict unemployment levels,[538 61] and the economic impact and media coverage of Hurricane Irene (2011).[538 62][538 63]

Occupy-wall-st-vs-tea-party.png
Adapted from a FiveThirtyEight October 2011 graph published in the New York Times.[538 64]

FiveThirtyEight published a graph showing different growth curves of the news stories covering Tea Party and Occupy Wall Street protests. Silver pointed out that conflicts with the police caused the sharpest increases in news coverage of the protests.[538 64] And he assessed the geography of the protests by analyzing news reports of the size and location of events across the United States.[538 65]

2012 U.S. elections

FiveThirtyEight rolled out the first iteration of its 2012 general election forecasting model on June 7, 2012. The model forecasts both the popular vote and the electoral college vote, with the latter being central to the exercise and involving a forecast of the electoral outcome in each state. In the initial forecast, Barack Obama was estimated to have a 61.8% chance of winning the electoral vote in November 2012. The website provided maps and statistics about the electoral outcomes in each state as well as nationally. Later posts addressed methodological issues such as the "house effects" of different pollsters as well as the validity of telephone surveys that did not call cell phones.[538 66]

From the middle of 2012 until election day, the FiveThirtyEight model updated its estimates of the probability that Barack Obama and Mitt Romney would win a majority of the electoral votes. On election day, November 6, Silver posted his final forecast for each state. On the morning of the November 6, 2012 presidential election, Silver's model gave President Barack Obama a 90.9% chance of winning a majority of the electoral votes.[538 67] At the end of that day, after the ballots had been counted, the 538 model had correctly predicted the winner of all 50 states and the District of Columbia.[43][d] Silver, along with at least two academic-based analysts who aggregated polls from multiple pollsters, thus got not only all 50 state predictions right, but also all 9 of the "swing states".[44] In contrast, individual pollsters were less successful. For example, Rasmussen Reports "missed on six of its nine swing-state polls".[45]

An independent analysis of Silver's state-by-state projections, assessing whether the percentages of votes that the candidates actually received fell within the "margin of error" of Silver's forecasts, found that "Forty-eight out of 50 states actually fell within his margin of error, giving him a success rate of 96 percent. And assuming that his projected margin of error figures represent 95 percent confidence intervals, which it is likely they did, Silver performed just about exactly as well as he would expect to over 50 trials. Wizard, indeed".[46][47] Additional tests of the accuracy of the electoral vote predictions were published by other researchers.[48][49]

Under ESPN ownership

FiveThirtyEight launched its ESPN-owned stage on March 17, 2014. As of July, it had a staff of 20 writers, editors, data visualization specialists, and others.[538 68] By March 2016, this staff had nearly doubled to 37 listed on the masthead, and 7 listed as contributors.[50] The site produced articles under 5 headings: politics, economics, science and health, (cultural) life, and sports. In addition to feature articles it produced podcasts on a range of subjects.

Monthly traffic to the site grew steadily from about 2.8 million unique visitors in April 2014 to 10.7 million unique visitors in January 2016.[51]

2014 U.S. elections

On September 3, 2014, FiveThirtyEight introduced its forecasts for each of the 36 U.S. Senate elections being contested that year.[538 69] At that time, the Republican Party was given a 64 percent chance of holding a majority of the seats in the Senate after the election. However, FiveThirtyEight editor Nate Silver also remarked, "An equally important theme is the high degree of uncertainty around that outcome. A large number of states remain competitive, and Democrats could easily retain the Senate".[538 70] About two weeks later, the forecast showed the Republican chances of holding the majority down to 55 percent.[538 71]

2016 Oscars predictions

FiveThirtyEight sought to apply its mathematical models to the Oscars, and produced internal predictions regarding the subject, guessing four out of six categories correctly.[52] The website also compiled a list of other predictions made by other people using different methods.[53]

2016 U.S. elections

Presidential primary elections

FiveThirtyEight applied two separate models to forecast the 2016 Presidential Primary elections – Polls-Only and Polls-Plus models. The polls-only model relied only on polls from a particular state, while the polls-plus model was based on state polls, national polls and endorsements. For each contest, FiveThirtyEight produced probability distributions and average expected vote shares per both of these models.[54]

As early as June 2015, FiveThirtyEight argued that Donald Trump "isn't a real candidate"[55] and maintained that Trump could not win the nomination, until late in the election season.[56] When Donald Trump became the presumptive Republican nominee in May 2016, New York Times media columnist Jim Rutenberg wrote that "predictions can have consequences" and criticized FiveThirtyEight for underestimating Trump's chances. He argued that by giving "Mr. Trump a 2 percent chance at the nomination despite strong polls in his favor...they also arguably sapped the journalistic will to scour his record as aggressively as those of his supposedly more serious rivals".[57]

In a long retrospective "How I Acted Like A Pundit And Screwed Up On Donald Trump," published in May 2016 after Trump had become the likely nominee, Silver reviewed how he had erred in evaluating Trump's chances early in the primary campaign. Silver wrote, "The big mistake is a curious one for a website that focuses on statistics. Unlike virtually every other forecast we publish at FiveThirtyEight – including the primary and caucus projections I just mentioned – our early estimates of Trump’s chances weren’t based on a statistical model. Instead, they were what we [call] 'subjective odds' – which is to say, educated guesses. In other words, we were basically acting like pundits, but attaching numbers to our estimates. And we succumbed to some of the same biases that pundits often suffer, such as not changing our minds quickly enough in the face of new evidence. Without a model as a fortification, we found ourselves rambling around the countryside like all the other pundit-barbarians, randomly setting fire to things".[58]

On the Democratic side, FiveThirtyEight argued that Sen. Bernie Sanders could "lose everywhere else after Iowa and New Hampshire" [59] and that the "Democratic establishment would rush in to squash" him if he does not.[60]

Fairness and Accuracy in Reporting, a progressive nonprofit media watch group, wrote in May 2016 that FiveThirtyEight "sacrificed its integrity to go after Sanders" and that they have "at times gone beyond the realm of punditry into the realm of hackery – that is, not just treating their own opinions as though they were objective data, but spinning the data so that it conforms to their opinions."[61]

FiveThirtyEight's predictions for each state primary, both for the Republican and the Democratic party nominations, were based on statistical analysis, not on the analyst's opinions. The core data employed were polls, which FiveThirtyEight aggregated for each state (while also considering national polls) using essentially the same method it had employed since 2008. In the 2016 primaries, the projections also took into account endorsements.[62] The website also kept track of the accumulation of national party convention delegates.[63] In a comparison of prediction success published by Bloomberg News after the primary season was completed, FiveThirtyEight's prediction success tied for the highest percentage of correct primary poll winners, at 92%; but it lagged behind PredictWise in predicting a larger set of primaries.[64] Notably, even with FiveThirtyEight's track record of correctly predicting elections that pollsters get wrong, it still missed Bernie Sanders's upset victory in the Michigan primary, for instance, regarded as the 'one of the biggest upsets in modern political history'.[61]

Presidential general election

The final prediction by FiveThirtyEight on the morning of election day (November 8, 2016) was at 10:41AM and had Hillary Clinton with a 71% chance to win the 2016 United States presidential election.[65] while other major forecasters had predicted Clinton to win with at least an 85% to 99% probability.[66][67] FiveThirtyEight's model pointed the possibility of an Electoral College-popular vote split widening in final weeks based on both Clinton's small lead in general polls, but also on Trump's improvement in swing states like Florida or Pennsylvania, mixed with Clinton's poor performing in several of those swing states in comparison with Obama's performing in 2012.[68] The main issues pointed by the forecast model was the unbalance of Clinton's improvement in very populated states like Texas, Georgia (projected safe for Republican) and California (projected safe for Democrats);[68] mixed with her inability to attract white voters without a college degree, an increasing demographic in swing states, in addition to a potential decline in turnout from minorities.[69] In consequence, Clinton's probabilities to win the Electoral College were not improving.[68] Nate Silver also focused on state by state numbers in considered 'must-win' states like Ohio and Florida, plus a consideration of polls' margin of error in advantages of less than three points.[70]

Donald Trump won the election. FiveThirtyEight projected a much higher probability of Donald Trump winning the presidency than other pollsters,[66] a projection which was criticized by Ryan Grim of the Huffington Post as "unskewing" too much in favor of Trump.[71] And while FiveThirtyEight expressed that "nonetheless, Clinton is probably going to win, and she could win by a big margin", the forecaster also made a point about the unreliability of poll trackers in some cases, about a considerable number of undecided voters and about the unpredictable outcome in traditional swing states.[72]

Recognition and awards

  • In September 2008, FiveThirtyEight became the first blog ever selected as a Notable Narrative by the Nieman Foundation for Journalism at Harvard University. According to the Foundation, "In his posts, former economic analyst and baseball-stats wunderkind Nate Silver explains the presidential race, using the dramatic tension inherent in the run-up to Election Day to drive his narrative. Come November 5, we will have a winner and a loser, but in the meantime, Silver spins his story from the myriad polls that confound us lesser mortals".[73]
  • The New York Times described FiveThirtyEight.com in November 2008 as "one of the breakout online stars of the year".[15]
  • Huffington Post columnist Jason Linkins named FiveThirtyEight.com as No. 1 of "Ten Things that Managed to Not Suck in 2008, Media Edition".[74]
  • FiveThirtyEight.com is the 2008 Weblog Award Winner for "Best Political Coverage".[75]
  • FiveThirtyEight.com earned a 2009 "Bloggie" as the "Best Weblog about Politics" in the 9th Annual Weblog Awards.[76]
  • In April 2009, Silver was named "Blogger of the Year" in the 6th Annual Opinion Awards of The Week, for his work on FiveThirtyEight.com.[77]
  • In September 2009, FiveThirtyEight.com's predictive model was featured as the cover story in STATS: The Magazine for Students of Statistics.[21]
  • In November 2009, FiveThirtyEight.com was named one of "Our Favorite Blogs of 2009" ("Fifty blogs we just can't get enough of") by PC Magazine.[78]
  • In December 2009, FiveThirtyEight was recognized by The New York Times Magazine in its "Ninth Annual Year in Ideas" for conducting "Forensic Polling Analysis" detective work on the possible falsification of polling data by a major polling firm.[79][e]
  • In November 2010, Editor-in-Chief of Politico John F. Harris, writing in Forbes magazine, listed Silver as one of seven bloggers among "The Most Powerful People on Earth".[81]
  • In June 2011, Time's "The Best Blogs of 2011" named FiveThirtyEight one of its Essential Blogs.[82]
  • May 2012: FiveThirtyEight won a Webby Award for "Best Political Blog" from the International Academy of Digital Arts and Sciences in the 16th annual Webby Awards.[83]
  • April 2013: FiveThirtyEight won a Webby Award for "Best Political Blog" from the International Academy of Digital Arts and Sciences in the 17th annual Webby Awards.[84]
  • June 2016: FiveThirtyEight was named the "Data Journalism Website of the Year" for 2016 by the Global Editors Network, a Paris-based organization that promotes innovation in newsrooms around the world. FiveThirtyEight won an additional award for "News Data App of the Year (large newsroom)" for “Swing the Election,” an interactive project by Aaron Bycoffe and David Wasserman.[85]

See also

Notes

  1. ^ Several national firms use the name "Strategic Vision"; only one has been releasing political polling results to the media.
  2. ^ Berman first worked with FiveThirtyEight.com when he made some provocative discoveries of anomalies in the reported results of the 2009 Election in Iran.[26]
  3. ^ Why other writers played only a limited role in FiveThirtyEight/NYT was explained in February 2011 in an article in Poynter.[38]
  4. ^ Although Silver put a "toss-up" tag on the presidential election in Florida, his interactive electoral map on the website painted the state light blue and stated that there was a 50.3% probability that Obama would win a plurality of the state's votes.
  5. ^ The first of a series of articles challenged Strategic Vision LLC to reveal key information.[80]

References

General citations

  1. ^ "fivethirtyeight.com Site Overview". Alexa Internet. Retrieved July 1, 2017.
  2. ^ "FiveThirtyEight.com WHOIS, DNS, & Domain Info – DomainTools". WHOIS. Retrieved September 3, 2016.
  3. ^ "Nate Silver joins ESPN in multifaceted role". ESPN.com.
  4. ^ Andrew Romano,"Making His Pitches: Nate Silver, an all-star in the world of baseball stats, may be the political arena's next big draw," Newsweek, June 16, 2008.
  5. ^ "FAQ and Statement of Methodology FiveThirtyEight.com". FiveThirtyEight.com. June 9, 2008. Retrieved June 19, 2008.
  6. ^ "Hillary Clinton has 81% chance of defeating Trump, Nate Silver predicts". The Guardian. June 29, 2016.
  7. ^ a b "Poblano's Profile". Daily Kos. Retrieved April 26, 2015.
  8. ^ "Mo. Parents Clueless About Kerry". Daily Kos.
  9. ^ "Daily Kos: State of the Nation". Archived from the original on February 8, 2008.
  10. ^ "Obama’s Path to Victory". The New York Times. February 11, 2008.
  11. ^ a b Blumenthal, Mark (May 8, 2008). "The Poblano Model". National Journal. Retrieved April 26, 2015.
  12. ^ a b Bialik, Carl (June 2, 2008). "Baseball Analyst Draws Fans by Crunching Election Numbers". The Wall Street Journal. Retrieved June 19, 2008.
  13. ^ "Rasmussen Reports to Partner with FiveThirtyEight.com".
  14. ^ "Today's Polls: The Bounce hits the Badger State – The Plank". Archived from the original on June 14, 2008.
  15. ^ a b Clifford, Stephanie (November 9, 2008). "Finding Fame With a Prescient Call for Obama". The New York Times. Retrieved April 26, 2015.
  16. ^ "The New York Times Will Incorporate the Blog FiveThirtyEight into the Politics Section of NYTimes.com". MarketWatch.
  17. ^ "Times to Host Blog on Politics and Polls". The New York Times. June 4, 2010.
  18. ^ "Nate Silver of FiveThirtyEight Blog Is to Join ESPN Staff". The New York Times. July 20, 2013.
  19. ^ Amy Phillips (July 22, 2013). "Nate Silver – Renowned Statistician, Author and Founder of FiveThirtyEight – Joins ESPN in Multi-Faceted Role". ESPN Front Row.
  20. ^ "Nate Silver Interview: The New FiveThirtyEight – NYMag". Daily Intelligencer.
  21. ^ a b Felder, Adam (September 2009). "Case study: The FiveThirtyEight.com Predictive Model of the 2008 Presidential Election" (PDF). STATS (50). pp. 3–9. ISSN 1053-8607. Retrieved April 26, 2015.
  22. ^ "Stevens concedes Alaska Senate race".
  23. ^ "Interview with Nate Silver". Financial Times.
  24. ^ "Polling Firm’s Reprimand Rattles News Media". The New York Times. October 3, 2009.
  25. ^ "Polling Controversy Raises Questions of Disclosure". Archived from the original on February 7, 2016. Retrieved February 7, 2016.
  26. ^ "Statistics wizard from Winchester makes a splash in Iran election - The Boston Globe".
  27. ^ Burkeman, Oliver (April 27, 2010). "Baseball nerd who predicted Obama's win foresees Labour meltdown". The Guardian. London. Retrieved May 19, 2010..
  28. ^ "Where's the Transparency in Pollster Ratings?". Archived from the original on June 12, 2010.
  29. ^ "Polling". Daily Kos.
  30. ^ "Transparency In Rating". National Journal Online. Archived from the original on June 14, 2010.
  31. ^ "Pollster.com".
  32. ^ pollster-ratings on GitHub
  33. ^ Brian Stelter (June 3, 2010). "The Times to Host Political Polling Site FiveThirtyEight". Media Decoder Blog. Archived from the original on September 9, 2015.
  34. ^ a b Garber, Megan (June 3, 2010). "Articles of incorporation: Nate Silver and Jim Roberts on the NYT’s absorption of FiveThirtyEight". NiemanLab. Harvard College. Retrieved October 16, 2016.
  35. ^ "FiveThirtyEight blog gets with the Times". NY Daily News. June 8, 2010.
  36. ^ "News Trends Tilt Toward Niche Sites". The New York Times. September 12, 2011.
  37. ^ a b "About FiveThirtyEight". Archived from the original on March 18, 2014.
  38. ^ "FiveThirtyEight’s Nate Silver adjusts to New York Times, 6 months after joining the newsroom". Poynter.
  39. ^ "The Monkey Cage". The Monkey Cage.
  40. ^ Vernon, Peter, FiveThirtyEight’s ‘Whiz Kid’ Harry Enten represents the new generation of political journalist, Columbia Journalism Review, Wednesday, October 5, 2016
  41. ^ "Nate Silver's Tournament Forecast". The New York Times. March 18, 2013.
  42. ^ Silver, Nate (August 27, 2011). "Popularity and Pedigree Matter in the B.C.S.".
  43. ^ "Obama's win a big vindication for Nate Silver, king of the quants". CNET. CBS Interactive. November 7, 2012.
  44. ^ "Pollster Predictive Performance, 51 out of 51". The Huffington Post. November 7, 2012.
  45. ^ Jonathan D. Salant and Laura Curtis. "Nate Silver-Led Statistics Men Crush Pundits in Election". Businessweek.com. Archived from the original on November 8, 2012.
  46. ^ "Nobody's perfect: Nate Silver and the imperfect art of prediction (UPDATE)". Boston.com.
  47. ^ "538's Uncertainty Estimates Are As Good As They Get".
  48. ^ "Was Nate Silver the Most Accurate 2012 Election Pundit?". CFAR.
  49. ^ "2012 Presidential prediction rankings". Retrieved November 12, 2012.
  50. ^ "Masthead".
  51. ^ Tweet by @NateSilver538 on February 3, 2016, https://twitter.com/NateSilver538/status/694974558831525888/photo/1
  52. ^ McCann, Allison (February 5, 2016). "The 2016 Oscars Race".
  53. ^ "Every Oscar Prediction We Could Find". February 26, 2016.
  54. ^ "How We’re Forecasting The Primaries". January 12, 2016.
  55. ^ "Why Donald Trump Isn’t A Real Candidate, In One Chart". June 16, 2015.
  56. ^ "Trump Is The Weakest GOP Front-Runner In The Modern Era". April 11, 2016.
  57. ^ "The Republican Horse Race Is Over, and Journalism Lost". The New York Times. May 9, 2016.
  58. ^ Nate Silver, "How I Acted Like A Pundit And Screwed Up On Donald Trump: Trump’s nomination shows the need for a more rigorous approach," FiveThirtyEight.com, May 18, 2016. [1]
  59. ^ "Bernie Sanders Could Win Iowa And New Hampshire. Then Lose Everywhere Else.". July 8, 2015.
  60. ^ "What To Make Of The Bernie Sanders Surge". June 17, 2015.
  61. ^ a b "538 Sacrifices Integrity to Go After Sanders on Independents". May 29, 2016.
  62. ^ Nate Silver, "How We're Forecasting the Primaries," FiveThirtyEight, January 12, 2016 [2].
  63. ^ Aaron Bycoffe and David Wasserman, "Who's On Track for the Nomination?" FiveThirtyEight, June 15, 2016 [3].
  64. ^ Andre Tartar, "Ranking the 2016 Presidential Primary Polls and Predictions," Bloomberg News, June 29, 2016
  65. ^ Silver, Nate. "Final Election Update: There’s A Wide Range Of Outcomes, And Most Of Them Come Up Clinton". FiveThirtyEight. Retrieved November 9, 2016.
  66. ^ a b Why FiveThirtyEight Gave Trump A Better Chance Than Almost Anyone Else; FiveThirtyEight; Nate Silver; November 11, 2016
  67. ^ Allen, Kate (November 9, 2016). "Nate Silver's FiveThirtyEight proves its worth with another close election prediction". Toronto Star. Retrieved November 10, 2016.
  68. ^ a b c "The Odds Of An Electoral College-Popular Vote Split Are Increasing". November 1, 2016.
  69. ^ Wasserman, David (September 15, 2016). "How Trump Could Win The White House While Losing The Popular Vote".
  70. ^ "Election Update: Don’t Ignore The Polls — Clinton Leads, But It’s A Close Race". November 6, 2016.
  71. ^ Nate Silver Is Unskewing Polls — All Of Them — In Trump’s Direction; Huffington Post; Ryan Grim; November 5, 2016
  72. ^ "Final Election Update: There’s A Wide Range Of Outcomes, And Most Of Them Come Up Clinton". November 8, 2016.
  73. ^ "Electoral Projections Done Right".
  74. ^ "2008: The Year In Media Highlights". The Huffington Post. January 24, 2009.
  75. ^ "The 2008 Weblog Awards Winners".
  76. ^ "Ninth Annual Weblog Awards: The 2009 Bloggies".
  77. ^ "THE WEEK Opinion Awards". Archived from the original on January 10, 2010.
  78. ^ "Our Favorite Blogs 2009". PCMAG.
  79. ^ Shea, Christopher. "The Ninth Annual Year in Ideas – Forensic Polling Analysis". www.nytimes.com. Retrieved October 13, 2016.
  80. ^ "A Few More Questions for a Sketchy Pollster". FiveThirtyEight.
  81. ^ John F. Harris (November 3, 2010). "My Picks: Bloggers". Forbes.
  82. ^ "Five Thirty Eight – TIME's 25 Best Blogs of 2011". TIME.com. June 6, 2011.
  83. ^ "The Webby Awards". Archived from the original on August 20, 2012.
  84. ^ "Blog – Political".
  85. ^ David Firestone, "We Won Some Prizes," FiveThirtyEight.com, June 16, 2016.

FiveThirtyEight articles

  1. ^ Silver, Nate (August 7, 2008). "Frequently Asked Questions". FiveThirtyEight.com. Retrieved April 26, 2015.
  2. ^ a b "What the Fox Knows". FiveThirtyEight.
  3. ^ "No, I’m not Chuck Todd". FiveThirtyEight.
  4. ^ Quinn, Sean (October 3, 2008). "On the Road: St. Louis County, Missouri". FiveThirtyEight.com.
  5. ^ Quinn, Sean (November 3, 2008). "Site Note". FiveThirtyEight.com.
  6. ^ a b Silver, Nate (June 3, 2010). "FiveThirtyEight to Partner with New York Times". FiveThirtyEight.com. Retrieved June 3, 2010.
  7. ^ Silver, Nate (August 25, 2010). "New Forecast Shows Democrats Losing 6 to 7 Senate Seats". FiveThirtyEight. Retrieved April 26, 2015.
  8. ^ "Pollster Ratings v3.0". FiveThirtyEight.
  9. ^ Silver, Nate. "Senate Forecast, 7/18: Republican Outlook Improves with Focus on Likely Voter Polls". FiveThirtyEight. Archived from the original on January 23, 2013. Retrieved March 28, 2017.
  10. ^ "Today’s Polls and Final Election Projection: Obama 349, McCain 189". FiveThirtyEight.
  11. ^ "The End of the Beginning". FiveThirtyEight.
  12. ^ "Obama Hits the Road to Sell Stimulus, Steps Up Pressure on Key Senators". FiveThirtyEight.
  13. ^ "Appointed Senators Rarely Win Re-Election". FiveThirtyEight.
  14. ^ "Daddy, Where Do Senators Come From?". FiveThirtyEight.
  15. ^ "Obama’s Agenda & The Difference Between Tactics & Strategy". FiveThirtyEight.
  16. ^ "What Are the Chances of a Depression?". FiveThirtyEight.
  17. ^ "Senate Rankings, January 2009 Edition". FiveThirtyEight.
  18. ^ "Are Oklahoma Students Really This Dumb? Or Is Strategic Vision Really This Stupid?". FiveThirtyEight.
  19. ^ "Real Oklahoma Students Ace Citizenship Exam; Strategic Vision Survey Was Likely Fabricated". FiveThirtyEight.
  20. ^ "Strategic Vision Polls Exhibit Unusual Patterns, Possibly Indicating Fraud". FiveThirtyEight.
  21. ^ "An Open Letter to Strategic Vision CEO David Johnson". FiveThirtyEight.
  22. ^ "Skipping Elections, Strategic Vision Has Not Polled Since Controversy Arose". FiveThirtyEight.
  23. ^ "Polling and Voting in Iran’s Friday Election". FiveThirtyEight.
  24. ^ "All posts tagged "Iran"". FiveThirtyEight. Retrieved April 26, 2015.
  25. ^ "Election Night Overview". FiveThirtyEight.
  26. ^ "Independent Voters and Empty Explanations". FiveThirtyEight.
  27. ^ "538 Model Posits Brown as 3:1 Favorite". FiveThirtyEight.
  28. ^ "UK Seats Projection: Tories 299, Labour 199, LibDems 120". FiveThirtyEight.
  29. ^ "A Hung Parliament? (From the Gallows, Perhaps?)". FiveThirtyEight.
  30. ^ "Instant Run-Off Proposed by Brown". FiveThirtyEight.
  31. ^ "Getting It "Right" on the UK Numbers". FiveThirtyEight.
  32. ^ "Selection bias in UK polling (Part 1): Cell phones". FiveThirtyEight.
  33. ^ "Selection Bias in UK Polling (Part 2): Internet Polling". FiveThirtyEight.
  34. ^ "Is the Lib Dem Surge for Real (Part 4: The meltdown)". FiveThirtyEight.
  35. ^ Silver, Nate; Sexton, Renard; Berman, Dan; Dollar, Thomas (May 6, 2010). "Liveblog: UK Election Returns". FiveThirtyEight. Retrieved April 26, 2015.
  36. ^ "Final UK Projection: Conservatives 312, Labour 204, LibDems 103". FiveThirtyEight.
  37. ^ a b Silver, Nate (May 11, 2010). "U.K. Forecasting Retrospective". FiveThirtyEight. Retrieved April 26, 2015.
  38. ^ "Con-Lib Pact Brings Cameron to PM’s Chair". FiveThirtyEight.
  39. ^ "Pollster Ratings v4.0: Results". FiveThirtyEight.
  40. ^ "On Transparency, Hypocrisy, and Research 2000". FiveThirtyEight.
  41. ^ "FiveThirtyEight Establishes Process for Pollsters to Review its Database of Their Polls". FiveThirtyEight.
  42. ^ "FiveThirtyEight’s Pollster Ratings". FiveThirtyEight.
  43. ^ "How FiveThirtyEight Calculates Pollster Ratings". FiveThirtyEight.
  44. ^ Nate Silver (August 25, 2010). "Welcome (and Welcome Back) to FiveThirtyEight". FiveThirtyEight. Archived from the original on September 7, 2015.
  45. ^ Micah Cohen (December 10, 2010). "38 Days Later". FiveThirtyEight. Archived from the original on October 11, 2014.
  46. ^ Andrew Gelman (January 3, 2011). "All Politics Is Local? The Debate and the Graphs". FiveThirtyEight. Archived from the original on March 21, 2015.
  47. ^ Brian J. McCabe (January 19, 2011). "Grading New York Restaurants: What's in an 'A'?". FiveThirtyEight. Archived from the original on May 26, 2015.
  48. ^ Nate Silver (October 10, 2011). "New Hampshire's Contrarian Streak". FiveThirtyEight. Archived from the original on September 11, 2015.
  49. ^ Micah Cohen (September 23, 2011). "A Look at PolitiFact Grades of Candidates". FiveThirtyEight. Archived from the original on September 10, 2015.
  50. ^ John Sides (September 12, 2011). "Social Status and How the Elected Vote". FiveThirtyEight. Archived from the original on September 6, 2015.
  51. ^ Silver, Nate (March 28, 2011). "In Tournament of Upsets, V.C.U. Has Overcome Longest Odds". FiveThirtyEight.
  52. ^ Silver, Nate (March 18, 2003). "Parity in N.C.A.A. Means No Commanding Favorite". FiveThirtyEight.
  53. ^ Silver, Nate (March 13, 2012). "FiveThirtyEight Picks the N.C.A.A. Bracket". FiveThirtyEight.
  54. ^ Silver, Nate (February 22, 2011). "Deal for Anthony May Limit Knicks' Upside". FiveThirtyEight.
  55. ^ "Calling Foul on N.B.A.'s Claims of Financial Distress". FiveThirtyEight. July 5, 2011.
  56. ^ "Jeremy Lin Is No Fluke". FiveThirtyEight. February 11, 2012.
  57. ^ Silver, Nate (May 31, 2011). "As Mets' Image Slumps, So Does Attendance". FiveThirtyEight.
  58. ^ Silver, Nate (September 27, 2011). "September Collapse of Red Sox Could Be Worst Ever". FiveThirtyEight.
  59. ^ Nate Silver (February 12, 2011). "The Economics of Blogging and The Huffington Post". FiveThirtyEight. Archived from the original on December 10, 2015.
  60. ^ Nate Silver (August 8, 2011). "Why S.&P.'s Ratings Are Substandard and Porous". FiveThirtyEight. Archived from the original on September 8, 2015.
  61. ^ Nate Silver (September 6, 2011). "In Jobs Data, 'Surprises' Mean Bad News". FiveThirtyEight. Archived from the original on September 6, 2015.
  62. ^ Nate Silver (August 26, 2011). "A New York Hurricane Could Be a Multibillion-Dollar Catastrophe". FiveThirtyEight. Archived from the original on September 6, 2015.
  63. ^ Nate Silver (August 29, 2011). "How Irene Lived Up to the Hype". FiveThirtyEight. Archived from the original on September 6, 2015.
  64. ^ a b Silver, Nate (October 7, 2011). "Police Clashes Spur Coverage of Wall Street Protests". FiveThirtyEight. Retrieved April 26, 2015.
  65. ^ Nate Silver (October 17, 2011). "The Geography of Occupying Wall Street (and Everywhere Else)". FiveThirtyEight. Archived from the original on May 9, 2015.
  66. ^ Nate Silver (June 22, 2012). "Calculating 'House Effects' of Polling Firms". FiveThirtyEight. Archived from the original on September 6, 2015.
  67. ^ "FiveThirtyEight blog". The New York Times. Retrieved April 26, 2015.
  68. ^ "Masthead". FiverThirtyEight. Retrieved April 26, 2015.
  69. ^ "2014 Senate Forecast". FiveThirtyEight. Retrieved April 26, 2015.
  70. ^ "FiveThirtyEight’s Senate Model Is Back And It Gives Republicans The Edge". FiveThirtyEight.
  71. ^ "Senate Update: Democrats Draw Almost Even. Is It The Money?". FiveThirtyEight.

Further reading

External links

Content from Wikipedia