“I know a lot of the national reporters say we’re going to finish last and lose a lot of games again. You know what? Oakland was supposed to be last [in the division] last year, Baltimore was supposed to be last, and they both ended up making the playoffs.” —Astros GM Jeff Luhnow, February 5.

Sometime between now and Opening Day—if you haven’t already—you’ll probably hear someone speculate about the surprise team(s) of 2013. Every spring, fans and analysts attempt to predict which teams will surpass the expectations of PECOTA and the pundits. Most of those predictions, of course, don’t come to pass. It’s tough to beat the stats, the oddsmakers, and the combined predictive powers of people who spend large chunks of their lives watching and reading and writing about baseball teams. Especially since some of the people who can beat the consensus consistently start publishing their predictions, the consensus becomes a bit better and harder to beat.

So while we all have hunches or get good vibes from certain teams, our hunches and vibes probably aren’t predictive. But it’s still fun to try to outsmart the system, and being the first to see something coming can make you look like you’re better at baseball analysis than everyone else. That means we’ll see more of the same old articles, but now there’s something new. We’re no longer settling for predicting the next “surprise teams.” We’re predicting the next Orioles and A’s.

The Orioles and A’s, as everyone knows, made the playoffs last season and won well over 90 games despite not having done either of those things for some time—15 years in Baltimore’s case, and six in Oakland’s. Someone, somewhere, might have predicted their success, but it wasn’t at Baseball Prospectus, and it wasn’t Billy Beane. It was a wonderful story, and we’re wired to want more wonderful stories. So now we need new Orioles and A’s. Some people started looking for them last year; others started looking last week.

But there’s a catch: Teams like the 2012 Orioles and A’s don’t come along often. You’ve probably heard of the Availability Heuristic, one of those handy hallmarks of human psychology discovered by Daniel Kahneman and Amos Tversky. This one, in the words of Wikipedia, is “the tendency to make a judgement about the frequency of an event based on how easy it is to recall similar instances.” In other words, if we just saw something happen, particularly in a memorable way, we’re more likely to overestimate how likely it is to happen again. Last year, we saw two teams go from afterthoughts in April to playoff teams in October in about the most memorable way possible. Maybe we’re overestimating the odds of it happening again.

It’s not that rare for a team to improve by at least 20 wins from one season to the next: Before last year, it had happened 26 times in 16 seasons during the wild-card era. Last year, it happened twice, which wasn’t that unusual either. What was unusual was the way it happened, particularly for the Orioles. The O’s improved by 24 wins, which had happened only 10 times in those 16 seasons. Their 20-plus-game improvement put them over 90 wins, which had happened only six times. (It’s probably easier to take a big jump from terrible to not too bad, like the 2003-4 Tigers, 2004-5 Diamondbacks, and 2008-9 Mariners, than it is to take a same-sized jump from not too bad to 93 wins.)

Maybe more importantly, no one saw Baltimore’s success coming. You can’t say that about the 1999 Diamondbacks, who signed Randy Johnson and Steve Finley and traded for Luis Gonzalez, among other moves, after a lousy expansion season. You can’t say it about the 2008 Rays, whom PECOTA projected to be 22 wins better than they had been the year before. And you won’t be able to say it about the 2013 Blue Jays, who might enter 2013 as the consensus favorite in the AL East after winning 73 games last year. The Jays could win 93 or more this year, but between the players they’ll get back from injury and the ones they’ve acquired over the winter, no one would be especially surprised. If we want true comparables—a team that improved by at least as many wins, won at least 90, and did it all without any warning or pre-season buzz—we’re down to a handful in the past couple decades.

Trying to isolate common traits of those teams so we can see the next surprise coming is an exercise as frustrating as earthquake prediction, one of Nate Silver’s subjects in The Signal and the Noise. Seismologists can estimate the probability that there will be an earthquake of a certain magnitude, somewhere in the world, over a particular period. What they can’t predict with any accuracy is exactly where and when it will occur. Similarly, we can estimate the likelihood that some team will exceed its projection by a given number of games, but we can’t tell you which team it will be. There are too many aspects of baseball performance we either don’t yet know how to predict or will never know how to predict, because they’re not predictable. (Fortunately, when PECOTA fails to predict something, nobody dies.)

Efforts to identify short-term earthquake indicators have failed. Some earthquakes are preceded by a series of mini-quakes that, in retrospect, look like warning signs. But other clusters of mini-quakes never lead to a larger one. Seismologists make the occasional correct call, but only because they’re such prolific prognosticators. If we predicted that every team projected to finish under .500 would actually end up 20 games over, we’d have a lousy success rate but be right once in a while.

People have proposed indicators to pinpoint surprise teams, too. In The Baseball Book 1990, Bill James laid out several that he used to predict how teams would do in the upcoming season. The indicators were based on Pythagorean record and some simple principles: good teams tend to get worse and bad teams tend to get better; teams that improve in one year tend to decline the next, and vice versa; young teams tend to improve, while old teams tend to decline; teams that played well late in the previous season tend to sustain their success, and so on. Building on James’ indicators in 2011, Dave Fleming of Bill James Online came up with a list of 14 questions designed to predict whether a team would improve:

1. Are the hitters young or old? Are their best years to come, or are their best years behind them?
2. Are the pitchers young or old? Are their best years to come?
3. Did the team improve during the second half of the season?
4. Did the team do well during August/September?
5. Assuming that the team posted a losing record: Did the team do well the year before that? Is there a recent history of success?
6. Did the team’s AAA organization do well?
7. Did the team’s AA organization do well?
8. Did the team underperform their Pythagorean W-L record?
9. Does the team have good management? Do they utilize talent well?  
10. Is the team’s division open for challengers?
11. Did the team acquire new talent in the off-season?
12. Is the team getting significant players back from injuries?
13. Does this team have clear and present talent?
14. Does this team have a story for how it will be successful?

Some of these are subjective, so it’s not clear how much value the questionnaire adds. If we’d applied this test to the Orioles a year ago, about half of our answers would have been, “No.” The A’s would have done a bit better, but they wouldn’t have aced it. Fleming, for his part, picked Cleveland as his surprise team. The Indians improved by 11 wins but finished 80-82.

PECOTA doesn’t foresee any team improving by 20 wins this season—the Red Sox, currently projected to gain 17 wins, come closest—but it’s not in PECOTA’s nature to predict extremes. (PECOTA doesn’t project anyone to hit more than 40 homers, either, but someone has in every season since 1986.) But as Sam Miller, Paul Sporer, and I discussed on the Cleveland season preview podcast earlier this month—before Michael Bourn signed—the Indians are a popular pick again.

A week ago, Baseball Nation’s Grant Brisbee wrote about whether Bourn would make Cleveland a contender. “It’s probably not going to happen,” Grant said. “But at least one team will be this year’s Orioles, and the Indians are just as good a pick as any.”

When Grant, who is as wise as he is witty (note: he is very witty), says, “at least one team will be this year’s Orioles,” he doesn’t mean, “at least one team will go 29-9 in one-run games, outplay its Pythagorean record by 11 games, and finish with 93 wins.” He means at least one team will be significantly better than we expect, which will probably be the case (as it is in most seasons).

Two things. First, as Grant acknowledges, calling a team the next Orioles effectively disqualifies it from consideration. What made the Orioles the Orioles (and the A’s the A’s) is that no one conceived of the possibility that they could do what they did. Now that they’ve done it, of course, it’s easier to imagine that anyone could. But the Indians have reached the point at which they’re too popular a pick to provoke the same surprise.

Second, using the 2012 Orioles as a proxy for “surprise team” raises expectations awfully high. The second wild card makes it more likely that a team can play over its head long enough to luck into a playoff spot, so in that sense we are more likely to see a surprise team today. But the Orioles won often enough that they would have made it to a tiebreaker with Texas with only one wild card. There’s always a surprise team, but there’s not always an Orioles.

The Cleveland love hasn’t been limited to the last couple weeks. Erik Karabell expressed similar sentiments on ESPN’s now-defunct Baseball Today podcast after Nick Swisher signed.

“What if they’re the Baltimore? What if they’re the team that can contend? We don’t know that”, Karabell asked his co-host, Keith Law.

Law wasn’t buying the “They could be Baltimore” argument.

Do you want to start spending money on the thought that, ‘We’re going to do what Baltimore did,’ which has to be one of the most remarkable one-season turnarounds of the last, I don’t know, 10-20 years, in terms of what was on the roster? … I would not want to run my club thinking, ‘We could be this year’s Baltimore.’

Law was right. Expecting the improbable isn’t the best way to run a team. And it’s probably not the best way to make pre-season predictions.

Thanks to R.J. Anderson and Dave Studeman for research assistance.

You need to be logged in to comment. Login or Subscribe
Another great column Ben,thanks. Being a tribe fan I would find the most disappointing aspect of Cleveland's offseason signing's would be another paltry average attendance, like last season,hopefully no matter how many games we win this season, just for the record I put the under/over at 75.5,bums on seats will rise markedley,and that would then be a great season for the tribe.
Thank you for this. I'm so tired of this question or the idea that you can predict who the next Orioles will be (since there's probably no metric you could have used last March to model what the Orioles did last season).
I agree. If you're asking 'Is X the new Y?' you're asking the wrong question.
Fine writing, Ben, as per usual. There aren't many places we can go to read about baseball that include well-explained references to Kahneman and Tversky! To be a little contrarian, though, it seems that the 2013 Orioles remain eligible to surprise people: PECOTA predicts 75 wins, last place, and a <5% chance of the playoffs. Apparently their Pythag W/L and record in 1-run games get a lot more weight than the rest of Dave's 14 questions. Perhaps PECOTA needs better heuristics?
It's possible, but as I mentioned, we don't know how many of those 14 questions add any value. They're fun, but some of them would have to be studied before we could conclude that they'd improve the predictions. And some of them are subjective, so they'd be tough for PECOTA to ask.
I was hoping for some mention of Trevor Bauer (maybe the Professor's mythical scouting report on him!), given that he was the headline photograph. Enjoyed the article still. My BP subscription was probably my best decision last year.
Yeah, didn't mention Bauer because the Bauer trade cost Cleveland Choo. I figure the odds are against that being an upgrade in 2012 alone.
Don't forget everyone missed on the Giants too or did most prognosticators have them winning the World Series again ? Did anyone have the White Sox leading their division until the last couple of weeks. It's February, feel free to pick the Yankees and Tigers winning their division with the Rangers and Angels battling for the division and wild card but with the Red Sox just finishing short but it would be more surprising if it finished that way then if the O's, Angels or White Sox made it in. The Giants just won the World Series but the Dodgers are supposed to win the division and the Giants may not even make the Wild Card... We'll see.
I haven't looked at any of the PECOTA projections, but what about the San Diego Padres? They had a great second half, have a young team and could have some additions from their farm system this year. I know they didn't go out and make any big moves, but I would assume it would make them more of a "surprise" team than the Indians. No one picked the Giants to be bad. In fact I'm sure people even picked them to in the West. If you add the Giants than you have to talk about the Nats. This is about teams that no one expected to play more than .500 baseball (if even that), and ended up in the playoffs. Not teams that people predicted to make the playoffs or at least contend.
I predicted the Nats to win the World Series, so they underachieved for me.
If the Indians do underperform their py-thag it will because of the karma debt that Trevor Bauer racked up with his musical stylings.
I don't think the Indians have been spending money this offseason with the idea that they could be 2013's version of the Orioles. I realize that isn't the argument Ben is making, but the tenor surrounding the Indians' offseason moves seems to suggest that analysts are puzzled by their forays into the free agent market. I find their confusion to be equally puzzling; why on earth shouldn't they use their financial flexibility to improve the ML roster? The new CBA renders moot any argument that these funds should be allocated towards aggressively pursuing amateur FA and tough-to-sign draft picks. The fact is they've put themselves within a lucky break of playoff contention, and acquired some valuable assets with future trade value along the way. This isn't a situation where they need some extraordinarily unlikely breakthroughs (e.g. Brandon Moss 2012) or statistical flukes (the O's extra inning prowess) to be in contention come September. Normal variation around their mean talent level (somewhere around 81 wins) puts them in the discussion for a playoff berth. Again, I realize this isn't the thrust of Ben's argument, but since the Indians are mentioned a few times I couldn't help but think about this a bit more.
The mets, put it in the books, after thought in the division, if things break perfectly they have will have to beat the big dogs (nationals = yanks, phillies = red sox, braves = rays) The mets have the rotation to have alot of close games (not much on the offensive front), the bullpen needs to do a quick turnaround from last season, but that's usually the easiest thing to fix
Reading the headline "Why There Probably Are No Next Orioles" kind of felt like reading "Why There Probably Will Be No Christmas This Year."
Yeah, I know. Sorry for being a buzzkill.
"Do you want to start spending money on the thought that, ‘We’re going to do what Baltimore did,’ which has to be one of the most remarkable one-season turnarounds of the last, I don’t know, 10-20 years, in terms of what was on the roster? … I would not want to run my club thinking, ‘We could be this year’s Baltimore.’" Dayton Moore disagrees so hard.
In Dayton's defense, they don't need to improve by 24 games. Only 18 or so, piece of cake.
I don't think Dayton Moore is trying to make this year's Baltimore. He is trying to make the 1992 Braves. He's banking on the notion that Hosmer, Moustakas and Perez are stars. If that's true, then they didn't need to add 18 wins to the roster, and the off-season trades may have given them enough to compete.
Indians take the second wild card spot. Combination of young players breaking out(Kipnis/Santana/Bauer) with new veteran talent additions. Anahiem, Toronto and Detroit division winners. Yankees first WC...
I'd like to think that about the Indians, but everyone in the rotation is pitching two spots above what he seems to be (i.e. Ubaldo is a #4 masquerading as a #2) and that doesn't seem to be an ingredient for success over the course of a season. That being said, I guess the bar to become the second wild card is not all that high.
The pitching is awful. Can't see it.
Your mention of the 1999 Diamondbacks raises the interesting question: what team added the most wins in an off-season? The trio of Johnson, Finley and Gonzalez added about 17 wins to the '99 D'backs. The Jays additions this off-season are projected to add 14-20 wins (depending on projection system).
There was a BP article from June 2012 about how bad the A's offense was. Somehow it all turned around. I think the A's figured they had nothing to lose.
Also Lunhow is smarter than us. He knows about cognitive dissonance, confirmation bias, Stockholm syndrome or whatever psychological geegaw it is that makes us think the exceptional can happen to our team.