CSS Button No Image Css3Menu.com

Baseball Prospectus home
  
  
Click here to log in Click here for forgotten password Click here to subscribe

<< Previous Article
Premium Article Transaction Action: Ca... (09/25)
<< Previous Column
BP Unfiltered: Why the... (09/12)
Next Column >>
BP Unfiltered: After T... (09/29)
Next Article >>
The Week in Quotes: Se... (09/27)

September 26, 2010

BP Unfiltered

Retiring the Sauce

by Colin Wyers

A few years ago, we introduced the concept of the secret sauce. It was designed to predict the odds of a team’s postseason success based upon the quality of their run prevention, using a team’s strikeout rate, the quality of their closer and the quality of their defense.

So how well has the sauce fared since its introduction? Prompted by some recent research, I took a look at how often the team with the best sauce won each series, from ’06 (the first season the Sauce was used) through ’09, and the result was only 54% success – not significantly better, statistically speaking, than flipping a coin.

The playoffs are notoriously noisy, of course – Billy Beane famously remarked, “My shit doesn’t work in the playoffs,” and it’s easy to see why. You’re talking about short series between teams that are very evenly matched – as mismatched as any two playoff teams might be, there is no team as bad as the 2010 Mariners in the playoffs. So compared to the regular season, you’re dealing with a real crapshoot.

It’s possible that the Secret Sauce ran up against a few years where its performance was flukily low. But what we have is a model based on historical data that has thus far been ineffective at predicting results out-of-sample, which doesn’t give us a lot of reason to be confident in it going forward. So for now, we’re retiring the Secret Sauce.

Of course, that doesn’t mean that we won’t be providing you analysis for the playoffs. This week, we’re going to start looking at the revamped PECOTAs, and one of the things we’re going to be doing is using PECOTA to give you an in-depth look at each team in the post season. Expect to see more about this as we unveil the changes in PECOTA and we get a clearer picture of the matchups we’ll be seeing in the playoffs.

Colin Wyers is an author of Baseball Prospectus. 
Click here to see Colin's other articles. You can contact Colin by clicking here

5 comments have been left for this article. (Click to hide comments)

BP Comment Quick Links

dpratola

Sure, go ahead, trample further the hopes of BP's Padres fans... all three of us (I believe three is correct... Normandin, Geoff Young, and me). Bad enough to take the weekly diss from Goldy and the Perfessor, now you simply extinguish a report we've dominated all year. Yeah... thanks.

Sep 26, 2010 12:04 PM
rating: -1
 
formersd

Make that 4 of us....

Sep 26, 2010 22:05 PM
rating: -1
 
awayish

what about historical secret sauce performance?

Sep 26, 2010 12:36 PM
rating: 0
 
Michael
(736)

Congratulations on recanting. It's not easy to do what's right.

I would hope though that the recanting isn't just due to 4 years' worth of post-season series but also some suspicion that the original research was a bit suspect.

Sep 27, 2010 06:39 AM
rating: 2
 
Luke in MN

As a Twins fan, allow me to offer my thanks. The Twins's postseason failures of the last decade have repeatedly been "explained" by sauce-inspired theories that have always smelled funny to me. Power pitching does not magically become a better way to win ballgames when the playoffs start!

Sep 27, 2010 09:44 AM
rating: 1
 
You must be a Premium subscriber to post a comment.
Not a subscriber? Sign up today!
<< Previous Article
Premium Article Transaction Action: Ca... (09/25)
<< Previous Column
BP Unfiltered: Why the... (09/12)
Next Column >>
BP Unfiltered: After T... (09/29)
Next Article >>
The Week in Quotes: Se... (09/27)

RECENTLY AT BASEBALL PROSPECTUS
Premium Article The Prospectus Hit List: Friday, May 29
Premium Article Minor League Update: Games of Thursday, May ...
Fantasy Rounders: San Diego's Marine Player
Premium Article Rubbing Mud: Context is King
Premium Article Daisy Cutter: How the Kipnis Got His TAv
Premium Article What You Need to Know: Another Day, Another ...
Premium Article Release Points: Where Have You Gone, Stephen...


MORE BY COLIN WYERS
2010-09-30 - Reintroducing PECOTA: Aches and Pains
2010-09-29 - Reintroducing PECOTA: The Hits Just Keep On ...
2010-09-28 - Reintroducing PECOTA: Whatever Happened to t...
2010-09-26 - BP Unfiltered: Retiring the Sauce
2010-09-22 - Manufactured Runs: A Walk in the Park
2010-09-14 - Premium Article Prospectus Perspective: Missing the WAR
2010-09-12 - BP Unfiltered: Why the Padres do not have a ...
More...

MORE BP UNFILTERED
2010-10-05 - Premium Article BP Unfiltered: BP: LABR Champions
2010-10-01 - BP Unfiltered: Baseball Prospectus on Twitte...
2010-09-29 - BP Unfiltered: After The Knife
2010-09-26 - BP Unfiltered: Retiring the Sauce
2010-09-12 - BP Unfiltered: Why the Padres do not have a ...
2010-08-25 - BP Unfiltered: Wanna be a scout?
2010-08-16 - BP Unfiltered: There's Matt Lauer...And Then...
More...

INCOMING ARTICLE LINKS
2015-03-04 - The BP Wayback Machine: Can Spring Training ...
2014-10-14 - Premium Article Baseball Therapy: The Other Playoff Myths
2013-04-02 - Testing the Dewan Rule
2012-09-20 - Premium Article Overthinking It: No Ace, No Problem?
2010-10-14 - Premium Article Changing Speeds: A Brief Meditation on the P...
2010-09-29 - Premium Article Prospectus Perspective: Front Fours