CSS Button No Image Css3Menu.com

Baseball Prospectus home
  
  
Click here to log in Click here for forgotten password Click here to subscribe

<< Previous Article
Premium Article Transaction Action: Ca... (09/25)
<< Previous Column
BP Unfiltered: Why the... (09/12)
Next Column >>
BP Unfiltered: After T... (09/29)
Next Article >>
The Week in Quotes: Se... (09/27)

September 26, 2010

BP Unfiltered

Retiring the Sauce

by Colin Wyers

A few years ago, we introduced the concept of the secret sauce. It was designed to predict the odds of a team’s postseason success based upon the quality of their run prevention, using a team’s strikeout rate, the quality of their closer and the quality of their defense.

So how well has the sauce fared since its introduction? Prompted by some recent research, I took a look at how often the team with the best sauce won each series, from ’06 (the first season the Sauce was used) through ’09, and the result was only 54% success – not significantly better, statistically speaking, than flipping a coin.

The playoffs are notoriously noisy, of course – Billy Beane famously remarked, “My shit doesn’t work in the playoffs,” and it’s easy to see why. You’re talking about short series between teams that are very evenly matched – as mismatched as any two playoff teams might be, there is no team as bad as the 2010 Mariners in the playoffs. So compared to the regular season, you’re dealing with a real crapshoot.

It’s possible that the Secret Sauce ran up against a few years where its performance was flukily low. But what we have is a model based on historical data that has thus far been ineffective at predicting results out-of-sample, which doesn’t give us a lot of reason to be confident in it going forward. So for now, we’re retiring the Secret Sauce.

Of course, that doesn’t mean that we won’t be providing you analysis for the playoffs. This week, we’re going to start looking at the revamped PECOTAs, and one of the things we’re going to be doing is using PECOTA to give you an in-depth look at each team in the post season. Expect to see more about this as we unveil the changes in PECOTA and we get a clearer picture of the matchups we’ll be seeing in the playoffs.

Colin Wyers is an author of Baseball Prospectus. 
Click here to see Colin's other articles. You can contact Colin by clicking here

5 comments have been left for this article.

<< Previous Article
Premium Article Transaction Action: Ca... (09/25)
<< Previous Column
BP Unfiltered: Why the... (09/12)
Next Column >>
BP Unfiltered: After T... (09/29)
Next Article >>
The Week in Quotes: Se... (09/27)

RECENTLY AT BASEBALL PROSPECTUS
Fantasy Article Free Agent Watch: Week 25
Fantasy Article They Hold No Quarter: Outfielders
The BP Wayback Machine: The Many Moments of ...
Fantasy Article Fantasy Freestyle: Small Moves That Might Ma...
Premium Article What You Need to Know: September 18, 2014
Premium Article Pitching Backward: Big Situation James
Painting the Black: The Plightin' Showalters


MORE BY COLIN WYERS
2010-09-30 - Reintroducing PECOTA: Aches and Pains
2010-09-29 - Reintroducing PECOTA: The Hits Just Keep On ...
2010-09-28 - Reintroducing PECOTA: Whatever Happened to t...
2010-09-26 - BP Unfiltered: Retiring the Sauce
2010-09-22 - Manufactured Runs: A Walk in the Park
2010-09-14 - Premium Article Prospectus Perspective: Missing the WAR
2010-09-12 - BP Unfiltered: Why the Padres do not have a ...
More...

MORE BP UNFILTERED
2010-10-05 - Premium Article BP Unfiltered: BP: LABR Champions
2010-10-01 - BP Unfiltered: Baseball Prospectus on Twitte...
2010-09-29 - BP Unfiltered: After The Knife
2010-09-26 - BP Unfiltered: Retiring the Sauce
2010-09-12 - BP Unfiltered: Why the Padres do not have a ...
2010-08-25 - BP Unfiltered: Wanna be a scout?
2010-08-16 - BP Unfiltered: There's Matt Lauer...And Then...
More...

INCOMING ARTICLE LINKS
2013-04-02 - Testing the Dewan Rule
2012-09-20 - Premium Article Overthinking It: No Ace, No Problem?
2010-10-14 - Premium Article Changing Speeds: A Brief Meditation on the P...
2010-09-29 - Premium Article Prospectus Perspective: Front Fours