CSS Button No Image Css3Menu.com

Baseball Prospectus home
  
  
Click here to log in Click here for forgotten password Click here to subscribe

Premium and Super Premium Subscribers Get a 20% Discount at MLB.tv!

<< Previous Article
Inside The Park: Farew... (05/21)
<< Previous Column
Baseball Prospectus Ne... (05/01)
Next Column >>
Baseball Prospectus Ne... (07/09)
Next Article >>
Premium Article Out of Left Field: Whe... (05/21)

May 21, 2012

Baseball Prospectus News

Improving the Odds

by Colin Wyers

We’ve identified incorrect data in the playoff odds report. The purpose of this post is to explain what happened, announce that it’s fixed, and offer some technical notes on the process so readers can reassure themselves that it’s now working as it should.

At the heart of the playoff odds report is a database table that contains the current-season MLB schedule. We use that table for many other products as well. After the season started, we moved many of the other products to a different schedule table that went back through the entire Retrosheet era and also included additional data. The playoff odds were a straggler, because we were working on a project that would allow us to run them for previous seasons. (The adjusted standings have been similarly modified, and soon we’ll have adjusted standings available back through 1974 on the site.) So the changes were made to the new playoff odds codebase, and the old codebase was left running on the old schedule table. Unfortunately, at some point during the season, the old schedule table stopped updating properly.

We’ve subsequently cut the old schedule table entirely, and now all products are running off the new schedule table. The new playoff odds codebase is in place as well, but due to the amount of data that needs to be processed, it will be some time before we’re ready to offer historic playoff odds for past seasons. We have rerun the playoff odds for the entire season, so the one- and seven- day deltas are working off corrected data and thus reflect changes in a team’s odds over time, not the correction of mistakes. Playoff odds for past dates this season can be viewed by clicking on the Hit List and navigating to past editions.

Running the odds over the whole season allows us to verify that the error has been corrected as well. Looking at the predicted win percentage in the report, and compared to the average rest-of-season win percentage from the simulation, we see an average difference of .003. So the simulation is correctly incorporating the inputs, within a certain tolerance. (Because it’s a Monte Carlo simulation, we would expect to see some variation from predicted record due to randomness.)

The next question one might have is how we determine the expected rest-of-season win percentage. There are three inputs:

  • A team’s third-order win percentage to date,
  • Its projected rest-of-season win percentage in the depth charts, and
  • Its strength of schedule (in other words, its opponents’ expected win percentages).

The weighting used varies based upon how many games have been played. Given a team’s third-order and depth chart (DC) winning percentages, we figure its expected win percentage like so:

We do this for every team. To figure the odds of the home team winning each game, we add in home field advantage and use the odds ratio, like so:

That gives us the home team’s winning percentage for that game. We take the average of this for the listed expected win percentage, so the number you see on the site will not exactly reflect the EXP_WPCT produced by the formula above.

Then, for each iteration of the sim, we produce a random number between zero and one; if the number is below or equal to the winning percentage, the home team wins. Otherwise, it loses. Then we rank the final standings from each simulated season and figure out how many times a team won either its division or one of the two wild cards.

We’ve written several new queries to monitor this report and will be checking on it daily to ensure that problems do not recur.

Colin Wyers is an author of Baseball Prospectus. 
Click here to see Colin's other articles. You can contact Colin by clicking here

Related Content:  Playoff Odds

10 comments have been left for this article.

<< Previous Article
Inside The Park: Farew... (05/21)
<< Previous Column
Baseball Prospectus Ne... (05/01)
Next Column >>
Baseball Prospectus Ne... (07/09)
Next Article >>
Premium Article Out of Left Field: Whe... (05/21)

RECENTLY AT BASEBALL PROSPECTUS
Premium Article Minor League Update: Games of Wednesday, Jul...
Feature Focus: Pitch f/x Matchup Tool
Fantasy Article Fantasy Freestyle: Trade Deadlines and Syste...
Fantasy Article Free Agent Watch: Week 18
Premium Article Transaction Analysis: Cardinals Vouch for Ma...
Premium Article Notes from the Field: July 31, 2014
Skewed Left: The Nomar Garciaparra Trade Tur...

MORE FROM MAY 21, 2012
Premium Article Painting the Black: David Wright's Dramatica...
Premium Article Out of Left Field: When You Can't Buy a Loss
Fantasy Article Resident Fantasy Genius: Building From the B...
Inside The Park: Farewell to a Phenom
Premium Article Collateral Damage Daily: Monday, May 21
Premium Article The Prospectus Hit List: Monday, May 21
What You Need to Know: Monday, May 21

MORE BY COLIN WYERS
2012-06-13 - Premium Article Manufactured Runs: The Madness of King Bill
2012-06-06 - Premium Article Manufactured Runs: What We Really Know About...
2012-05-30 - Manufactured Runs: Who Gives a Shift?
2012-05-21 - Baseball Prospectus News: Improving the Odds
2012-05-16 - Premium Article Manufactured Runs: The Angels, Albert Pujols...
2012-05-08 - BP Announcements: Rest-of-Season PECOTA Now ...
2012-05-04 - Between The Numbers: The Prorating Game
More...

MORE BASEBALL PROSPECTUS NEWS
2012-08-31 - Baseball Prospectus News: Goodbye to the Int...
2012-07-12 - Baseball Prospectus News: Introducing the BP...
2012-07-09 - Baseball Prospectus News: Introducing the BP...
2012-05-21 - Baseball Prospectus News: Improving the Odds
2012-05-01 - Baseball Prospectus News: Introducing the Re...
2012-04-09 - Baseball Prospectus News: Introducing BP's D...
2012-04-05 - Baseball Prospectus News: Opening Day Roundt...
More...

INCOMING ARTICLE LINKS
2013-06-18 - Premium Article Overthinking It: The Most Surprising Team Pe...
2012-07-17 - BP Announcements: Playoff Odds Updated