CSS Button No Image Css3Menu.com

Baseball Prospectus home
  
  
Click here to log in Click here for forgotten password Click here to subscribe

Premium and Super Premium Subscribers Get a 20% Discount at MLB.tv!

<< Previous Article
Premium Article Transaction Action: TA... (08/20)
<< Previous Column
Premium Article The Biz Beat: A Revenu... (08/12)
Next Column >>
Premium Article The Biz Beat: The Wint... (09/11)
Next Article >>
Premium Article Red Sox Woes Afield (08/21)

August 20, 2009

The Biz Beat

A New Way to Rank the GMs

by Shawn Hoffman

the archives are now free.

All Baseball Prospectus Premium and Fantasy articles more than a year old are now free as a thank you to the entire Internet for making our work possible.

Not a subscriber? Get exclusive content like this delivered hot to your inbox every weekday. Click here for more information on Baseball Prospectus subscriptions or use the buttons to the right to subscribe and get instant access to the best baseball content on the web.

Subscribe for $4.95 per month
Recurring subscription - cancel anytime.


a 33% savings over the monthly price!

Purchase a $39.95 gift subscription
a 33% savings over the monthly price!

Already a subscriber? Click here and use the blue login bar to log in.

Back in 2004, the late Doug Pappas came up with a simple way to evaluate how well each team was spending their money: marginal payroll per marginal win. Here's Doug's original formula:

(club payroll - (28 x major league minimum)) / ((winning percentage - .300) x 162)

Simple enough, and it managed to give us yet another way to show how great Billy Beane and the A's were. But while it was a decent first step, it failed even the simplest laugh tests: were the Yankees really one of the bottom ten teams, even when they were running away with their division every year? Are the Marlins consistently one of the best-run teams, just by virtue of not spending much beyond the minimum on payroll? Probably not.

Looking at it now, the biggest problems are fairly obvious. First off, not all wins are created equal-as Nate Silver touched on in Baseball Between the Numbers, a team's ninetieth win creates significantly more marginal revenue than its seventieth (see chart below). Also, each team has its own marginal revenue curve-the Yankees' ninetieth win is much more valuable than the Marlins' ninetieth win, at least in terms of pure revenue potential.

So while Doug's original formula punished large-market teams for spending significant sums on payroll, the reality is that the Yankees would have to have a brain lapse to cut their payroll below $100 million. The question really should be: How well are they spending their $200 million, and is that the right number, given their competitive position and market size?

Neil deMause was on the right track two years ago when he added Nate's marginal-revenue-per-win curve to Doug's method. But we need to go a couple steps further. Here's how we'll do it:

  1. First, we need to know how much marginal revenue each team is likely to bring in, based on its win total and market size. To do this, we'll use Nate's MR/MW curve, updated for 2009 revenues. We'll then assign each team a market-size factor based on its 2007-2008 gate receipts. (We already know that this is the only short-term revenue source that significantly impacts a team's payroll spending). The Red Sox won 95 games last year, which should generally lead to $108 million in marginal revenue. Multiply that figure by Boston's market-size factor (2.48), and we get expected revenue of $267 million.

  2. Next, we'll use a regression equation (MW = 0.1106*MP + 22.538) to determine how many games a team should win-and, therefore, how much revenue it should bring in-based solely on its payroll. For example, Boston's $133 million payroll in 2008 should have led to 86 wins. According the win curve, multiplied by the team's market-size factor, that would create $165 million in marginal revenue.

  3. Then we just divide these numbers: 267 / 165 = 1.61. In other words, given their payroll and revenue potential, the Red Sox performed about 61 percent better than average in 2008.

Let's compare the top and bottom teams from 2008, first using Doug's approach, and then using our new one:

Team Marginal Payroll Marginal Wins MP / MW
Marlins $10,636,500
36 $300,466
Rays $32,620,598† 49 $673,979
Twins $50,982,767† 40 $1,293,979
Athletics $36,767,126† 27 $1,392,694
Diamondbacks $55,002,713† 34 $1,646,788
---- ---- ---- ----
Nationals $43,761,000† 11 $4,207,788†
Padres $62,477,617† 15 $4,338,723†
Yankees $197,881,579† 41 $4,898,059†
Tigers $127,485,197† 26 $5,019,102†
Mariners $106,793,982† 13 $8,612,418†

Of the top five teams, only one-the Rays-actually made the playoffs, and of the other four, only the Twins should have even been close. The Marlins, D'backs, and A's performed reasonably well given their small payrolls, but still only averaged 80 wins.

Let's see how those results compare to our new method:

Team Marginal Revenue Expected MR MR / ExpMR
Rays $51,461,633 $23,524,473 2.19
Angels $115,533,623 $64,051,489 1.80
Cubs $185,744,330 $106,445,281 1.74
Phillies $132,870,709 $78,183,106 1.70
Red Sox $267,185,811 $165,780,654 1.61
---- ---- ---- ----
Yankees $228,824,384 $302,239,343 0.76
Tigers $46,166,722 $67,111,767 0.69
Padres $26,758,423 $53,501,930 0.68
Nationals $26,758,423 $42,507,738 0.63
Mariners $32,245,120 $55,863,187 0.58

This seems a lot closer to reality. The Rays run away from the pack, with the 100-win Angels and 97-win Cubs coming in a distant second and third, respectively. Instead of punishing large-market teams, the system accounts for their inherent advantage, and judges them on how well they actually use it. The Yankees remain in the bottom five-which is actually identical to the previous list, just with a different order-but it's no longer their fait accompli, as they would have finished in the top half had they played up to expectations. The Red Sox, for example, finish nineteenth on the old list despite winning 95 games, as compared to fifth on the new list.

If we want to make it even more meritocratic, we can use third-order wins instead of actual wins, in order to strip out some of the luck involved:

Team 3rd-Order MR ExpMR MR3/ExpMR
Rays $51,461,633 $23,524,473 2.19
Red Sox $290,486,158 $165,780,654 1.75
Blue Jays $66,790,624 $39,300,599 1.70
Cubs $175,942,093 $106,445,281 1.65
Dodgers $128,566,277 $100,454,854 1.28
---- ---- ---- ----
Padres $41,255,570 $53,501,930 0.77
Tigers $51,211,783 $67,111,767 0.76
Nationals $30,054,408 $42,507,738 0.71
Pirates $14,483,537 $20,635,720 0.70
Mariners $35,986,509 $55,863,187 0.64

The Rays remain in front, while the Red Sox, Blue Jays, and Dodgers all move up a few spots.

Here's the same chart for 2009, assuming each team's current third-order winning percentage holds:

Team 3rd-Order MR ExpMR MR3/ExpMR
Rays $50,733,695 $24,508,966 2.07
Dodgers $181,196,617 $91,143,942 1.99
Rockies $58,385,603 $38,702,035 1.51
Rangers $41,117,147 $28,721,444 1.43
Red Sox $217,262,599 $152,072,010 1.43
---- ---- ---- ----
Royals $15,701,747 $19,530,582 0.80
Mets $94,833,032 $124,697,984 0.76
Pirates $15,300,110 $20,216,344 0.76
Astros $49,817,523 $66,058,454 0.75
Reds $24,847,828 $33,316,875 0.75

You can see the full data here.

If there's still a piece missing, it's the value that comes with finishing last. The first pick in the draft is worth a lot more than the fifth or the tenth or the fifteenth, so a team that wins 59 games, as the Nationals did last year, should have that factored into its marginal revenue figures. But we'll leave that for another day.

For now, some other notes on the data we do have:

  • Andrew Friedman and the Rays are clearly the class of Major League Baseball right now. Ignore their actual 2009 record; first-, second-, and third-order wins have them as the second-best team in the American League, and they're only trailing a team that will spend three and a half times as much on payroll. Combine that with a runaway victory in 2008, in both actual and third-order MR/ExpMR, and it's hard to argue they're not the best around right now.

  • The Yankees are currently twelfth in MR3/ExpMR (we seriously need a name for this, if anyone has any ideas), but only 27th in the classic MP/MW-despite being on pace to win 101 games. I think the new method is a pretty fair approximation; the marginal returns clearly diminish very quickly after about $120-$130 million (which is where the Red Sox usually are), and the Yankees could obviously win a lot of games with a $150 million payroll, if managed correctly. That they're about average seems right-when you spend fifty percent more than anybody else, you probably should win 101 games.

  • The Mets are a disaster.

  • The Pirates, Royals, Orioles, and Nationals would definitely benefit if we included the value of their ensuing draft picks. Of those teams, I'd guess that the Pirates are the only one that actually understood this coming into the season.

  • It doesn't surprise me that the Nationals aren't in the bottom five-they've tracked well ahead of their actual record all year, and they actually aren't that far behind the Mets in the adjusted standings.

Now, about that name...

Shawn Hoffman is an author of Baseball Prospectus. 
Click here to see Shawn's other articles. You can contact Shawn by clicking here

57 comments have been left for this article.

<< Previous Article
Premium Article Transaction Action: TA... (08/20)
<< Previous Column
Premium Article The Biz Beat: A Revenu... (08/12)
Next Column >>
Premium Article The Biz Beat: The Wint... (09/11)
Next Article >>
Premium Article Red Sox Woes Afield (08/21)

RECENTLY AT BASEBALL PROSPECTUS
Premium Article Transaction Analysis: Chris Denorfia is in t...
Premium Article Transaction Analysis: Cardinals Trade from t...
Premium Article Transaction Analysis: Andrew Miller Goes to ...
Premium Article Transaction Analysis: If You've Got Asdrubal...
Premium Article Transaction Analysis: A's hire A's
Premium Article Transaction Analysis: Not Just A Pretty Face
Premium Article Transaction Analysis: Yankees Get a Proper I...

MORE FROM AUGUST 20, 2009
Premium Article Transaction Action: TA-lette
Premium Article Checking the Numbers: Two Out of Three Ainít...
Premium Article Under The Knife: Seeing Red

MORE BY SHAWN HOFFMAN
2009-10-08 - Premium Article Relative League Quality
2009-09-24 - Premium Article The Biz Beat: Fixing the GM Rankings
2009-09-11 - Premium Article The Biz Beat: The Winter Market
2009-08-20 - Premium Article The Biz Beat: A New Way to Rank the GMs
2009-08-12 - Premium Article The Biz Beat: A Revenue-Sharing Re-Think
2009-08-05 - Premium Article Using Tools
2009-07-29 - Premium Article The Biz Beat: Seeing Everything?
More...

MORE THE BIZ BEAT
2009-10-25 - Premium Article The Biz Beat: Another Chilly Winter?
2009-09-24 - Premium Article The Biz Beat: Fixing the GM Rankings
2009-09-11 - Premium Article The Biz Beat: The Winter Market
2009-08-20 - Premium Article The Biz Beat: A New Way to Rank the GMs
2009-08-12 - Premium Article The Biz Beat: A Revenue-Sharing Re-Think
2009-07-29 - Premium Article The Biz Beat: Seeing Everything?
2009-07-22 - The Biz Beat: Doom and Gloom?
More...

INCOMING ARTICLE LINKS
2010-03-09 - Premium Article Prospectus Hit and Run: NL Central Competiti...
2010-02-23 - Premium Article Prospectus Hit and Run: AL Central Competiti...
2010-02-12 - Premium Article Prospectus Hit and Run: AL East Competitive ...
2010-02-04 - Premium Article Squawking Baseball: The Best and Worst GMs o...
2010-02-03 - Premium Article Prospectus Hit and Run: The Lay of the Land
2009-09-24 - Premium Article The Biz Beat: Fixing the GM Rankings