CSS Button No Image Css3Menu.com

Baseball Prospectus home
Click here to log in Click here for forgotten password Click here to subscribe

<< Previous Article
Fantasy Article Value Picks: Relievers... (06/13)
<< Previous Column
Premium Article Manufactured Runs: Wha... (06/06)
Next Column >>
Manufactured Runs: Doe... (06/20)
Next Article >>
Premium Article The Platoon Advantage:... (06/13)

June 13, 2012

Manufactured Runs

The Madness of King Bill

by Colin Wyers

the archives are now free.

All Baseball Prospectus Premium and Fantasy articles more than a year old are now free as a thank you to the entire Internet for making our work possible.

Not a subscriber? Get exclusive content like this delivered hot to your inbox every weekday. Click here for more information on Baseball Prospectus subscriptions or use the buttons to the right to subscribe and get instant access to the best baseball content on the web.

Subscribe for $4.95 per month
Recurring subscription - cancel anytime.

a 33% savings over the monthly price!

Purchase a $39.95 gift subscription
a 33% savings over the monthly price!

Already a subscriber? Click here and use the blue login bar to log in.

The really great thing about learning from one’s predecessors is that you can learn just as much from when they are wrong as when they are right, if you take care and are vigilant—which is to say, that you recognize that an error was made to begin with.

At its core, sabermetrics got its start because people were able to read things and then ask questions about what they read, rather than taking everything at face value. Does this make sense? Is this really true? And I think that any sabermetrics worthy of that name is as willing to question itself in this fashion as it is everyone else.

(To that end, I think a fair amount of self-doubt is healthy. Too much is crippling, but too little is freeing the same way that taking a life preserver from a drowning man is. Unfortunately, writing with confidence tends to be more interesting than writing with doubt. I think the very best kind of sabermetrics writing is the sort that can make doubt compelling, but it’s hard to do, and especially hard to do often.)

One of the most instructive failures we can look at is the madness of King James the Bill. In the most direct sense, I am referring to his Win Shares system, but I think the lesson we can learn goes well beyond that.

James’ work on Win Shares has long been the “King in Yellow” of sabermetrics, causing many who dare to examine it to grow mad from the very strain of the non-Euclidean geometry within. In my opinion, the best explanation of the system I’ve seen is Patriot’s Win Shares walkthrough. The short version is that Win Shares is an often baroque, sometimes brilliant, always complex system. What separates Win Shares from most modern win-based metrics is that, instead of trying to attribute wins above average or above replacement, James tries to allocate all the wins a team has, period. This leads to some rather unique features of Win Shares.

A great example (and I have stripped away the heavy math portions, so those interested should read the whole series) is the splitting of offensive and defensive wins:

The first important step in Win Shares is to divide credit for the team wins between the offense and the defense. This is done by the percentage of marginal runs that each provides. … This is one of the crucial steps in the process, and it is a fairly clever one, certainly not something I would have thought up. I’m not sure it works, but it’s clever either way. What James does is calculate marginal runs against some very low baseline. He never explains exactly what this baseline is supposed to represent, other than that it works. He uses .52 for the offense and 1.52 for the defense. Let’s call the league average runs/game L. James says:

W% = (R-.52L + 1.52L-RA)/(2*L)

In other words, [runs per win] = 2L, since we can rewrite this equation as:

W% = (R-RA)/(2L) + .5

It does not matter if you use .52 and 1.52, or .5 and 1.5, or .6 and 1.6 –  as long as there is a difference of 1 between the two baselines, the team W% formula will hold.

This, I think, encapsulates Win Shares in a nutshell—it works exceedingly hard to present itself as a measure of absolute wins, but at its core it is based on marginal wins and then “fudged” to look as though it was measuring absolute wins. Many of the flaws of Win Shares can be traced back to that fundamental disconnect between what Win Shares really is and what it is claiming to be.

In some sense, this is a bigger issue for defense than for offense. There is no such thing in Major League Baseball as a team or hitter who, in a reasonable span, will produce zero runs. But that’s a selection problem; you can readily find batters who would manage to put up a zero OBP (and power numbers to match)—if you need someone to demonstrate this, give me a bat and a major-league pitcher and I will strike out as much as you need me to. (In my wildest dreams, I could work myself up to a point where I could muster a groundout against a major-league pitcher.) So measuring offense against a zero baseline, while not realistic, is at least plausible.

If an absolute baseline for offense is a zero run team, though, what’s the equivalent on defense? A team that scores zero runs is practically impossible, but a team that allows every run is not just impossible in practice but impossible even in theory.

So instead James sets baselines for both offense and defense, mirror images of each other, and sets them low enough that if you look at it in a hazy sort of way, you can see them as absolute, not relative, runs. In the end, though, it doesn’t work—and watching James try to fit that square peg into that round hole is like watching a master craftsman relentlessly working off a set of blueprints from M.C. Escher. As much as you may cheer for him to succeed, the effort is doomed from the start.

I don’t bring this up to try and dissuade you from using Win Shares—I think Win Shares itself has already accomplished that task far better than I ever could. Instead, I’m trying to illustrate a point. Nothing in baseball analysis is absolute, everything is relative. And if you’re asking “relative to what,” you’re starting to ask the useful questions of baseball analysis. Hold onto this like a drowning man clutching onto a rope, and eventually you’ll be pulled to shore.

As sabermetricians, we often have ready-made baselines on hand, such as average and replacement level. Some will reflexively claim that average is better because it is easier to define—and it is, and sometimes it is useful, but average is an abstract mathematical concept with no baseball logic behind it. Replacement level has its fans who defend it as the solution to the problem of calling an average player with substantial playing time a zero (and it solves that problem, but as replacement players are hypothetical, your starting assumptions can affect what you are doing in a myriad of ways, some more obvious than others). Both are more useful than their detractors would have you believe, and being abstract or hypothetical does not invalidate the utility of a concept.

But at the core of it, figuring out which baseline has the most value needs to start with figuring out what question you are trying to answer. Not everything is a nail, and not every problem requires a hammer. Thinking carefully about what you’re trying to get at, and what sorts of comparisons are useful to that sort of analysis, is invaluable.

And if you aren’t explicit in deciding that what you’re looking at is relative, that doesn’t mean you’ll be answering things in absolute terms, it means you’ll be answering things relative to a baseline that you haven’t decided on with a clear rationale, and probably without awareness of how that baseline is affecting your analysis.

So I beseech you, do not give into the madness of the king. All value is relative. Anything else is self-deception.

Colin Wyers is an author of Baseball Prospectus. 
Click here to see Colin's other articles. You can contact Colin by clicking here

Related Content:  Bill James,  Sabermetrics,  Win Shares

11 comments have been left for this article. (Click to hide comments)

BP Comment Quick Links

Karl Barth

This is helpful and the writing is engaging. Good work, Colin.

Jun 13, 2012 06:01 AM
rating: 0

Good article.

"Unfortunately, writing with confidence tends to be more interesting than writing with doubt."

Not sure this is true. (Actually, I'm fairly sure it's not.)

Jun 13, 2012 07:06 AM
rating: 3

Seems suspect to tell the author he is incorrect without providing some sort of evidence or argument for your side.

Jun 13, 2012 07:20 AM
rating: 0

He made an offhand remark in a parenthetical aside, and also gave "no evidence"; why should I have to?

Jun 13, 2012 11:28 AM
rating: 2

A fair point.

Jun 13, 2012 11:51 AM
rating: 0
Richard Bergstrom

I think part of the idea behind sabremetrics is to apply a methodical, scientific process to any avenue of research. Everything should be questioned, whether Bill James wrote it or Colin Wyers did.

Jun 13, 2012 07:44 AM
rating: 7
Ric Size

I think that is well said. Nice article, Colin.

Jun 13, 2012 18:43 PM
rating: 0

Great article, Colin. Really helps to put things into perspective a bit.

I still don't understand Win Shares, though.

Jun 13, 2012 08:43 AM
rating: 0
Pat Folz

The Barnes and Noble near my house used to have an actual, physical copy of the Win Shares book. I used to gaze in awe and wonder at its sheer size, and dream that some day I might understand what lay therein.

Now seeing a peak of how it works... what on earth took 7000 pages to convey?

Jun 13, 2012 18:50 PM
rating: 0

Pat, the first 100 pages are a description of the system and the last two-thirds are basically a Win Shares encyclopedia. In between those pages are some excellent essays, in which Bill talks about things he discovered while creating the system.

As someone who spent a lot of time understanding Win Shares, I have to say that I learned a lot by doing so. And give Bill credit here. He systematically described his system in detail, so that others could read it, analyze it, critique it, whatever. In fact, I still understand Win shares better than I do WAR or WARP, because Bill is so good at explaining things.

When Colin says "One of the most instructive failures we can look at is the madness of King James the Bill" he is way out of line, IMO. Bill started changing his system almost immediately after he published it. Bill's thoughts and work are always evolving, and he's to be complimented for it, not denigrated.

Jun 14, 2012 10:38 AM
rating: 10

If only someone would try to explain PECOTA as lucidly as James did Win Shares, there might a chance people could understand, critique and try to improve it.

Jun 16, 2012 07:29 AM
rating: 3
You must be a Premium subscriber to post a comment.
Not a subscriber? Sign up today!
<< Previous Article
Fantasy Article Value Picks: Relievers... (06/13)
<< Previous Column
Premium Article Manufactured Runs: Wha... (06/06)
Next Column >>
Manufactured Runs: Doe... (06/20)
Next Article >>
Premium Article The Platoon Advantage:... (06/13)

Premium Article Minor League Update: Games of Wednesday, May...
Premium Article Painting the Black: Stealing Signs
Fantasy Rounders: Statistical Crossroads
Eyewitness Accounts: May 28, 2015
Premium Article Pitching Backward: Started From the Bottom, ...
Premium Article The Call-Up: Eduardo Rodriguez
Premium Article Some Projection Left: Ask the Industry: Catc...

Premium Article Overthinking It: Who Is the Best Umpire?
Premium Article Pebble Hunting: Swinging from His Toes to Hi...
Premium Article The Platoon Advantage: Cheating Cheaters and...
Fantasy Article Value Picks: Relievers for 6/13/12
Premium Article Collateral Damage Daily: Wednesday, June 13
Premium Article The Prospectus Hit List: Wednesday, June 13
What You Need to Know: Wednesday, June 13

2012-07-17 - BP Announcements: Playoff Odds Updated
2012-06-24 - BP Unfiltered: A More Honest Response to Tra...
2012-06-20 - Manufactured Runs: Does the Rockies' Four-Ma...
2012-06-13 - Premium Article Manufactured Runs: The Madness of King Bill
2012-06-06 - Premium Article Manufactured Runs: What We Really Know About...
2012-05-30 - Manufactured Runs: Who Gives a Shift?
2012-05-21 - Baseball Prospectus News: Improving the Odds

2012-08-15 - Premium Article Manufactured Runs: The Importance of Imperfe...
2012-07-18 - Premium Article Manufactured Runs: Getting Shifty Again
2012-06-20 - Manufactured Runs: Does the Rockies' Four-Ma...
2012-06-13 - Premium Article Manufactured Runs: The Madness of King Bill
2012-06-06 - Premium Article Manufactured Runs: What We Really Know About...
2012-05-30 - Manufactured Runs: Who Gives a Shift?
2012-05-16 - Premium Article Manufactured Runs: The Angels, Albert Pujols...