CSS Button No Image Css3Menu.com

Baseball Prospectus home
  
  
Click here to log in Click here for forgotten password Click here to subscribe

<< Previous Article
Premium Article Kiss'Em Goodbye: Balti... (09/14)
<< Previous Column
Premium Article Prospectus Perspective... (09/13)
Next Column >>
Premium Article Prospectus Perspective... (09/17)
Next Article >>
Premium Article Prospectus Hit and Run... (09/14)

September 14, 2010

Prospectus Perspective

Missing the WAR

by Colin Wyers

the archives are now free.

All Baseball Prospectus Premium and Fantasy articles more than a year old are now free as a thank you to the entire Internet for making our work possible.

Not a subscriber? Get exclusive content like this delivered hot to your inbox every weekday. Click here for more information on Baseball Prospectus subscriptions or use the buttons to the right to subscribe and get instant access to the best baseball content on the web.

Subscribe for $4.95 per month
Recurring subscription - cancel anytime.


a 33% savings over the monthly price!

Purchase a $39.95 gift subscription
a 33% savings over the monthly price!

Already a subscriber? Click here and use the blue login bar to log in.

The end of the season brings with it a lot of miserable things. It brings about the playoffs (and trust me, for a Cubs fan, that’s about as miserable as it gets), and soon thereafter the end of baseball altogether for the season (well, this may be more miserable). It also brings with it awards voting season.

Zounds! Awards voting season. Rarely is so much passion devoted to so little meaning—if by rarely you mean “every year, like clockwork.” It’s important to remember that, except nobody ever does. It’s as if every year September comes around and everyone is a tabula rasa—every argument starts over as if we’ve never been through this before.

Which would be fine, if these were interesting or stimulating debates, but most of them aren’t. Perhaps the most interesting thing you can learn from these discussions is the staggering number of people who can simultaneously believe “too much attention is paid to statistics in baseball” and “so-and-so is obviously the winner because of his impressive [HR | RBI | Win] totals.”

The awards themselves are of little help—most of them consist of only the vaguest of qualifications, so every voter is given wide latitude to define what the awards mean. And most of them are happy to explore every inch of that latitude.

And the focus of all this tempest in a tea pot? Finding the best player, or the best pitcher, or the best rookie… so on and so forth. But frankly, the gap between the best and the next best isn’t much of a gap at all. And it turns out that the smaller the gap, the more (not less) contentious things become. Large differences are easy to measure, small differences are hard.

This is something I’ve wanted to discuss ever since Murray Chass wrote about his ex-employer printing Wins Above Replacement in connection to the MVP and Cy Young voting. Very little has changed since the last time Chass made such a broadside, except now Nate Silver has a job at the New York Times and Murray Chass runs a blog.

So in a nod to that look back at Chass’ unchanging views on baseball stats, let’s look at the top 10 position players in the NL in Value Over Replacement Player:

#

Name

Team

POS

PA

VORP

1

Albert Pujols

SLN

1b

621

68.5

2

Joey Votto

CIN

1b

585

66.2

3

Carlos Gonzalez

COL

lf

562

64.3

4

Hanley Ramirez

FLO

ss

601

55.2

5

Adrian Gonzalez

SDN

1b

611

52.6

6

Troy Tulowitzki

COL

ss

448

52.4

7

Matt Holliday

SLN

lf

589

50.9

8

Ryan Zimmerman

WAS

3b

564

47.5

9

Aubrey Huff

SFN

1b

594

45.8

10

Prince Fielder

MIL

1b

630

44.9

I think if I presented you with that list of players as the “top 10 in the National League,” you’d be inclined to say—yeah, that’s reasonable. (Of course, I can come up with similarly reasonable listings by pulling up the top 10 in WARP, or the top 10 in WAR, or the top 10 in WAR–-depending on if you’re visiting FanGraphs or Baseball Reference.) But in terms of awards voting, the listing of the top 10 is less important than where those players rank in the top 10 To illustrate, those same players’ rankings in those measures:


VORP

WARP

fWAR

rWAR

Albert Pujols

1

1

3

2

Joey Votto

2

3

2

5

Carlos Gonzalez

3

10

9

8

Hanley Ramirez

4

21

18

18

Adrian Gonzalez

5

2

7

1

Troy Tulowitzki

6

4

6

3

Matt Holliday

7

6

4

11

Ryan Zimmerman

8

13

1

6

Aubrey Huff

9

5

8

4

Prince Fielder

10

15

22

15

I expressly didn’t compute an average of each player’s ranking in each measure, because that I think would distract rather than enlighten. The point is that the ranking isn’t very helpful in the first place—they’re such fragile things. Add three runs to Carlos Gonzalez’s VORP and he leaps from third to first.

That’s because the precision with which we’re measuring is somewhat less than the differences between these players. And beyond our precision in measurement, what these metrics are is a collection of assumptions about how baseball players create value. And often two very similar metrics will have different assumptions—about positions, about parks, about how to measure defense.

So in the sabermetric approach, there is still room for dissent. We aren’t heading for Chass’ imagined future, where a computer does all the reckoning and humans are mere observers. The computer is a tabulation machine, nothing more or less—it does the rote calculation as instructed to by a thinking human being.

I think what the sabermetric approach does best is it encourages you to think through the process of evaluating players, independently of the results. That strikes me as distinct from the way a lot of awards voters do it, which is to look at players and then work their way to figuring a definition of value. Much to do has been made of Gonzalez’s home-road splits, for instance. And we know that a player’s home park can affect scoring, and that Coors Field is certainly one of those parks. But once we adjust for that (and again, there are different assumptions you can make in doing so that can affect the outcome), does the magnitude of the home-road split matter? Once you figure out these rather subtle questions, the ordinal ranking of value falls into place rather easily.

But the downside is that, in collating all these assumptions into a single number, we invite people skipping all the details and going straight to the conclusion, sometimes not caring about the operating assumptions (or understanding that they exist at all—I’m still rather astonished by people who will quote “WAR” without bothering to note what site the numbers came from). The assumptions matter—in the aggregate sometimes not a lot, but for an individual player they can make all the difference in the world. And by uncritically quoting any of these metrics without examining the assumptions you’re letting someone else do your thinking for you.

I think the worst thing that could happen is for people to start treating any “above replacement” measure the way people 50 years ago treated pitcher wins or runs batted in. That would indicate that sabermetrics won some battles but lost, so to speak, the war. Because it’s not about numbers, it’s about a way of thinking about baseball (and the world)—one that admits that there are always new things to learn and new discoveries to make.

So I implore you—get your nose out of a game and watch a spreadsheet once in a while. I don’t mean to look at the results—I mean examine the process. Don’t think about what the numbers say, think about why the numbers are what they are and what assumptions you have to make to get there. Conclusions are boring and sometimes more final than they ought to be. It’s in figuring out how we come to those conclusions that we end up learning something meaningful about baseball.

Colin Wyers is an author of Baseball Prospectus. 
Click here to see Colin's other articles. You can contact Colin by clicking here

Related Content:  Murray Chass

16 comments have been left for this article.

<< Previous Article
Premium Article Kiss'Em Goodbye: Balti... (09/14)
<< Previous Column
Premium Article Prospectus Perspective... (09/13)
Next Column >>
Premium Article Prospectus Perspective... (09/17)
Next Article >>
Premium Article Prospectus Hit and Run... (09/14)

RECENTLY AT BASEBALL PROSPECTUS
Premium Article Baseball Therapy: Starving Young Royals, Bat...
Premium Article The Prospectus Hit List: Wednesday, Septembe...
Eyewitness Accounts: September 17, 2014
Premium Article What You Need to Know: September 17, 2014
Fantasy Article Fantasy Freestyle: Streaming Strikeouts
The Lineup Card: Eight Memorable Final-Week ...
Premium Article Skewed Left: How to Change Things When Chang...

MORE FROM SEPTEMBER 14, 2010
Premium Article Prospectus Hit and Run: JUMP Again
Premium Article Kiss'Em Goodbye: Baltimore Orioles
Premium Article Expanded Horizons: Don't Call It a Comeback
Relief Corpse
Premium Article Another Look: Reconsidering Pete Rose
Premium Article Prospectus Q&A: Dellin Betances

MORE BY COLIN WYERS
2010-09-28 - Reintroducing PECOTA: Whatever Happened to t...
2010-09-26 - BP Unfiltered: Retiring the Sauce
2010-09-22 - Manufactured Runs: A Walk in the Park
2010-09-14 - Premium Article Prospectus Perspective: Missing the WAR
2010-09-12 - BP Unfiltered: Why the Padres do not have a ...
2010-09-08 - Premium Article Manufactured Runs: Solving the Mays Problem
2010-09-08 - Between The Numbers: More charts and tables!
More...

MORE PROSPECTUS PERSPECTIVE
2010-09-21 - Premium Article Prospectus Perspective: September Song
2010-09-20 - Premium Article Prospectus Perspective: How Important is the...
2010-09-17 - Premium Article Prospectus Perspective: Dunn Enough?
2010-09-14 - Premium Article Prospectus Perspective: Missing the WAR
2010-09-13 - Premium Article Prospectus Perspective: Padres' Playoff Chan...
2010-09-10 - Premium Article Prospectus Perspective: Man Up, Mariners!
2010-09-09 - Premium Article Prospectus Perspective: Race to the Top
More...

INCOMING ARTICLE LINKS
2010-11-03 - Manufactured Runs: Replacing Replacement