Notice: Trying to get property 'display_name' of non-object in /var/www/html/wp-content/plugins/wordpress-seo/src/generators/schema/article.php on line 52
keyboard_arrow_uptop

Did you hear the one about the relief pitcher at the bar the night before the game? (One?) The guy is putting back his fair share of adult beverages when someone at the bar recognizes him.

“Hey, John,” the patron says, “should you be drinking tonight?” 

“No problem, buddy,” the reliever replies. “I’m not pitching tomorrow.”

“But… you’re the closer!”

Relievers are hard-partying bad boys who dye their beards with shoe polish and pump their fists when they successfully withdraw money from an ATM. While the popular picture may have a kernel of truth, it is connected to a widespread view about the usefulness about relievers. For many analysts, relievers—especially free-agent relievers—simply aren’t worth the money their images would lead you to believe they are.

The question of whether relievers as a whole are overpaid relative to talent at other positions is a notoriously difficult one to solve. I’m not sure anyone has the final answer yet. But some relievers are better than others, and some get paid more than others. That means that, at the very least, we can look for relative bargains on the free-agent market for relievers.

SIERA + WXRL = AX RE SWIRL

In the past, I have used a metric that blends WXRL and SIERA to evaluate relievers from year to year. This approach has the advantage of combining two types of information we have about relievers. WXRL gives us a sense of how much a pitcher contributed to his team’s chances of winning the game; it’s all outcome and no peripherals (adjusted, of course, for lineup and replacement level). SIERA, on the other hand, is nearly the opposite. It tells us how strong a pitcher’s key peripherals were, especially strikeout, walk, and ground-ball rates. SIERA also has the virtue of doing a nice job predicting future ERA. To succeed in both WXRL and SIERA, then, a pitcher must have dominant peripheral stats and perform well in the box score.

What we’ll do, then, is look at how much better than average each reliever—at least 20 relief IP and no more than 20 innings as a starter—is in both WXRL and SIERA. (Technically, I’ve calculated z-scores.) The scores are combined and compiled into a single list. A deficit in one can be overcome by superb performance in the other, but the very best firemen top both lists. For example, here are the top 10 from 2010:

 

Name

Team

LG

WXRL

SIERA

Carlos Marmol

CHN

NL

5.351

2.13

Joakim Soria

KCA

AL

6.529

2.87

Brian Wilson

SFN

NL

6.271

2.72

Heath Bell

SDN

NL

6.508

2.87

Hong-Chih Kuo

LAN

NL

5.167

2.37

Matt Thornton

CHA

AL

4.482

2.25

Rafael Betancourt

COL

NL

2.86

1.31

Rafael Soriano

TBA

AL

5.914

3.27

Joaquin Benoit

TBA

AL

3.063

1.71

Neftali Feliz

TEX

AL

4.667

2.98

Nothing gets your spreadsheet pumping like a 16.0 K/9, as Marmol had. Although he was outdone in WXRL by five others (Soria, Wilson, Bell, Soriano, and Brandon Lyon) and in SIERA by six others (Betancourt, Benoit, Billy Wagner, Craig Kimbrell, Joe Thatcher, and Koji Uehara), he experienced combined success in both categories more than anyone else. None of the other names in the top 10 are terribly surprising: each pitcher has had successful seasons in the past.

However, as the experiences of the pair of former Tampa Bay relievers at eighth and ninth disclose, near identical performance in this metric does not guarantee equal success on the free-agent market.

The Free Agents

Now let’s turn our stat to the free-agent relievers. There were 29 relievers who both pitched in 2010 and have been given contracts of at least $1 million (per year) this offseason. They range from Mariano Rivera’s two-year, $30 million contract to George Sherrill’s one-year, $1.2 million handout from the Braves. The following chart lists the free agents by the average amount they’ll be paid per year over the life of their new contracts. It also lists where they ranked on the SIERA/WXRL hybrid list.

 

Name

AAV

Rank

Mariano Rivera

$15.00

21

Rafael Soriano

$11.67

8

Bobby Jenks

$6.00

58

Joaquin Benoit

$5.50

9

Brian Fuentes

$5.25

56

Scott Downs

$5.00

34

J.J. Putz

$5.00

74

Kevin Gregg

$5.00

115

Jesse Crain

$4.33

70

Grant Balfour

$4.05

33

Pedro Feliciano

$4.00

75

Matt Guerrier

$4.00

113

Arthur Rhodes

$3.90

46

Octavio Dotel

$3.50

57

Jon Rauch

$3.50

63

Kyle Farnsworth

$3.25

77

Koji Uehara

$3.00

15

Dan Wheeler

$3.00

138

Jose Contreras

$2.75

47

Will Ohman

$2.00

146

Aaron Heilman

$2.00

215

Takashi Saito

$1.75

24

Hideki Okajima

$1.75

225

Chad Qualls

$1.50

124

Kerry Wood

$1.50

219

J.C. Romero

$1.35

196

Randy Choate

$1.25

84

D.J. Carrasco

$1.25

150

George Sherrill

$1.20

244

The chart discloses that reliever pay at least loosely tracks previous-year performance, but it doesn’t do so exactly. For example, Takashi Saito stands out as a bargain: his WXRL of 2.0 and his SIERA of 2.48 were both well above average, and yet the Brewers owe him just $1.75 million. Part of the reason is that Saito is entering his age-41 season and is coming off a season in which he battled shoulder injuries.

Koji Uehara, on whom the closer mantle has only just begun to rest, also looks like a bargain. He had a SIERA of 2.04 and a WXRL of 1.99, which was good enough for 15th overall. This isn’t an example of hidden value, either. Even Uehara’s baseball card would disclose the fact that he allowed just five walks in 44 innings last year, his first in relief. Uehara will head back to the Orioles at a salary ($3 million) lower than what he earned in 2010 ($5 million).

On the other side of the ledger, Bobby Jenks and Brian Fuentes both look overpaid (by the Red Sox and Athletics, respectively). Although each did manage a slightly above average season last year, neither was among baseball’s 50 best relievers. Both pitchers received multi-year deals. Kevin Gregg, meanwhile, did not reach even the modest heights of statistical averageness, but the Orioles have guaranteed him a cool $10 million over the next two years.

As a final point, it may be useful to plot these data points in a scatter fashion.

Above the trend line is the better place to be, at least from a team’s standpoint. The four that stick out from the rest are, from left to right, are Saito, Uehara, Benoit, and Soriano. As the chart makes clear, teams do not base their decisions on anything so rigid as this formula. In some cases, like to take into account age and injury risk, this is appropriate. In other cases, it appears to be a much more simple mistake. However much we may want to defend the rationality of hard-working and intelligent front offices, some of these salaries just don’t line up.

Thank you for reading

This is a free article. If you enjoyed it, consider subscribing to Baseball Prospectus. Subscriptions support ongoing public baseball research and analysis in an increasingly proprietary environment.

Subscribe now
You need to be logged in to comment. Login or Subscribe
BBBill
1/26
It would be very interesting to see the same type of plot comparing Average Salaries per Year to Saves, to see if that variable shows a stronger correlation. This might prove indicative of the mindset of GMs as they shop for relievers.
nateetan
1/26
The trend line is extremely warped by the Yankees' signings.
rawagman
1/26
Not really. The trend would still be similar, but it would be a far shorter line!
LynchMob
1/26
Would be interesting to see ... I'm guess that rather than a shorter line, the scale of the x-axis would change :-) ... still would be interesting to see.
tbsmkdn
1/26
Sounds like a reasonable request to me!

Reliever Chart Without Yankees

Note: I only removed Rafael Soriano and Mariano Rivera, since Pedro Feliciano seems pretty well inside the main cluster.
TheRedsMan
1/26
2 things:

1) I think with relievers, you see teams paying a significant premium for perceived reliability.
2) I think SIERA gives teams too much credit in their assessment of reliever ability. It seems to me that teams pay more attention to ERA and assume a significant correlation between ERA and leverage. That is, if a reliever has an ERA higher than his SIERA (FIP, etc), it is generally assumed that he struggles with high leverage situations.

Combine these and you wind up with the relievers who put up a low era over multiple years in higher leverage situations getting the big bucks. Teams are adding in a variable which has a geometric multiplier effect.