CSS Button No Image Css3Menu.com

Baseball Prospectus home
Click here to log in Click here for forgotten password Click here to subscribe

<< Previous Article
Fantasy Article Fantasy Focus: Left Fi... (03/02)
<< Previous Column
Premium Article Expanded Horizons: Ove... (02/23)
Next Column >>
Premium Article Expanded Horizons: Bra... (03/09)
Next Article >>
Premium Article An Agent's Take: Crisi... (03/02)

March 2, 2010

Expanded Horizons

Best Non-Closers

by Tommy Bennett

the archives are now free.

All Baseball Prospectus Premium and Fantasy articles more than a year old are now free as a thank you to the entire Internet for making our work possible.

Not a subscriber? Get exclusive content like this delivered hot to your inbox every weekday. Click here for more information on Baseball Prospectus subscriptions or use the buttons to the right to subscribe and get instant access to the best baseball content on the web.

Subscribe for $4.95 per month
Recurring subscription - cancel anytime.

a 33% savings over the monthly price!

Purchase a $39.95 gift subscription
a 33% savings over the monthly price!

Already a subscriber? Click here and use the blue login bar to log in.

Always a Bridesmaid, Never a Bride

For a certain type of completist, memorizing all the relievers that get roster spots by virtue of 13-man pitching staffs is the troublesome last mile. Any fantasy player worth his salt can rattle off nearly every team's closer, even ones whose job security is questionable. But closers aren't always selected purely on merit, and there is usually a flamethrower waiting in the wings to become the anointed. Those relievers who, for whatever reason, do not close ballgames but that nevertheless mow down hitters are fascinating to me. Ask most fans who the best non-closer reliever in baseball is, they might stumble a bit, but you'll get a pretty interesting discussion going.

Like Janus, Looking Forward and Backwards

Any statistical attempts to answer the question will be highly sensitive to the metrics chosen. We know ERA is unacceptable for relievers, but most rate stats suffer similar problems. We can look at component stats, but even then small sample size problems still persist. Besides, there seems to be a stronger edict for asking how a player actually did, rather than how he ought to have done, or could have done), when it comes to relievers. On the other hand, we cannot simply look backwards to evaluate talent, since we would inevitably single out guys who were merely lucky to be there.

To solve these twin problems, I came up with a toy to try to rank relievers. It's not a complicated toy. In fact, it only has two moving parts: SIERA and WXRL/LEV. I hope by now you've had a chance to peruse Eric Seidman & Matt Swartz's series on SIERA, but the gist is that it gives an estimation of a pitcher's controllable skills (fly ball rate, strikeout rate, ground ball rate, and walk rate) and considers how they interact with one another. Put simply, it's a way to evaluate the totality of a pitcher's skills while looking beyond contingent (or luck-based) factors. WXRL, on the other hand, is a metric based on win expectancy. It simply measures, compared to replacement and adjusted for quality of opposing lineup, how the likelihood of the reliever's team winning changed from when he entered the game to when he left. Because it is dependent on the situations in which a pitcher is deployed (and thus would favor closers especially), I have divided it by LEV, which is a measure of the leverage of the average situation the pitcher faced. (I realize there have been criticisms of LEV, but as a rough and ready way to de-leverage WXRL, it should do fine.) Remember, with SIERA, lower is better, but with WXRL/LEV, higher is better (because it is denominated in wins).

Damn the Torpedoes

I've taken these two measures of reliever performance, and ranked the best relievers (with more than 25 IP) in each measure for the 2009 season. I've assigned a number rank based on position in each list. I've then added the ranks on the two lists together, and re-sorted that list from lowest to highest. In other words, to rank high on my hybrid list, a reliever must have done well in both WXRL/LEV and SIERA in 2009. Here are the top three overall (SIERA and WXRL/LEV in parentheses):

1. Jonathan Broxton (1.98 SIERA, 2.84 WXRL/LEV)
2. Joe Nathan (2.31, 3.18)
3. Mariano Rivera (2.44, 3.25)
3. Michael Wuertz (2.21, 3.13)

Wuertz snuck in to tie Rivera, placing ahead of closers Huston Street (tied for fifth), Jonathan Papelbon (seventh), Joakim Soria (eight), Andrew Bailey (ninth), and Rafael Soriano (10th). Obviously, he's No. 1 on the non-closer list, presented below.

1. Michael Wuertz (2.21, 3.13)
Wuertz's slider is truly a sight to behold, and many hitters have walked red-faced back to the dugout after beholding it dart through the zone for a backwards K. Though pitchF/X data tell us his fastball sits around 91 mph, the slider is more than enough to make him among the most dangerous non-closer relievers in baseball. Because he plays in a pitcher-friendly park and generates plenty of ground balls, he's likely to continue to succeed in 2010.

2. Matt Thornton (2.56, 2.81)
Thornton is a perfect example of how dominant relievers can emerge slowly and quietly. He's always had electric stuff (including a fastball that sits 95-96 mph and touches the high 90s), but in the last two years, Thornton has become nearly unhittable. Last season in 72.1 innings, Thornton struck out 87 and walked just 20. Did I mention his ground ball tendencies? Those are the kinds of peripherals that SIERA notices, and his mark was lower than his still-low ERA (which was 2.74 in 2009).

3. Luke Gregerson (2.91, 1.96)
Acquired prior to last season in the deal that sent Khalil Greene to the Cardinals, Gregerson flourished in his Padres' debut. Though there are worse gigs to help a reliever's value than pitching in Petco Park, Gregerson was not a product of his circumstances. In 75 innings, he struck out an astounding 93 batters. He issued just 22 unintentional walks and allowed just three home runs. His low-90 mph fastball doesn't blow guys away, but he supplements it with a nifty slider that also generates plenty of ground balls.

4. Pedro Feliciano (3.07, 2.04)
One byproduct of a list generated like this is that the WXRL aspect tends to favor high-workload LOOGYs like Feliciano. Nevertheless, he's earned his way on the list, and SIERA is especially good at evaluating extreme groundballers like him.

5. Mike Adams (2.09, 1.58)
Another byproduct of this list is that it can value guys like Adams, who pitched just 37 innings in '09, but was utterly dominant. Like Feliciano, Adams doesn't have one dominant out pitch. Instead, he combines his low-90s fastball with a kitchen sink approach that baffled hitters in limited time. The result was a 45/7 K/UBB. It's around this point that you start wondering where the Padres find all these guys.

6. Jeremy Affeldt (3.46, 2.68)
The Old Man and the Bay may sport the highest SIERA of any guy on the list, but his extreme ground ball tendencies last season (64-percent ground ball rate) helped him rack up the WXRL. A sinkerballer who throws mid-90s can kill plenty of rallies, but Affeldt may be the guy on this list I most doubt going forward.

7. Neftali Feliz (1.99, 1.35)
Like Adams, Feliz just didn't have the reps to accumulate WXRL, but, boy howdy, did he dominate the SIERA leader board. Only Broxton bested him, and Feliz's stuff is probably better than anyone else's on this list. His high-90s fastball is enough to make grown men (or Kevin Goldstein, at least) weep. Whether he remains a reliever in the short term is unclear, but his long term future is in the rotation.

8. Trever Miller (2.88, 1.60)
Miller's presence on this list is a lot like Feliciano's. He's a LOOGY who strikes out plenty of batters and managed to avoid yielding hits last year. He's been solid for several years now, so his formula may be more or less replicable.

9. Sergio Romo (2.64, 1.41)
Romo may be the biggest mystery on this list. Although his fastball sits right around 90 mph, his slider is his best weapon. He hasn't been used too much by the Giants in the last two seasons (just 68 innings combined in '08 and '09), but he has a 74/19 K/BB in that time. The Giants and Padres have cornered this list.

10. Nick Masset (3.32, 1.92)
White Sox fans, look away. Masset was part of the deal that sent Griffey, Jr. to the South Side, and has emerged as a very valuable reliever. He complements a mid-90s fastball with a curveball and cutter that is capable of generating ground balls. He benefited from a fluky-low BABIP and high LOB percentage last year, but his peripherals and stuff suggest he will be above average for several years.

Question of the Day

I limited myself to the methodology of my toy. Which deserving relievers did such a method leave out? Which included relievers are undeserving?

Related Content:  Relievers,  The Who,  Michael Wuertz,  Flamethrower

31 comments have been left for this article. (Click to hide comments)

BP Comment Quick Links


As a Padres fan, I've always felt that Kevin Towers (KT) was the best at finding live arms to stock a deep bullpen. Guess we are about the find out if it was KT or something organizational.

Mar 02, 2010 09:35 AM
rating: 0

I agree-KT is a genius at finding "scrap heap" relievers. I'll be interested to see if the Yankees suddenly develop the ability to find those under-valued relievers now that he's on staff.

Mar 02, 2010 11:44 AM
rating: 0

KT did have some talent for this in the past, but I wouldn't be surprised if DePodesta had his fingerprints on some of the more recent ones. It's pretty well accepted that he's the one who pushed to get Heath Bell. It wouldn't surprise me if Adams or Mujica were his guys as well. I'd lean towards Gregorson being a KT guy though.

You also have to add in that Darren Balsley is absolutely fantastic at helping guys iron out some of their issues and making sure they are used appropriately.

Mar 02, 2010 14:58 PM
rating: 0

Padres unite! I hope you are right that DePodesta was involved, because KT did seem amazing at finding those arms. Sludge merchant: I think that was a self-description at one point.

Regarding Balsley, anyone ever see a "pitching coach lift" analysis, kind of like the ones that see if catchers improve pitcher performance (usually not)? Duncan in STL has the reputation, and I always hoped that Perez would completely flame out and SDP pick him up on a minor league deal only to get him back to prior glory.

Mar 03, 2010 08:00 AM
rating: 0

I can't imagine that Masset will continue his good fortune. I guess Moylan missed the list because he only had a handful of appearances in 2008 and had a week start to 2009, but he's a severe groundball releiver in a pitcher's park. Admittedly he's unlikely to go two years without allowing a HR, but surely he's one of the best non-closers in the game.

Mar 02, 2010 09:35 AM
rating: 0
Tommy Bennett

Moylan didn't do TERRIBLY by this metric last year, but his SIERA (3.66) wasn't great and his WXRL/LEV actually ranked still lower among his peers.

Mar 02, 2010 11:53 AM
rating: 0

Re: the Q of the day... off the top of my head, I'd think Phil Hughes deserved a mention.

Mar 02, 2010 10:11 AM
rating: 0
Tommy Bennett

Yeah, Hughes would actually qualify for this if I included both starter innings and reliever innings. But he loses out in WXRL when you look at just the reliever innings, so he slipped past Romo in my methodology. If he were a reliever for a full year, he might very well qualify.

Mar 02, 2010 11:47 AM
rating: 0
Tommy Bennett

*Romo and Masset, that should be.

Mar 02, 2010 11:48 AM
rating: 0

Dave Robertson.

Mar 02, 2010 10:14 AM
rating: 0
Tommy Bennett

Robertson is hurt by his low WXRL, but he's a good bet going forward, provided he limits the walks.

Mar 02, 2010 11:52 AM
rating: 0

Hughes or Chamberlain - whichever one ends up in the pen.

Mar 02, 2010 10:18 AM
rating: 0

Sergio Romo throws several different pitches for a lot of different arm angles, and manages to get them into the strike zone. He looks 'different' enough that guys don't have time to figure him out when he only goes through the lineup one time (or less). He has had a couple of minor injuries which is the primary reason he hasn't pitched much. I love watching Romo pitch, but he is kind of risky bet because he doesn't throw that hard and needs to hit his spots more than most guys to be effective.

Mar 02, 2010 10:26 AM
rating: 0

Wouldn't it be White Sox fans that need to look away and not Seattle fans? Masset went from CWS to CIN in the Griffey deal...

Mar 02, 2010 10:39 AM
rating: 1
Tommy Bennett

Yep, that's a typo! Thanks for the good catch.

Mar 02, 2010 11:32 AM
rating: 0

White Sox fans such as myself are too stunned by the inclusion of Nick Masset on a good anything list to turn away. Seriously? Nick Masset? How easy is it to pitch in the NL??

Mar 02, 2010 11:34 AM
rating: 2

When healthy, Hong-Chih Kuo has looked very good the last two seasons.

Mar 02, 2010 11:43 AM
rating: 0
Morris Greenberg

No mention of Angel Guzman? He has been pretty great.

Mar 02, 2010 13:05 PM
rating: 0
Tommy Bennett

His 4.09 SIERA basically disqualified him.

Mar 02, 2010 14:16 PM
rating: 0

Mujica seemed to have solid year for the Padres when he worked out of the pen. I would assume that his numbers as a starter later in the year complicate things.

Mar 02, 2010 14:55 PM
rating: 0

Is Ryan Madson considered a closer?

Mar 02, 2010 15:09 PM
rating: 0
Tommy Bennett

I wouldn't have counted him as the closer, but he ranked 30th overall on the list (which includes closers). That means he just missed this list.

Mar 02, 2010 15:20 PM
rating: 0

Thank you for finally giving some love to Mike Adams. He put up nintendo numbers the last two seasons. I've rooted for him a long time-he's had knee surgeries (both knees) and shoulder surgery for good measure. He does nothing but dominate in between the DL stints. If he's healthy, I'd think the Padres will make Heath Bell available, and slide Adams into the 9th. I know I would.

Mar 02, 2010 15:41 PM
rating: 0

When will pitching metrics advance to the point where quality of opposition faced is used to calculate an opponent-neutral ERA? A key component of the opp. "quality" calculation would be handedness of the batter rel. to the pitcher. Continuing to evaluate pitchers without doing this is like using a college football power rating that doesn't incorporate strength of schedule.

Mar 02, 2010 21:02 PM
rating: 0
Matthew W

Thats why he used SIERA and WXRL/LEV instead of ERA...ANY ERA(opponent neutral or not) is basically garbage. There is more to a pitcher than just the batters he faces(Lefty or Righty) and the actual outcome of his efforts. (ie. Defense, Park factors, BABIP, etc.)

Mar 03, 2010 07:00 AM
rating: 0

Anybody from the Rays a threat to make this list? They always seem to have a deep bullpen.

Mar 03, 2010 07:46 AM
rating: 0

Be curious to know how Matt Guerrier would compare. The Twins bullpen in general seems solid. Guerrier has led the league in appearances for the last two years. Impressive that he's held up pretty well despite pitching in 70+ games three years running.

Mar 03, 2010 08:41 AM
rating: 0

I think it would be interesting to see how these guys rank on the complete list. How many non-closers outpitched the worst closer?

Mar 03, 2010 21:06 PM
rating: 0

From the rebuilding Blue Jays you might want to consider Jason Frasor. He had 11 saves last year and is definately in the mix for the closer's job this year. He also has an improved change up which made its appearance last year as well. From the various interviews it seems that he's ready for the position and with no incumbant he may very well get the job.

Mar 04, 2010 05:48 AM
rating: 0

A few other names to toss out there, based on a scan of Strat-O-Matic ratings, not SIERRA or WNXL/LEV (for which I don't have the whole list):

Claudio Vargas
Darren O'Day
Brian Sanches
Fu Te Ni
Kiko Calero
Joe Thatcher
Alfredo Aceves
Sean Burnett

All would be solid non-closer Strat cards in the 2009 set.

Mar 08, 2010 09:46 AM
rating: 0

Meant WXRL/LEV...sorry

Mar 08, 2010 09:47 AM
rating: 0
You must be a Premium subscriber to post a comment.
Not a subscriber? Sign up today!
<< Previous Article
Fantasy Article Fantasy Focus: Left Fi... (03/02)
<< Previous Column
Premium Article Expanded Horizons: Ove... (02/23)
Next Column >>
Premium Article Expanded Horizons: Bra... (03/09)
Next Article >>
Premium Article An Agent's Take: Crisi... (03/02)

Fantasy Rounders: The Slump Buster
Premium Article What Scouts Are Saying: July 1, 2015
Premium Article Going Yard: Futures Game: USA Bats
Premium Article Minor League Update: Games of Tuesday, June ...
Premium Article What You Need to Know: July 1, 2015
Premium Article Notes from the Field: July 1, 2015
Premium Article The Call-Up: Miguel Sano

Premium Article An Agent's Take: Crisis Management
Fantasy Article Fantasy Focus: Left Fielder Rankings
Fantasy Article Team Health Reports: Cincinnati Reds

2010-03-09 - No Pepper: Against the Fence
2010-03-08 - No Pepper: Against the Fence
2010-03-03 - No Pepper: Against the Fence
2010-03-02 - Premium Article Expanded Horizons: Best Non-Closers
2010-02-23 - Premium Article Expanded Horizons: Overrating Fifth Starters
2010-02-22 - No Pepper: Search Costs Versus Surplus
2010-02-17 - Premium Article Division Preview: AL East

2010-03-23 - Expanded Horizons: Mauer Present Value
2010-03-16 - Premium Article Expanded Horizons: Don't Count Out The Diamo...
2010-03-09 - Premium Article Expanded Horizons: Braves Optimism
2010-03-02 - Premium Article Expanded Horizons: Best Non-Closers
2010-02-23 - Premium Article Expanded Horizons: Overrating Fifth Starters
2010-02-16 - Premium Article Expanded Horizons: Thomas and Glavine
2010-02-09 - Premium Article Expanded Horizons: Catching conundrum

2011-01-26 - Premium Article Expanded Horizons: No One Man Should have Al...
2010-08-17 - Premium Article Expanded Horizons: Mariano Rivera, Outlier