August 22, 2007
The Big Picture
Re-calculating the Save
Two weeks ago I proposed a new way of defining saves. The save had been instituted to reward the evolving role of the fireman, the reliever who came into a game in a tight situation to save the day. However, today's closer rarely faces a game on the line situation, unless he creates it himself. The rule defined the role over the years, turning saves into relatively passive activities. It's time to refine the rule, or introduce a more active statistic to move the closer back to the role intended, the pitcher who saves the day.
Which is where I came up with my proposal--rather than awarding saves to the person who finishes the game, the reward goes to the pitcher with the best performance in terms of increasing the team's chance of winning while also meeting a threshold increase of 0.1. Unlike the 1970s, when baseball defined the save rule, we now know the probability of a team winning at every point in the game. Given the score, base situation, and inning when the reliever enters and leaves the game, we can tell how much he helped shift the probability toward winning.
That was the theory. This week's column puts the theory into practice to find out how the proposed rule changes the number of saves awarded and which pitchers benefit and decline under this scheme. The play-by-play data used comes from Baseball Info Solutions and covers 2002-2006. William Burke and Keith Woolner supplied the Win Expectancy data, and I'm grateful for their help.
For every game in that time frame, queries determined the last event in a game in which a team was tied or trailing. Relievers entering the game after that point were eligible for a save, provided they did not get the win. For each reliever eligible, the inning, half-inning, outs, base situation, and score difference was recorded both for the event in which he entered the game and the event in which he left the game. Queries then calculated the win expectancies for both points, and the difference became the score for the pitcher for the game. If the score was...
... then the reliever was credited with a save. Note that the team's chance of winning has to increase by at least 0.1--to spell it out, that means if a team already has better than a 90 percent chance of winning, the reliever can't get a save.
The data shows that the new proposal eliminates about 40 percent of current saves:
A much higher percentage of saves under the current rule are eliminated, almost 65 percent. Over one-third of those lost are shifted to other pitchers with the new proposal, however:
The data shows that a large number of saves are going to pitchers who enter the game in high-probability win situations. This rule shaped strategy and contract negotiations for a generation, and yet it is mostly applied in situations where the probability of winning is already better than nine in ten. The distribution of the various parameters shows us how the new proposal shifts save opportunities. First, the distribution of inning entered:
As you can see, many of the ninth inning saves are eliminated. Basically, if you enter the start of the ninth and the lead is two runs or more, there's no save opportunity. Notice, however, that pitchers in the sixth and seventh inning get many more chances to pick up a save.
The next table shows the distribution of outs when entering the game:
The distribution is not all that different. A higher percentage of saves comes with outs already recorded in the inning, but the great majority still occur with a pitcher entering with no outs. Pitching a full inning without allowing a run raises the win expectancy by over 0.1, and that gets higher the later in the game a pitcher enters.
Now for the base situation the pitcher faces entering the game:
Again, the number of saves awarded in the relatively easy situation of entering the game with no one on is reduced. But while the number of saves rewarded in tougher base situation goes up, the current rule actually does a pretty good job of rewarding pitchers who enter games with runners on base.
The distribution of the lead a pitcher inherits changes things quite a bit:
Under the current rule, saves are pretty much evenly distributed over one-, two-, and three-run leads. Again, the rule for awarding a save by starting the ninth with a three-run lead or less shapes the distribution, but under the new proposal, the distribution is heavily weighted to games with a smaller score difference. Another way to look at this is by subtracting inherited runners from the lead, a measure of potential scoring:
This distribution makes it clear that saves under the new proposal are shifted to much more perilous situations. Under the current rule, the distribution peaks at +2, but with the new proposal, 87 percent of the saves come in situations where this figure using leads minus baserunners is one or less, or the games that are really in jeopardy. It is also clear on examination of the average win expectancy when a pitcher enters a game for a save--the average win expectancy for a pitcher earning a save under the current rule is 0.89, but under the new proposal, 0.77.
The new proposal clearly makes earning a save more difficult. Just how much is evident in the leader board for the new proposal over the five years from 2002-2006:
It seems the quality closers also do very well under the new proposal. What interests me is if this rule change was ever adopted, would managers start using these relievers differently? Would we see them more often in the eighth inning, or even the seventh? Some closers complain if they come in before the start of the ninth. If coming into a key situation in the seventh will earn them a save, are they more likely to want to pitch early? Would they eschew pitching with a two-run lead in the ninth? I'd suggest that closers pitch longer in games less often; better to save them for that tough situation in the eighth, and give someone else the three-run lead in the ninth.
There are, of course, pitchers who do face those early, tough situations. Here are the pitchers who increase their saves by at least ten under the new proposal; you'll recognize a few quality set-up men in that group.
Among the many excellent comments on the original piece, one person suggested that since the chances of a change to the save rule were thin, perhaps this new proposal should stand by itself. He suggested, "The Rescue" be introduced as a new statistic. I like that idea very much; the difference between a save and a rescue is the difference between catching the person who tripped and rushing into a burning building to pull out the children. If a middle reliever ends up with more rescues than a closer, maybe fans and management will start to question that role more closely.