BP Comment Quick Links


December 16, 2010 Ahead in the CountHome Runs, Fly Balls, and PopupsI have always loved pitchers’ duels. One of my favorite childhood baseball memories is watching Curt Schilling throw a complete game shutout for the Phillies in a 20 win against the Blue Jays in Game Five of the 1993 World Series, with the Phillies facing elimination. I was only 12 years old at the time, and I did not know anything about sabermetrics, but Schilling appeared majestic as he pitched yet another brilliant start in what would become a magnificent playoff career. He only surrendered five singles that night and extended the series one more day. When I finally did learn about Defense Independent Pitching Statistics (DIPS) and Voros McCracken’s discovery that pitchers have little control over batting average on balls in play, I found it mildly disappointing to look back at that box score and discover Schilling actually had rather mediocre DIPS numbers that night—just six strikeouts and three walks. However, I still felt confident in my memory that I had seen a great game as a youngster, and I convinced myself that the lack of home runs that Schilling allowed were evidence that he was unhittable that night. Unfortunately, I later discovered that pitchers have little control over the rate of home runs allowed per fly ball, and that Schilling actually generated just 10 ground balls that night on 24 balls in play. Though DIPS Theory finds Schilling’s entire career amazing, his numbers from that alleged gem appeared pedestrian even on that front. Some fans probably dislike DIPS Theory because it takes the glamour away from memories like these, but I find myself appreciating individual pitching performances more now that I have a better understanding of the game. Seeing a pitcher like Tim Lincecum strike out 14 hitters in his playoff debut adds to the majesty of the 2010 postseason, rather than takes away from Roy Halladay’s playoff nohitter the day before. The knowledge of what good pitchers do and do not control has given me an ability to watch a brilliant pitching performance critically and appreciate the masterful performances more. Elementary DIPS theory is well established. Pitchers have a lot of control over strikeout, walk, and groundball rates, as evidenced by the yeartoyear correlation of this statistic, but they have poor control over batting average on balls in play (BABIP). While we have known for some time that pitchers also have little control over HR/FB, statistics like FIP remove all of the variance from BABIP and reproduce an ERA with a leagueaverage BABIP for all pitchers, but leave in all of the variance in HR/FB. This treats HR/FB as a skill and hides the fact that home it is a statistic that pitchers show even less ability to maintain than their BABIP. Looking at home runs per outfield fly ball is important, because some pitchers do have some tendency to allow more popups than others, even controlling for team. Below I list the yeartoyear correlation of different statistics for 549 pitchers with at least 300 balls in play in consecutive seasons from 200310. For BABIP and HR/FB, I give numbers net of team performance (because defense and parks affect these numbers similarly for pitchers on the same team).
Pitchers actually appear to have more control over the rate of hits allowed on balls in play than they have control over the rate that outfield fly balls go for home runs. Yet statistics like FIP remove the luck from BABIP, but not HR/FB, because it is known that the rate of HR/FB is a little persistent. However, since BABIP is even more persistent, this does not make much sense. Statistics like SIERA and xFIP that neutralize the number of HR/FB do a better job of explaining reality when you have only a limited amount of information about a pitcher. Tom Tango has often argued that several seasons of data will show patterns in HR/FB, and that FIP will outlast xFIP when predicting ERA for pitchers with several years of data available. The problem is that excluding BABIP for several years of data by using FIP will ignore the control that pitchers have over BABIP as it reveals HR/FB skill, and ERA itself may be better at showing a pitcher’s skill level with several years of data than FIP will. Somewhat interesting was that popup rate has a high yeartoyear correlation itself (.582). But what was surprising was that even after adjusting for team (and therefore park and foul ground area), the rate of popups per fly ball also had a pretty high yeartoyear correlation (.328). This suggests that inducing popups is a skill beyond being a product of being a flyball pitcher. Therefore, SIERA’s inclusion of outfield fly balls and infield popups together may be something worth revisiting as we learn more about pitching. All numbers in the below table are computed relative to total team numbers, and are for all pitchers with at least 100 balls in play in consecutive seasons between 2003 and 2010 (a sample size of 1459).
However, the rate of popups per ball in play does not have a significant correlation with the rate of home runs per outfield fly ball (.043). The importance of making an adjustment to SIERA seems minimally important, as the correlation between nextyear’s ERA and this year’s popup rate is low as well (.028). On the other hand, regressing next year’s ERA on this year’s popup rate and this year’s outfield flyball rate shows an interesting effect. Next Year’s ERA = 4.96 – 9.77*(net PU%) + 7.71*(net FB%) The net popup rate coefficient is significant, with p=.022. This suggests that differentiating popups and fly balls may be more useful and could be used to enhance SIERA. Although the rate of popups per ball in play does not correlate with the rate of HR/FB, this does not mean that we cannot learn something important about this statistic. In fact, part of the strength of SIERA comes from the fact that it implicitly models the rate of HR/FB similarly to how it implicitly models BABIP. I checked the correlation of HR/OFB with DIPS statistics:
The reason that the strikeout coefficient in SIERA is so large is that not only do strikeouts lead to lower ERAs in and of themselves, but they also correlate with lower BABIPs and lower HR/OFB rates, which likewise correlate with lower ERAs. Running a regression (on all pitchers with 100 balls in play or more) of HR/OFB rate on all three statistics does not show a statistically significant coefficient for anything but strikeout rate:
The equation of the regression with only strikeout rate is: Net home runs per outfield fly ball = .016  .100*(SO/PA) In the above regression, the pstatistic on strikeout rate is also less than .001. yesterday’s article both show the benefit of using regression analysis to study ERA. Pitchers clearly exhibit far more control over defenseindependent pitching statistics, but they still do have some control over BABIP and HR/FB. While looking at statistics like FIP removes the noise inherent in these two metrics, they also remove the skill. Since pitchers’ BABIP and HR/FB skills are significantly correlated with their DIPS skills, running a regression actually controls for these effects and gives an accurate reading of pitchers’ true skill levels with a unique methodology that picks up on factors that other measures do not. Overall, this article and
Matt Swartz is an author of Baseball Prospectus. 15 comments have been left for this article. (Click to hide comments) BP Comment Quick Links TangoTiger (57181) I've mentioned this to Matt on my blog, but I'll repeat it here. Dec 16, 2010 07:31 AM jlefty (39531) can't the answer be that FIP does both, depending on how it is used? As an ERA predictor, it acts like Matt describesignores noise and skill. As a representation of specific skills, it acts like Tango describes just observed results. Dec 16, 2010 08:19 AM I don't want my discussion of FIP to be mischaracterized. When I say "FIP assumes no BABIP control," I do not mean "Tom Tango assumes no BABIP control." I'm ONLY saying that his model is designed to neutralize BABIP, and one of the advantages SIERA has is that it neutralizes BABIP luck with neutralizing the whole thing. One of the model assumptions of SIERA is that all we know about BABIP can be explained by K, BB, and GB%. That's not a 100% true assumption either. But it's a feature of the model. Dec 16, 2010 11:18 AM mikewilsonelgin (57442) What about asymmetric ballparks? I seem to recall one of the Yankee pitchers (I think it was Sparky Lyle) claim that he pitched so that the ball would go to leftcenter if it were drilled. Would that affect HR/FB? Dec 16, 2010 08:59 AM Travis Leleu (4228) I believe that is accounted for when they compare a given pitcher's data to the team data. Matt explicitly mentions popups WRT infield foul territory, I would have to imagine it acts similarly for OF asymmetry. Dec 16, 2010 09:33 AM Yeah, it's probably very unlikely that many pitchers can really control where hard hit contact is made. If you're going to have that much control, you should probably aim to get the guy to make weak contact or miss. But a few pitchers probably do have the skill and intelligence to get that job done, which is why we do see somewhat positive correlations for a lot of the numbers above, even the ones close to zero. Dec 16, 2010 11:20 AM KaiserD2 (15467) This is very interesting, but I am confused on one point. Matt wrote near the end of the article: Dec 16, 2010 10:47 AM Well, the proof mostly comes at the beginning. The correlations of BABIP and HR/FB are positive and small. They are also significantly negatively correlated with K%, and BABIP is significantly correlated with GB%. So we do say evidence of that small amount of control in that respect. Pitchers who miss bats also tend to induce weaker contact. Dec 16, 2010 11:21 AM TangoTiger (57181) I think what Kaiser's point is one that permeates everywhere: if you see a correlation of r=.10, then, that's it. It's r=.10. But, it's only r=.10 when BIP=400 (or whatever Matt used). Indeed, the r numbers are useless unless you also know the number of opps. Dec 16, 2010 12:59 PM Joey Matschulat (28886) Tango, are you saying that in calculating r for any pair of variables, as sample sizes increases, r will inevitably approach 1.0? Because I'm pretty sure that's not the case. Dec 17, 2010 09:52 AM I think what he is saying is that any variable that has any slight persistence at all will do that. That's true, I think. But we're talking about saying suppose that all pitchers gives up infinity fly balls in 2010 and infinity fly balls in 2011, all against the same competition, the correlation of his HR/FB in those two years would be 1.0. That's technically true. Dec 17, 2010 14:58 PM Not a subscriber? Sign up today!

I love this stuff, Matt; thanks.
With respect to BABIP and groundballs, I found Jamie Moyer's season last year very interesting. There was certainly a difference between those games when he got good results vs. bad. I bring him up because I watched a lot of his games last year and have been trying to figure how to square what I *thought* I saw with what the advanced metrics told us about his value to the Phillies.
We talk about a very low BABIP as being unsustainable, and rightly so, I think, but it seems to me that we make a mistake if we look at a low BABIP and simply conclude "he was wasn't *really* pitching that well". In those games in which Moyer posted the best results last season, he did indeed (somehow) induce a lot of weak contact, weak grounders and flies that are easy to field. Obviously weakly hit balls can find holes and be misplayed too, so luck remains a factor. Still, it seems to me that DIPS theories don't tell us much about any one game, but rather about the persistence of certain tendencies. With a pitcher like Moyer, he needs to have very good command to be successful (and to "get" the outside strike), but when he does have that command he *really* did pitch that wellweak contact mattersbut if he's slightly off, he gets hit much harder.
Am I making any sense? If so, is there anything to what I'm suggesting?
I'm not as sharp as these guys, but I think this type of analysis isn't particularly appropriate when you're looking at things on a singlegame level. Just what my gut tells me.
That's what I was thinking, but Matt's anecdote about his take on Schilling's WS shutout is what made me bring it up... thanks.
I think that any detailed statistical analysis of one particular game needs to have a big asterix on it. That said, I think that pitchers (particularly ones like Moyer) are great at having plans for games. They are really good at mixing pitches and finding hitters weaknesses. As a result, they can often have good BABIP in a fleeting moment, but those strategies don't tend to be persistent. It's tough to keep getting the same hitters out if you are not striking them out or getting them to hit ground balls. Moyer will surprise a lot of hitters with a fastball down the middle on an 02 count, and then they'll hit a popup when they suddenly realize that it is actually a fastball. I don't think that Moyer will get the same guy to do that again, so I wouldn't say his BABIP is repeatable (as evidenced by his ever so slightly good but not amazing career BABIP), but he's definitely able to make a good pitch to get an out in an individual game. One thing I have also noticed with Moyer is that when his location is off, his BABIP is terrible, and no pitcher can always have their location on. It's a fleeting thing even Cliff Lee and Greg Maddux have games where the ball isn't going where they want it to be within the strike zone. So I would say it's possible to have a good game with mediocre K/BB, but probably it's rare, and the times it does happen, it's probably when the pitcher gets ahead in the count a lot.