September 13, 2007
Lies, Damned Lies
New Life on Different Fields
This piece was originally intended as a response to Gary Huckabay's column of last week, the idea being to contradict his assertion that baseball analysis is dead by counting down 10 points of decision that at least a significant minority of baseball franchises get wrong. But after reading through my article-I generally write my introductions last-as well as re-reading Gary's piece, I am not so sure it is orthogonal to it at all. I agree with Gary that there is relatively little to be gained from what he describes as "the rigorous review of player performance data." Relatively little does not mean "nothing," however, and I have isolated some of the exceptions below. Most of the items on my list, however, have to do with questions that run outside the scope of the GM or the field manager. They have more to do with the guy sitting in the owner's box, and those places on a baseball team's org chart where the names stop becoming familiar.
10. Inappropriate Leadoff Hitters: We start with one of those minor exceptions that takes place at the field level. There are very few in-game strategic decisions that amount to a hill of beans, and lineup order-within reasonable boundaries of sanity-is no exception. Most teams, save perhaps for three or four outliers like the Dodgers, have no trouble understanding the value of on-base percentage.
Still, for fully one-third of the teams in baseball, the most frequently-used leadoff hitter this season has a lower OBP than that of the team in general. The ten culprits are these:
Team Hitter Hitter OBP Team OBP BOS Lugo .296 .362 NYY Damon .350 .364 CHW Owens .307 .317 PHI Rollins .346 .356 WAS Lopez .307 .321 CHC Soriano .329 .332 CIN Freel .308 .336 HOU Biggio .283 .326 ARI Young .293 .316 SDP M. Giles .306 .321
By contrast, 29 of the 30 primary leadoff hitters are on pace to finish with double-digit stolen base totals; the lone exception is Craig Biggio, which can readily be explained by the fact that the Astros came into the season apparently thinking they were getting the 1997 version of the former star. Generally speaking, the conceit of using a Brian Downing or Wade Boggs type as a leadoff hitter never really caught on.
What's funny is that there are several analysis-friendly teams on the list, like the Red Sox, Padres, and Diamondbacks. It would appear that this is a battle that our SABRCat Superfriend GMs have concluded is not worth fighting; there is just too much inertial momentum going the other way, and too little marginal gain to be had.
9. Underaccounting for Injury Risk: I have only anecdotal evidence to present here: Randy Wolf. Jason Schmidt. Nomar Garciaparra. Wait, all of those guys are Dodgers? There is ample room for improving analysis of injury risk and its concomitant effects on performance, feeding off the head start that Will Carroll and Sig Mejdal have given us. But for the time being, there are a number of clubs that could stand to develop a respect for the Inertial Law of Injuries: what's healthy tends to stay healthy, and what's injured tends to stay injured.
8. Focusing Too Much on Year N-1, and other small sample sizes: Now we start to get into the more serious sins. My analysis of the free agent market indicates that the player's performance in his most recent season generally accounts for about 65 percent of the salary package he eventually receives, when statistically speaking the proper fraction for a mid-career player is closer to 50 percent. This is especially problematic if, as Dayn Perry found in Baseball Between the Numbers, players tend to perform especially well in contract drive seasons (and even more so if my further speculation is correct that baseball players are more likely to use PEDs when they're angling for a new contract).
7. Failure to Understand Pitcher Peripherals, Especially for Relief Pitchers: Stop me if you've heard this one before. Baseball seems to have experienced some improvement in downplaying the importance of W-L record, but it still treats ERA as the holy grail. Yet ERA is not much more reliable; the year-over-year correlation for ERA is just .38 for starting pitchers, and a fair bit lower than that for relievers. Key peripheral statistics like walk rate, strikeout rate, and groundball percentage, on the other hand, all check in with correlations between .68 and .81. The failure to heed the importance of peripheral statistics can lead to disasters like the White Sox middle relief corps of the past two seasons.
A related adage is the old piece of Bill James wisdom about power pitchers holding up better than finesse pitchers over the longer run. But after seeing the difference in the value of the recent contract extensions signed by Mark Buehrle and Carlos Zambrano, I am not so sure that teams haven't started to price this into the market.
6. Failure to Adjust Strategy Based on Position on the Wins Curve: This is a tricky one, because it requires both a solid understanding of baseball economics and a capacity for intellectual honesty. Because of the substantial increase in marginal revenues associated with making the playoffs, proper strategy differs rather radically based on where a team falls on the wins curve; a free agent that might be a good buy for an 88-win club could be an awful investment for a 73-win club. The problem is that a baseball team may not be honest with itself about just where it stands. Most people that establish a high degree of authority in a people business like baseball tend to be optimists, and optimists tend to exaggerate their lot in life. If you surveyed the 30 major league GMs about how many games they expected their team to win next season (and were somehow able to get an honest answer) I would guess that the average would come out to something like 88. This fact alone begets substantial irrationality in the free agent market…
5. Lack of Objective Analysis of Marginal Returns: …and this issue facilitates those problems. Most teams don't seem to be conducting objective analysis of how much extra wins or extra championships will actually improve revenues in their market. Rather, teams tend to spend the money they have, and market prices are dictated by a monkey-see, monkey-do approach. How else to explain how 27 of 30 teams lost money on their marginal spending on payroll last year? Or that in spite of that, prices for free agent talent in this winter's market increased by nearly 50 percent because of an influx of cash from sources like MLBAM and national TV rights, neither of which are responsive to marginal changes in team quality?
4. Lack of Coordination between Baseball Ops and Ownership: I was talking recently with Aaron Schatz about the differences in ownership structures between baseball and football. In football, for whatever reason there are a large number of franchises owned by families; by my quick count 11 of the 32 current NFL owners fall under the category of legacy hires. In contrast, this is relatively rare in baseball; baseball teams tend to be owned by corporations, investment conglomerates, or Very Rich Dudes. You would think that this breakdown would tend to be favorable to baseball, since family legacy teams tend to make nepotistic hires, leading to occasional disasters like the pre-Carson Palmer Cincinnati Bengals.
In fact, however, Aaron theorizes that all this nepotism tended to breed less tension into the NFL's culture of ownership-management relations. In the NFL, the owner was some rich guy wearing argyle socks, and the general manager was probably also some rich guy wearing argyle socks, who happened to share half the owner's DNA. In baseball, on the other hand, the owner was some guy wearing argyle socks, and the GM was some ex-jock who had come up in a different culture.
Sure, the argyle-sock guys might authorize the trade of John Elway for an offensive lineman and a six-pack of Schlitz, but at least they knew where one another was coming from. Baseball, on the other hand, seems to be in a perpetual state of ownership-management tension, damned if they do and damned if they don't. On the one hand, you have the Drayton McLanes of the universe, who interfere with their GM's ability to do his job. On the other hand, you have cases like the Cubs, where ownership changes its payroll requirements willy-nilly from year to year based on balancing the corporate bottom line, rather than trying to maximize the profits from the baseball team itself. The few franchises where ownership and management seem to see eye-to-eye, like the Red Sox and the Angels, stick out like a sore thumb, and they almost always do well in the standings column.
3. Misuse of the Closer: Gary touched on this one-optimizing the use of the bullpen is perhaps the one in-game managerial decision that has the most impact on a team's ultimate place in the standings. Unfortunately, it is also the one that teams routinely get wrong. We are not talking about using a closer by committee; most teams will have an alpha dog in their bullpen, and he deserves to get the most important opportunities. But those opportunities are not particularly strongly related to the definition of the save.
This is a cultural thing, not an analysis thing. The theory behind it is not particularly hard to understand, and yet almost every team is giving away a couple of wins a season by succumbing to the groupthink that the save rule has engendered. With the notable exception of NFL coaches' irrational disdain for going for it on fourth down, this might be the most reliably botched strategic protocol in American sports.
2. Failure to Appreciate the Value of Draft Picks and Pre-Free Agent Players: I am not necessarily talking about the signing bonuses paid to draft picks. Although teams are generally rewarded when they go over slot for a special player, there are also some incentives toward collective action that keeps prices down overall. Nevertheless, baseball teams fail to appreciate that essentially the only reliable way to make money at the margins in the industry is to employ quality talent at below-market prices. The expected savings on a premium prospect like Jarrod Saltalamacchia can approach $50 million before he hits his first cycle of free agency. There is almost no reasonable combination of veteran talent, and no reasonable discount rate, that could justify trading away such an asset.
But at least the guy the Braves got for Saltalamacchia is a good player. How to explain a trade like Scott Moore and Rocky Cherry for Steve Trachsel? Nobody noticed this one, but it might be the worst trade in several seasons, and it required a violation of at least half of the ten principles that you see in this column to come to fruition. Trachsel is a liability rather than an asset; he is not worth his prorated salary. In fact, provided that you understand #7 above, he is worth less than nothing. His QERA at the time the Cubs acquired him from the Orioles was 6.47, largely because he had walked 50 percent more batters than he'd struck out. Nevertheless, the Cubs gave away a prospect in Moore whom PECOTA thinks could produce about $30 million in value before he becomes a free agent, and a decent reliever who would cost at least a million or two each season in the free agent market to replace. It makes absolutely no sense, nor does the rationalization that the Cubs traded for Trachsel to keep him away from the Brewers and Cardinals; the Cubs should actively seek to have Trachsel pitching for their rivals. You can't tell me that the arbitrage opportunities in baseball are anywhere near exhausted when you see a trade like that, which barely got a shrug from the analysis community.
1. Too-Long Contracts (and Too-Short Time Horizons): How many contracts of at least four years in length turn out to produce a positive return on investment for the club? I've given an off-the-cuff estimate of between 20 and 30 percent when asked this question. People like David Regan who have studied this issue more systematically would tend to support that conclusion. By the third year of his contract, a free agent hitter has generally lost about 40 percent of his value from his contract-year season, and a free agent pitcher has generally lost 60 percent of his value. Yet teams give out extra years on their contracts like they're Halloween candy. It's very common to hear of a team that is considering signing a particular player to a three-year, $30 million deal, and before you know it, that contract has become four years and $40 million (or worse still, the extra year might be a player option).
Now, overall, a great number of these problems-certainly #1 and #2, but also to some extent #4, #5, #6, and #8-stem from the fact that teams are exceptionally focused on the near-term. Vince Gennaro in Diamond Dollars suggests that the discount rate applied by baseball teams approaches 35 percent-you'll trade 1.35 wins next season for one win today. Such a discount rate would be unconscionable in any other mature industry, but it should not be entirely surprising, given the principal-agent problems that baseball teams face. The median tenure of current major league managers is between two and three years, GMs between four and five years, and principal team owners last about seven years. Why should the Cubs care about giving too much money to Alfonso Soriano if neither Lou Piniella nor Jim Hendry (and certainly not the Tribune Corp.) is going to be around when that deal expires?
Of course, the Tribune should care about Soriano's contract if the potential new ownership groups are smart enough to recognize that it represents a liability, but they have some reasonable hope that it will be written off as rounding error by whoever purchases the franchise. The market for baseball franchises is not particularly liquid, nor are the prospective owners necessarily evaluating the investment as rigorously; they might understand finance, but not baseball economics. The owners may be willing to pay substantially more than the price that the P&L justifies because they think they'll be able to pass the franchise off to a greater fool.
The next revolution in baseball will not take place at the field level, and it will probably not take place at the general manager level; it will take place at the ownership level, and it will not be led by statheads, but by investment bankers. Like a lot of revolutions, it might be precipitated by hardship. I believe there is at least a 60:40 chance that that franchise valuations for baseball are presently in a bubble, and that the bubble will burst at some point within the next decade. If the credit crunch has legs, such that leveraged buys of baseball teams become harder to execute, the collapse could come toward the beginning of that cycle.
If baseball's existing owners want to protect their investments, they ought to change their practices for vetting potential new owners, focusing not so much on those owners that are likely to perpetuate the collective groupthink, but rather on those who come with business plans in hand, and have a demonstrated ability to shepherd long-term investments. In contrast to the perception that everything is just ducky, I believe that the industry is in a fairly dangerous place. That's what I have to conclude when I see discount rates of 35 percent, or the market price for free agent talent jumping by 50 percent with little underlying economic rationale, or the Cubs throwing away $30 million in future value to trade for a player like Steve Trachsel.