Scorecasting looks at data: Cubs not unlucky, just bad

The recently published book Scorecasting (read a quick summary here) has a chapter that tackles the question of whether the Chicago Cubs are cursed or not. Their conclusion after looking at the data: the team has simply been bad.

But how can anyone disprove the existence of a curse? According to the authors, teams that frequently field good teams but finish in second place, or make the playoffs but fail to win a title, justifiably can claim to be unlucky. So, too, can teams that have impressive batting, hitting and defensive statistics, but whose strong numbers don’t translate into victories.

On both scores, the Cubs proved to be “less unlucky” than the average team. That is, not unlucky, just bad.

“Relative to other teams, we could easily explain the Cubs lack of success from the data — both their on the field statistics and where they finished in the standings,” Moscowitz said.

Since their last Series appearance in 1945, the Cubs have finished second fewer times than they have finished first. They also have finished last or next to last close to 40 percent of the time. According to the book, the odds of this happening by chance are 527 to 1.

The authors of “Scorecasting” believe that what has been stopping the Cubs the last three decades is the extreme loyalty of their fans, which has served to reduce the incentive for Cubs management to win.

According to their analysis, which is primarily based on attendance records and the team’s won-loss percentage from 1982-2009, Cubs fans are the least sensitive to the team’s winning percentage, while White Sox fans are among the most sensitive.

There are two interesting arguments going on here, both of which commonly come up in conversation in Chicago:

1. The data suggests that the Cubs have just been a bad team. It is not as if they have reached the playoffs or World Series multiple times and lost. It is not that they have impressive statistics and this hasn’t translated into wins. They just haven’t been very good. It would be interesting to read the rest of this chapter to see if the authors talk about the MLB teams that have been truly unlucky. I don’t know if a chapter like this will put the talk of a Cubs curse to rest but it is good to hear that there is data that could quiet the curse talk. (But perhaps the curse is what Cubs fans want to believe – it means that the team or the fans aren’t at fault.)

2. Cubs fans like to think that they are loyal while White Sox fans argue that Cubs fans will go to Wrigley Field no matter what. So is the answer for more Cubs fans to stay away from the ballpark until the team and the Ricketts show that they are serious about winning?

How (baseball) statistics can help you earn $2.025 million

Traditional baseball statistics would say that Pittsburgh Pirates pitcher Ross Ohlendorf didn’t have a great 2010 season: the 27-year old had 1 win against 11 losses with 108 innings pitched in 21 games. Yet, in an arbitration hearing, Ohlendorf just earned a pay raise from $439,000 to $2.025 million. What happened?

Even though this might seem like a minor matter (the average MLB salary in 2010 was $3.3 million), there is plenty of talk already that Ohlendorf benefited from statistics (and a field known as sabermetrics) that have become fairly normal in the last 20 years in baseball. Ohlendorf’s WHIP ((walks + hits)/innings pitched) was decent at 1.384. His ERA+ (comparing his ERA to the league average and adjusting for the ballpark) was 100, right at the league average.

Ultimately, these statistics suggest that Ohlendorf’s performance was decent, at least average. His main problem was that he was pitching for a terrible team that finished with 57 wins and 105 losses. With a little more data beyond what typically goes on a baseball card or is flashed on a television graphic, Ohlendorf got a sizable raise.

There could be some alternative takes on this outcome:

1. Wow, even an average MLB pitcher can make big money.

2. It would be interesting to know whether Ohlendorf’s representative in the arbitration hearing used all of these advanced statistics to make his case.

3. How quickly can workers in other careers develop advanced statistics to further their pitches for raises?

Seizing the spotlight

One of the items highlighted in Monday’s Intellectual Property Enforcement Coordinator (IPEC) report (92 page PDF–see here for my previous post) was government seizures of various domain names allegedly associated with infringing comment.  Bruce Lidi over at ZeroPaid makes a compelling argument that the publicity associated with such tactics is counter-productive at best:

As nearly every analysis of the recent ICE action has noted, by seizing the US registered domain names of foreign-owned and operated sites, the authorities have propelled the sites to set up on domains not under US control, and to do so within days, if not hours, of the seizures….It would appear that aside from a very momentary interruption, the practical effect of the seizures will be negligible, except to make any future actions by rights holders that much more difficult, since the targeted sites will be farther from US jurisdiction.

Additionally, and even more importantly, the recent ICE domain seizures that focused on sports streaming sites has had, and will continue to have, the effect of generating more publicity for this kind of infringing.  Consistent with the concept of the “Streisand Effect,” attempts to suppress troublesome information online result invariably in that information becoming even more widely distributed.  While impossible to quantify with any certainty, the seizures by ICE surely increased awareness of the existence of rojadirecta and atdhe, and even more, of the ease in which viewers can access live streaming of sporting events online.  As we so often see in articles about “cord-cutting,” or dropping cable in favor of purely internet video delivery, many people are stymied by the lack of live sports online, yet now, because of the actions of ICE, millions more viewers have just been instructed that it is actually quite simple to get live footage of every soccer match or football game.

Lidi’s analysis reminded me of countless debates I’ve read about U.S. military policy.  Some people favor a “shock and awe” approach while others think that “winning over hearts and minds” is the way to go.  Unfortunately for the content industry, I’m not sure that they’re ever going to win people over completely to their way of thinking.  Anyone who claims that, as a practical matter, people don’t have the right to rip their owned CD into Mp3’s (article from 2008 but still true–see the RIAA’s current website) has completely lost touch with reality.

Why you should have had a Super Bowl party: to reinforce deep human bonds

A communication professor suggests that going to a Super Bowl party with friends is more than just eating food and hanging out: it is about building human bonds, particularly after tough times.

Sparks said there’s a wealth of medical evidence that human contact — particularly in social situations — can be therapeutic, reducing stress and giving people a comforting sense of belonging.

“It sounds silly in a way when we’re talking about Super Bowl parties, but I don’t think events like this should be underestimated,” Sparks said. “These are important social occasions that really have the potential to reinforce our deep human bonds. And the timing of this year’s Super Bowl is really quite nice. People are going to be wanting to come out and share stories about their experiences.”

From blizzards in the Midwest to Super Bowl parties. If people needed more reasons to have a party, this seems like a good justification.

Patriotism at the Super Bowl

If you want to see what Americans think about their country, sporting events are good places to find out, particularly the Super Bowl, the sporting event of the year.

This year, the pregame featured a reading of the Declaration of Independence. Football players, surrounded by military personnel, read the main parts though we didn’t hear all the grievances regarding the tyranny of the English king. Colin Powell and Roger Goodell finished off the reading.

The two patriotic songs, God Bless America and the Star-Spangled Banner, seemed overwrought. God Bless America had an interesting arrangement at the end while Christiana Aguilera tried her own take on the National Anthem.

Some of this is standard fare at American sporting events. But I’m still trying to figure out how the Declaration of Independence fits with football. It did offer an opportunity to support our military, a cause that often is invoked in big sporting events. But is the idea that because we have freedom and strive for equality as a nation that we therefore should sit together for the next four hours and watch football? Perhaps a little more text could have been added: “We are not red or blue states, Republicans or Democrats: we are united together on this day like no other in our desire to watch football and many commercials.”

This mix of patriotism plus the military plus explicit values plus football seems to have been done in a uniquely American way. The next step sociologically is to discuss this as American civil religion.

High rate of arrests among NFL players?

Going into the Super Bowl, everyone knows about the legal issues Ben Roethlisberger has faced in recent years. But one sociologist has found that behavior that breaks the law is not unknown to NFL players. One website suggests that sociologist Eric Carter found “nearly 35% of all players in the league have been arrested.” Elsewhere, Carter goes into more detail about why so many NFL players are arrested at some point and how religion could help players deal with anomie:

Eric has conducted over 100 interviews with NFL players, some who have led happy and well-adjusted lives but also with many who have not.  We talk about the typical pressures that a professional player faces, coming into sudden fame and fortune.  Prof. Carter brings the research ideas of Emile Durkheim, particulary “social anomie,” to bear on what a number of these athletes face when moving into the professional ranks.  The sudden change in lifestyle combined with intense pressures to perform often leave many of them unhappy, confused and susceptible to all sorts of deviant behavior (some of which makes the news).  We talk then about the role of religion in helping players cope with these changes.  Our discussion looks at what factors might help players make adjustments to their new environments, including: a religious upbringing; the support networks they have access to at college; and religious role models in the locker room.

More details about Carter’s study of NFL players can be found here. Although this is a small sample of 104 players (there are at least 1440 players in the NFL each year – 45 players on 32 rosters), Carter found that 33 of the players had been arrested (31.7%). And Carter wrote a book, Boys Gone Wild, based on his study.

What is interesting about this is that the NFL seems to avoid scrutiny in the public eye about this. Whereas baseball stars are vilified for cheating, NFL players are regularly arrested (if this arrest rate holds true across the NFL – and even if it was really 10-20% lower, it still is a decent number) and the popularity of the NFL has continued to grow. Even with players like Roethlisberger or Rae Carruth or Michael Vick or Ray Lewis or Donte Stallworth or Marvin Harrison getting into trouble, this sort of news gets overwhelmed by the behemoth that is NFL entertainment.

In a more recent interview, Carter talks about how the NFL is able to keep this information out of the public eye:

“We see a lot of what goes on, because of the media,” Carter said. “But I was amazed at how much goes on that isn’t picked up — how powerful the NFL is in combating some of the potential bad media. I couldn’t believe how many guys contemplated suicide or attempted it, or were that unhappy with their lives that they engaged in these self-destructive behaviors.”

Carter found that 32 percent of the players he interviewed had been arrested after they entered the league — and others said they often evaded arrest by dispensing autographs to star-struck police officers — and nearly half described themselves as unhappy people.

“Fifty percent? That’s a big number,” he said, especially when you consider that these are young men who make on average more than $1 million a year to play football, and many of them much more than that.

“It just goes against our contemporary American conceptions of what happiness is. They have it all. They have the wealth, the fame, the power, the status — all of those things that many people equate with a happy life.”

Perhaps the NFL is able to bury these stories or minimize them. Or perhaps the American public doesn’t want to face this kind of information or thinks the athletes are compensated enough and can deal with the problems on their own.

Quick Review: Da Bears!

Partly to commemorate the Chicago Bears’ lone Super Bowl title and also to help mourn the recent loss to the Green Bay Packers, I read Da Bears!: How the 1985 Monsters of the Midway Became the Greatest Team in NFL History. A few thoughts about this book, one of many products commemorating this 25th anniversary:

1. A main theme of the book is the ongoing battle between Head Coach Mike Ditka and defensive coordinator Buddy Ryan. How exactly the team kept moving forward with this kind of tension is interesting.

2. There are claims that the Bears were the team that really helped push the NFL to the top. With their winning plus the actions and charm of their players, the Bears were a kind of media circus in an era where this didn’t happen often.

2a. The problem with a claim like this is that little evidence is presented that might conflict with this narrative. At one point, the book mentions that several teams had recorded songs as teams before the “Super Bowl Shuffle” but it was this 1985 song that really took off. Another (implicit?) claim is that the Bears really pushed athlete endorsements forward. Were other star athletes not doing commercials? In the end, how exactly do we know the Bears were something different in the eyes of the media compared to any other team of the time? I would have liked to have read more perspectives from outside of Chicago – were people across the country as intrigued with the Bears as Chicagoans were?

3. Some things never seem to change with the Bears: defense over offense, inconsistent quarterback play, complaints about the McCaskeys, an inability to follow up on success (with the 1985 Super Bowl team never getting back to another title game), fickle fans who suddenly were worried at the end of the 1985 season with less than perfect play, and more. How long can a team have the same basic identity?

4. As a cultural phenomenon, it would be interesting to track other teams that have captured the heart of a city in the same way as the Bears. While the list of endorsements and radio shows during the 1985 season was impressive, many of those guys are still around in the Chicago media. Will there be a point where the 1985 team is eclipsed by another team or was their combination of dominance and style too much to overcome?

5. It was unclear to me how much of this book was original research versus drawing from existing sources.

Overall, I’m not sure how much new material this book presents: many of the themes are widely known. There are a wide range of perspectives in this book but I think you also find this information elsewhere. I was looking for a new take on a famous team and yet you will hear the same things on local sports talk stations and other media.

The morality of going to the gym

The adult life is often made of up little tasks that must be done to live: go to work, prepare and eat meals, do laundry, and various other activities. Perhaps there is another activity that must be added to this list: getting exercise and/or going to the gym.

“There seems to be a whole substitute morality, where your obligation is to go to the gym and not ask why,” says Mark Greif, a founding editor of the literary journal n+1 and the author of a widely discussed 2004 essay, “Against Exercise.” “If you don’t, you become a sort of villain of the culture.”

The message that perspiration is a gateway to, and reflection of, higher virtues is captured in health club slogans like ones used by the Equinox chain over recent years: “Results aren’t always measured in pounds and inches.” “My body. My biography.” “It’s not fitness. It’s life.” The same idea is encoded in the language of personal improvement. A “new you” usually means a trimmer, tauter version, not someone who has learned to speak Mandarin or picked up woodworking skills.

And the pectoral is political. The current president and his predecessor have made ostentatious points of their commitments to fitness routines. Whatever the differences in their ideologies, intellects and work habits, George W. Bush and Barack Obama both let voters know that they carve out time almost daily for cardio or weights or both. And while that devotion could be seen as evidence of distraction (Bush) or vanity (Bush and Obama), each politician safely counted on a sunnier takeaway. In this country, at this time, steadiness of exercise signals sturdiness of temperament, and physical leanness connotes mental toughness…

To be unfit is to be unfit: a villain of the culture, indeed.

An interesting commentary. More broadly, these ideas seemed tied to American ideals of youth and health. We like politicians and athletes and movie stars who are physical specimens. We argue that disciplining the body is indicative of discipline in other areas of life. Being healthy is not just being an appropriate weight or eating right or limiting stress: it should include muscles and toning.

Some questions follow:

1. Do other cultures have similar ideas or are we unusual in this regard?

2. When or where did the emphasis on muscles, beyond just “being fit,” arise?

3. For the average American, how much of this judgment regarding exercise and going to the gym comes from people around them versus comparing themselves to media produced images?

4. How much have professional sports contributed to this? If you look at athletes in the 1950s and 1960s, they did not train as much. Today, being an athlete is a full-time, full-year job in order to stay in shape.

Scorecasting: Freakanomics for the sports world

A movement has been growing in the sports world in the last few decades: the use of lots of data in order to make decisions. Some of this data goes against “conventional wisdom” such as ideas of whether players can be “clutch” (some good stuff on which NBA players you would want to take the final shot with the game on the line) and what should actually be valued in free agents (MLB’s shift toward statistics like on-base percentage over home runs and RBIs).

A new book, Scorecasting, tackles a number of sports issue from a quantitative perspective. Read an interview (including a few examples from the book) with one of the authors here.

It will be interesting to see just how mainstream these sorts of ideas become. Does the average sports fan, or even the average sports broadcaster, want to rely on these kinds of data as opposed to their intuition or their feeling? Numbers may provide a better explanation – but numbers have all sorts of perceptions tied to them including the idea that people are just twisting the data to fit their explanation and that numbers about sports are developed by geeks who can’t play sports (or something along these lines).

I, for one, would like to have more quantitative data available to me when watching sports. Information like the batting average of a batter for particular parts of the plate (usually split into nine segments) or on a particular count would be useful. The data might seem overwhelming but ultimately, I think it helps people see the patterns underlying their favorite sport. For example, a home run hit on an 0-2 count in the 9th inning to win the game is impressive in its own right. But to know how rarely home runs are hit on the 0-2, even more so for some batters, adds to the feat.

Can the NFL over-hype itself?

As the NFC and AFC title games slowly approach, I wonder: can the NFL over-hype its product?

On one hand, it appears not. NFL television ratings have been excellent this year (regular season stats here). The league has a number of stars that draw a wide range of attention, from the good (Tom Brady, Peyton Manning) to the bad (Brett Favre, Michael Vick’s sage in recent years). Particularly at this time of year, talk about the NFL dominates the airwaves – a number of other sports are mid-season. The final four teams remaining in the playoffs are historic franchises that have passionate fan bases. Even with Bill Simmon’s recent claim that there is “there’s at least one great [NBA] game” each night, other sports can’t match the popularity of the NFL. The NFL even thinks it can sell $200 tickets for a “party plaza” outside of the Super Bowl.

On the other hand, it is A LOT of talk. In the weeks between playoff games, it seems that ESPN can’t stop talking about the next match-ups. In Chicago, everyone has been talking Bears-Packers. The teams already have played twice so how much more is there to discuss? Could it get to the point where fans tune out the week before and are just happy to get the game over with? And interestingly, it only gets worse for the Super Bowl: then we get the infamous “Media Day.” Though the Super Bowl gets tremendous ratings, how often does the game match the hype? In my lifetime of watching Super Bowls, I distinctly remember being disappointed by most of them. (A couple stand out in memory: the Giants-Bills match-up in 1991, Rams and Titans in 2000, the Bears-Colts in 2007, Patriots-Giants in 2008, Steelers-Cardinals in 2009.)

From a broader perspective, there is no guarantee that the popularity of the NFL will be maintained over the years, let alone continue to increase. (Gregg Easterbrook, ESPN’s Tuesday Morning Quarterback, points this out.) The first non-sports comparison that comes to mind are presidential elections. Yesterday, the New York Times reported how President Obama is getting his next campaign in order and plans to formally declare his candidacy in two months. From now until November 2012, this is what we will hear about in the news: who will challenge Obama, how much money will be raised, what are the issues, who has the best image, what do the latest polls say, etc. Don’t voters, at least some of them, get burned out by all of this by the time the actual election takes place? The idea that some countries have of holding more defined election seasons, typically announced by the current leader and lasting for a few months, seems preferable to this endless, over-hyped presidential election season.

I am sure someone has done research on over-hyping. For the NFL, the question is when will it saturate its market. Of course, one way around this is to expand your market and head overseas. (They are trying to do this with games in Toronto, London, and Mexico City in recent years. But the NBA is way ahead of them.) In the meantime, the sporting public will get heavy doses of talk, analysis, and replays. I, for one, will be very happy when it finally gets to 2 PM Sunday afternoon and we can actually see whether the Bears and Packers will win.