Correlation and not causation: Redskins games predict results of presidential election

Big events like presidential elections tend to bring out some crazy data patterns. Here is my nomination for the oddest one of this election season: how the Washington Redskins do in their final game before the election predicts the presidential election.

Since 1940 — when the Redskins moved to D.C. — the team’s outcome in its final game before the presidential election has predicted which party would win the White House each time but once.

When the Redskins win their game before the election, the incumbent party wins the presidential vote. If the Redskins lose, the non-incumbent wins.

The only exception was in 2004, when Washington fell to Green Bay, but George W. Bush still went on to win the election over John Kerry.

This is simply a quirk of data: how the Redskins do should have little to no effect on voting in other states. This is exactly what correlation without causation is about; there may be a clear pattern ut it doesn’t necessarily mean the two related facts cause each other. There may be some spurious association here, some variable that predicts both outcomes, but even that is hard to imagine. Yet, the Redskins Rule has garnered a lot of attention in recent days. Why? A few possible reasons:

1. It connects two American obsessions: presidential elections and the NFL. A sidelight: both may involve a lot of betting.

2. So much reporting has been done on the 2012 elections that this adds a more whimsical and mysterious element.

3. Humans like to find patterns, even if these patterns don’t make much sense.

What’s next, an American octopus who can predict presidential elections?

Sociologist defends statistical predictions for elections and other important information

Political polling has come under a lot of recent fire but a sociologist defends these predictions and reminds us that we rely on many such predictions:

We rely on statistical models for many decisions every single day, including, crucially: weather, medicine, and pretty much any complex system in which there’s an element of uncertainty to the outcome. In fact, these are the same methods by which scientists could tell Hurricane Sandy was about to hit the United States many days in advance…

This isn’t wizardry, this is the sound science of complex systems. Uncertainty is an integral part of it. But that uncertainty shouldn’t suggest that we don’t know anything, that we’re completely in the dark, that everything’s a toss-up.

Polls tell you the likely outcome with some uncertainty and some sources of (both known and unknown) error. Statistical models take a bunch of factors and run lots of simulations of elections by varying those outcomes according to what we know (such as other polls, structural factors like the economy, what we know about turnout, demographics, etc.) and what we can reasonably infer about the range of uncertainty (given historical precedents and our logical models). These models then produce probability distributions…

Refusing to run statistical models simply because they produce probability distributions rather than absolute certainty is irresponsible. For many important issues (climate change!), statistical models are all we have and all we can have. We still need to take them seriously and act on them (well, if you care about life on Earth as we know it, blah, blah, blah).

A key point here: statistical models have uncertainty (we are making inferences about larger populations or systems from samples that we can collect) but that doesn’t necessarily mean they are flawed.

A second key point: because of what I stated above, we should expect that some statistical predictions will be wrong. But this is how science works: you tweak models, take in more information, perhaps change your data collection, perhaps use different methods of analysis, and hope to get better. While it may not be exciting, confirming what we don’t know does help us get to an outcome.

I’ve become more convinced in recent years that one of the reasons polls are not used effectively in reporting is that many in the media don’t know exactly how they work. Journalists need to be trained in how to read, interpret, and report on data. This could also be a time issue; how much time to those in the media have to pore over the details of research findings or do they simply have to scan for new findings? Scientists can pump out study after study but part of the dissemination of this information to the public requires a media who understands how scientific research and the scientific process work. This includes understanding how models are consistently refined, collecting the right data to answer the questions we want to answer, and looking at the accumulated scientific research rather than just grabbing the latest attention-getting finding.

An alternative to this idea about media statistical illiteracy is presented in the article: perhaps the media perhaps knows how polls work but likes a political horse race. This may also be true but there is a lot of reporting on statistics on data outside of political elections that also needs work.

Neither Obama or Romney tackling issue of housing

There are plenty of issues to talk about this election season but neither Obama or Romney have done much to address housing:

For existing homeowners and the government, though, housing remains an enormous issue. If new government initiatives are not implemented, it could take another three to five years for the market to fully recover, analysts estimate. And The Wall Street Journal reports that neither candidate has offered ways to remake failed mortgage giants Fannie Mae and Freddie Mac, which have already cost taxpayers $140 billion and face further losses.

Across the United States, nearly 10.8 million properties — 22 percent of homes with a mortgage on them — remain underwater, according to CoreLogic, a data analysis firm. The numbers of properties where owners owe more than their home is worth is shrinking, but analysts say the process can, and must, be sped up.

Both Obama and Romney, though, have been silent on the issue. Why?

“It turns out to be a lose-lose issue for both candidates,” John Vogel, a professor at Dartmouth’s Tuck School of Business, recently told MarketWatch. “And therefore gets ignored.”

For each candidate, the reason for staying mum on housing is different. Obama does not have the strongest record to run on. And Romney has found that wading into housing opens himself up to being painted as a heartless corporate mogul.

So housing greatly contributed to the economic crisis yet neither candidate wants to bring it up. Perhaps this topic might top an unfortunate list titled something like “topics that candidates absolutely do not want to talk about.” They can discuss a range of controversial topics like abortion, education, social security and medicare reform, the outsourcing of jobs, and tough foreign policy topics but not housing…

After seeing a variety of opinions on the topic of housing in the last few years, I wonder if most people, including the experts, are just hoping it comes back. Thus far, government policies do not seem to have helped much. As some have noted, without a more robust housing market, it is difficult for people to move and take advantage of the jobs that might be available. Local governments need increasing property tax values to bring in more revenues. Mortgage lenders, the real estate industry, and builders and developers would benefit from more activity. And if the housing industry doesn’t come back quickly? There doesn’t seem to be much in place for this possibility.

I wonder what Americans would want to hear about housing, if it even rates highly enough (or might simply be part of “the economy”). In the earlier stages of the economic crisis, there was a lot of talk about not providing a lot of support to people who should have known better than to take out mortgages they might not be able to afford. Who deserves to get help? Would Americans be happy with more regulation of mortgage lenders so they won’t be allowed to offer mortgages homeowners that could harm borrowers?

State Budget Crisis Task Force: big debt trouble in Illinois

Even if politicians in Illinois don’t talk about this much, outsiders such as the State Budget Crisis Task Force are noticing the debt trouble in Illinois:

For years, Illinois has racked up billions in public debt to plug budget holes, pay overdue bills, and put money into its mismanaged pension funds. And for the people who live there, this has resulted in decrepit commuter trains and buses, thousands of unsound bridges, 200 hazardous dams and one of the most inequitable public school systems in America…

The group, led by the former Federal Reserve chairman, Paul A. Volcker, and the former New York lieutenant governor, Richard Ravitch, recommended an overhaul of Illinois’ budgeting practices, to make it harder to kite money from year to year and raid special-purpose funds. It also warned that tax increases may be in store…

Illinois has the lowest credit rating of the 50 states and has America’s second-biggest public debt per capita, $9,624, including state and local borrowing. Only New York State’s debt is bigger, at $13,840 per capita. But Illinois has not been able to use much of the borrowed money to keep its roads, bridges and schools in good working order, because years of shoddy fiscal practices have taken a heavy toll, the report said…

While many states have heavy debt burdens and unfunded pensions, the task force warned that Illinois’ problems had been building for decades and were advanced. The state was “insolvent” even before the financial crisis hit in 2008, the report said, but that was hard to detect because “budget gimmicks became a standard practice.”

Not exactly a rosy outlook.

This could relate to the discussion at the national level about how the federal government doesn’t have to balance its budget while other levels of government do. Well, states and other government bodies can still mess up the process even if they are “balancing the budget.”

How Republicans became the party against cities

After noting Republicans barely mentioned the word “city” at the Republican National Convention, the rest of a review piece in the New York Times looks at how Republicans became anti-urban:

IT could hardly be otherwise. The Republican Party is, more than ever before in its history, an anti-urban party, its support gleaned overwhelmingly from suburban and rural districts — especially in presidential elections.

This wasn’t always the case. During the heyday of the urban political machines, from the Civil War to the Great Depression, Republicans used to hold their own in our nation’s great cities. Philadelphia was dominated for decades by a Republican machine. In Chicago — naturally — both parties had highly competitive, wildly corrupt machines, with a buffoonish Republican mayor, “Big Bill” Thompson, presiding over the city during the ascent of Al Capone. In the 1928 presidential election, the Republican Herbert Hoover swept to victory while carrying cities all across the country: Philadelphia; Pittsburgh; Chicago; Detroit; Atlanta; Birmingham, Ala.; Houston; Dallas; Omaha and Los Angeles…

FOR Republicans, cities now became object lessons on the shortcomings of activist government and the welfare state — sinkholes of crime and social dysfunction, where Ronald Reagan’s “welfare queens” cavorted in their Cadillacs. The very idea of the city seemed to be a thing of the past, an archaic concept — so much so that Gerald R. Ford seriously considered letting New York go bankrupt in 1975…

In short, they promise to rip and tear at the immensely complex fabric of city life while sneering at the entire “urban vision of dense housing and government transit.” There is a terrible arrogance here that has ramifications well beyond the Republicans’ electoral prospects.

Fascinating.  A sociologist adds an addendum through a letter to the editor several days later:

While I agree with much of Kevin Baker’s article, his statement that in the postwar years “newly prosperous whites and eventually blacks pursued the American dream out to the suburbs” suggests that postwar urban America became the bastion of the poor and minorities.

Mostly true. But in cities such as Chicago, Philadelphia and Boston, many members of the black middle class continue to live in proximity to their poor and working-class counterparts.

Indeed, in the postwar and post-civil-rights era, blacks have been inheriting urban America, hence the rise of black mayors and other elected officials across all levels of government. Mr. Baker’s analysis of the concerted turn away from urban America by the G.O.P. reveals that a major consequence of this strategy is not just a forsaking of cities but also the alienation of a large swath of poor, working-class and minority voters.

This has all led to the situation today where both parties try to cater to middle-class suburbanites as more exurban and rural voters are in the Republican camp and more urban dwellers are in the Democratic camp.

I have three other ideas about this:

1. Republicans have shifted over the years toward protecting “traditional” American life which sounds often like it can best be lived out in small towns. While the country may still hold on to some small town values (think of President Obama’s talk about Wall Street versus Main Street), the era of Main Street, even in suburbs and towns that have real Main Streets as opposed to the shopping mall kinds (see here and here), is over.

2. This is a bit odd considering that cities and metropolitan regions are massive economic engines. Aren’t Republicans for markets and a growing economy? Most of this is not happening in rural areas but rather in cities.

3. Tied to #2, suburbs are in part made possible by cities. On one hand, suburbs are more independent than ever before but they are still tied to cities for things like major cultural institutions, major financial institutions, airports and other transportation facilities, and sports teams. Additionally, we should be thinking more about metropolitan regions anyway rather than cities versus suburbs

Overall, we aren’t going back to a United States that is primarily small town or rural. The percent of Americans living in non-metropolitan areas in 1910 was 71.6% while over 80% of American live in metropolitan areas today – a complete switch. The population density of the country tripled from 25.7 to 79.6 people per square mile between 1900 and 2000. The United States of today is an urban nation – and both Republicans and Democrats have to adapt to this.

Lack of WASP candidate for election due to the Internet?

Several commentators have picked up on this feature of the 2012 presidential election: neither candidate is a WASP.

Right now, we’re looking at an absence that would have been a startling presence 50 years ago. With all the focus on economic issues in the U.S. presidential race, there’s hardly any talk about the fact that, for the first time, none of the leading presidential and vice-presidential candidates is a white, Anglo-Saxon Protestant. Moreover, the U.S. Supreme Court has no WASPs. These are new phenomena in the United States.

The totally non-WASP tickets signify major political and social shifts in the networked age. As Robert Putnam showed a decade ago in Bowling Alone, organized groups such as churches, political clubs, fraternal clubs and Scouts have declined in importance. People have moved sharply away from traditional, tightly knit groups into more loosely knit networks that have fewer clan boundaries and more tolerance. The rise of the Internet and mobile connectivity has pushed the trend along by allowing people to expand the number and variety of their social ties…

In 1955, sociologist Will Herberg showed how white America was rigidly divided in Protestant, Catholic, Jew. Indeed, one of the authors of this article was barred from college fraternities because he was Jewish.

Now, when Chelsea Clinton marries, no one remarks on the kippa on her husband’s head. This year, a poll by the Pew Research Center found that 81 per cent of those who know Republican Mitt Romney is a Mormon are either comfortable with his affiliation or say it doesn’t matter to them.

I’m not sure I buy the Internet argument; WASPs lost their elite control because of the Internet? I think the process had started way before this. I wonder if the most basic explanation is that there are simply less WASPs overall in the population. Since the 1950s, there has been a sharp uptick in immigration and more people have had access to education and college and graduate degrees.

NYT lays out three options for how personal religious faith could influence sociological work

At the end of a column looking at this summer’s public debate over research findings from sociologist Mark Regnerus, the writer suggests there are three ways personal religious faith could influence a sociologist’s work:

So if there is not really a Christian method in sociology, but there is a role for a self-described Christian in sociology, as Dr. Regnerus once averred, then what is that role? One can imagine several answers.

First, the religious — or atheist, for that matter — sociologist might have a set of topics that she finds particularly relevant to her beliefs. Given their traditions’ emphasis on traditional family, for example, a conservative Catholic or evangelical Protestant could reasonably gravitate toward the study of family structure.

Second, a scholar might have faith that good research ultimately brings people to God or furthers his plans. A Christian historian might trust that even a modest study of the Spanish-American War, or of Rhode Island history, would do a small part to reveal the providential nature of all history.

Finally, a scholar might be a “Christian scholar” by virtue of the pride he takes in his faith, especially in the secular academy. Dr. Regnerus was a proud Christian witness, once upon a time. But these days he won’t discuss his faith, even with a Christian magazine. Two weeks ago, Christianity Today ran a lengthy interview with Dr. Regnerus in which he said nothing about his religious beliefs.

Option one presented here seems to be the one that would probably be most acceptable to the broader scientific community. Lots of researchers have personal interests that help guide them to particular areas of study but then we tend to assume (or hope), a la Weber’s arguments about value-free sociology, that the findings will not necessarily be influenced by these personal interests. At the same time, some might argue that completely separating personal life and research results may be a modernist dream.

I suspect options two and three wouldn’t get as much broad support.

It would also be interesting to see how this would play out if we weren’t talking about personal religious beliefs but other personal beliefs. For example, Jonathan Haidt has been looking at politics within social psychology and thinking about how these personal (and more collective) beliefs might influence a whole field.

Cell phone users now comprise half of Gallup’s polling contacts

Even as Americans are less interested in participating in telephone surveys, polling firms are trying to keep up. Gallup has responded by making sure 50% of people contacted for polling samples are cell phone users:

Polling works only when it is truly representative of the population it seeks to understand. So, naturally, Gallup’s daily tracking political surveys include cellphone numbers, given how many Americans have given up on land lines altogether. But what’s kind of amazing is that it now makes sure that 50 percent of respondents in each poll are contacted via mobile numbers.

Gallup’s editor in chief, Frank Newport, wrote yesterday about the evolution of Gallup’s methods to remain “consistent with changes in the communication behavior and habits of those we are interviewing.” In the 1980s the company moved from door-to-door polling to phone calls. In 2008 it added cellphones. To reflect the growing number of Americans who have gone mobile-only, it has steadily increased the percentage of those numbers it contacts.

“If we were starting from scratch today,” Newport told Wired, “we would start with cellphones.”…

Although it may be a better reflection of society, mobile-phone polling is more expensive, says Newport. They have to call more numbers because the response rate is lower due to the nature of mobile communication.

As technology and social conventions change, researchers have to try and keep up. This is a difficult task, particularly if fewer people want to participate and technologies offer more and more options to screen out unknown requests. Where are we going next: polling by text? Utilizing well-used platforms like Facebook (where we know many people are turning every day)?

Politicians trying to woo the ambigiously defined middle class

Amidst an election cycle where all sides want to woo the middle class, several researchers suggest that providing an exact definition of the middle class is difficult:

“You can’t define middle class, but you can ask people, ‘Do you still feel middle class?’ And more and more people don’t,” said Tim Smeeding, director of the Institute for Research on Poverty at the University of Wisconsin…

“The whole attraction of middle class … is it doesn’t mean anything,” said Dennis Gilbert, a sociology professor at Hamilton College who studies class issues. “Middle class means anybody who might vote for you.”…

Still, experts say the term middle class has a cultural connotation that goes beyond the number on your paycheck or tax stub.

Kevin Leicht, director of the Iowa Social Science Research Center at the University of Iowa, said many Americans think of a middle-class life as being one in which you have a stable job, own your own home and occasionally buy something substantial like a new car. You also either went to college or have the aspiration of sending your children to college.

I would disagree with Gilbert and agree with Leicht and Smeeding. When asked, Americans do tend to feel they are middle class, the recent economic crisis notwithstanding. The middle class in America is more of an idea than a clearly-defined category that people move in and out of. Cultural categories can be powerful, perhaps even more so than economic realities.

Recently, the Brookings Institution defined six likely life stages a middle-class person goes through and in 2010, a government task force tied being middle class to six outcomes. It is not impossible to set such criteria for measurement purposes but they do not match up with everyone who would call themselves middle class.

Speaking of politicians looking for middle-class votes, I haven’t seen journalists or scholars discussing how this wooing developed in American political history. How long has this wooing been taking place? Is this primarily a post-World War II phenomenon or does it have a longer history? I wonder if the middle class only matters here because it is in this period of history that politicians think there are a large number of voters to be swayed in this category…

Cory Booker uses his social networks to funnel Wall Street money to Newark

Newark mayor Cory Booker has found a way to bring needed money to his city: work his wealthy social networks.

“The room is packed; you had every major hedge-fund, private-equity person,” recalls Joseph Shenker, chairman of law firm Sullivan & Cromwell LLP.

Booker holds guests spellbound using the Hebrew phrase “tikkun olam,” or fixing the world, to describe Ackman’s generosity. It’s a notion Booker has adapted to his city 12 miles (19 kilometers) west of Wall Street, and the moneyed elite are buying in…

“One of the things Cory Booker has done is turned Newark into a national cause,” says Shenker, 55, a New Yorker who remembers watching TV footage of the 1967 riots that left 26 dead. “He has made it a serious issue for the United States.”

Booker, midway through his second four-year term, has raised more than $250 million in donations and pledges for a city where the previous three mayors were convicted of or pleaded guilty to felonies after leaving office.

Mining a network stretching back to Stanford University and Yale Law School, Booker is promoting New Jersey’s largest city as a lower-cost alternative to New York and overseeing nonprofits to fund everything from security cameras to midnight basketball tournaments. Benefactors view Booker as somebody they can work with after decades of corruption, says Larry Sabato, director of the Center for Politics at the University of Virginia.

This reminds me of some of the public-private efforts also being undertaken by Chicago Mayor Rahm Emanuel. If major cities are facing budget issues, this is one way to get money: work with wealthy business people, offer them some results/benefits of investing, and then use the money as you wish.

I could imagine some potential issues with this:

1. Is this a sustainable long-term solution? What if another cause becomes more attractive? What if the city problems become too big to be dealt with using private money?

2. Do the donators have any sway or influence of how the money is used? If so, or, perhaps even more important, if there is even the perception of this, the public may not appreciate this.

3. Generally, does this suggest that it is primarily the powerful people in society, people like important elected officials and wealthy businesspeople, who really to get to decide what gets done? Who really controls a city: the people or those with money and clout?

4. What happens if this money doesn’t lead to much improvement? In business terms, what if there is not a high return on investment?