Nate Silver: “The World May Have A Polling Problem”

In looking at the disparities between polls and recent election results in the United States and UK, Nate Silver suggests the polling industry may be in some trouble:

Consider what are probably the four highest-profile elections of the past year, at least from the standpoint of the U.S. and U.K. media:

  • The final polls showed a close result in the Scottish independence referendum, with the “no” side projected to win by just 2 to 3 percentage points. In fact, “no” won by almost 11 percentage points.
  • Although polls correctly implied that Republicans were favored to win the Senate in the 2014 U.S. midterms, they nevertheless significantly underestimated the GOP’s performance. Republicans’ margins over Democrats were about 4 points better than the polls in the average Senate race.
  • Pre-election polls badly underestimated Likud’s performance in the Israeli legislative elections earlier this year, projecting the party to about 22 seats in the Knesset when it in fact won 30. (Exit polls on election night weren’t very good either.)

At least the polls got the 2012 U.S. presidential election right? Well, sort of. They correctly predicted President Obama to be re-elected. But Obama beat the final polling averages by about 3 points nationwide. Had the error run in the other direction, Mitt Romney would have won the popular vote and perhaps the Electoral College.

Perhaps it’s just been a run of bad luck. But there are lots of reasons to worry about the state of the polling industry. Voters are becoming harder to contact, especially on landline telephones. Online polls have become commonplace, but some eschew probability sampling, historically the bedrock of polling methodology. And in the U.S., some pollsters have been caught withholding results when they differ from other surveys, “herding” toward a false consensus about a race instead of behaving independently. There may be more difficult times ahead for the polling industry.

It sounds like there are multiple areas for improvement:

1. Methodology. How can polls reach the average citizen two decades into the 21st century? How can they collect representative samples?

2. Behavior across the pollsters, the media, and political operatives. How are these polls reported? Is the media more interested in political horse races than accurate poll results? Who can be viewed as an objective polling organization? Who can be viewed as an objective source for reporting and interpreting polling figures?

3. A decision for academics as well as pollsters: how accurate should polls be (what are the upper bounds for margins of error)? Should there be penalties for work that doesn’t accurately reflect public opinion?

Hillary Clinton’s biggest urban Facebook fan base is Baghdad?

Melding political, social media, and urban analysis, a look at Hillary Clinton’s Facebook fans has an interesting geographic dimension:

Hillary Clinton’s Facebook pages have an unexpected fan base. At least 7 percent of Clinton’s Facebook fans list their hometown as Baghdad, way more than any other city in the world, including in the United States.

Vocativ’s exclusive analysis of Clinton’s Facebook fan statistics yielded a number of surprises. Despite her reputation as an urban Democrat favored by liberal elites, Iraqis and southerners are more likely to be a Facebook fan of Hillary than people living on America’s coasts. And the Democratic candidate for president has one of her largest followings in the great red-state of Texas.

While Chicago and New York City, both with 4 per cent of fans, round out the top three cities for Hillary’s Facebook base, Texas’ four major centers—Houston (3 percent), Dallas (3 percent), Austin (2 percent) and San Antonio (2 percent)—contain more of her Facebook supporters. Los Angeles with 3 percent of her fans, and Philadelphia and Atlanta, each with 2 percent, round out the Top 10 cities for Facebook fans of Hillary.

On a per capita basis, in which Vocativ compared a town’s population to percentage of Hillary’s likes, people living in cities and towns in Texas, Kentucky, Ohio, Arkansas, North Carolina and Wisconsin were the most likely to be her fans on Facebook than any other American residents.

This hints at the broader knowledge we might gain from social media and should beg the question of how this information could be well used. I imagine this information could be used for political ends. Is this a curiosity? Is this something the Clinton campaign would want to change? Would this influence the behavior of other voters? The article itself is fairly agnostic about what this means.

This sounds like data mining and here is how the company behind this – Vocativ – describes its mission:

Vocativ is a media and technology venture that explores the deep web to discover original stories, hidden perspectives, emerging trends, and unheard voices from around the world. Our audience is the young, diverse, social generation that wants to share what’s interesting and what’s valuable. We reach them with a visual language, wherever they are naturally gathering…

Our proprietary technology, Verne, allows us to search and monitor the deep web to spot breaking news quickly, and discover stories that otherwise might not be told. Often we know what we’re looking for, such as witnesses near the front lines of a conflict or data related to an emerging political movement. We also uncover unexpected information, like pro-gun publications giving away assault rifles to fans of their Facebook pages.

Is this the Freakonomicization of journalism?

Mayors leading the charge for tackling infrastructure issues

Who is tackling big infrastructure projects these days?

Governors have long been among the nation’s loudest advocates for pouring concrete. Interstate highways? New bridges? Major development projects? They love it. When a huge pot of federal money opened up as part of the 2009 stimulus package, states were eager to get their share of the cash and push it toward pet projects, shovel-ready or not.

And that’s what makes it interesting to see mayors taking the lead on transportation spending. At an event Monday in Boston, the U.S. Conference of Mayors launched what it says will be the largest coordinated campaign by mayors in some time, pushing Congress to reauthorize the surface-transportation bill and to increase funding for local and state infrastructure projects…

All of that combines to create a situation in which mayors, rather than governors, can take over the dominant role in pushing for transportation spending. Of course, mayors have plenty of concerns of their own, especially in big cities. Major bridges like the one that collapsed in Minnesota in 2007 worry them, as do crumbling urban highway interchanges and failing subway systems. Here in D.C., a major parkway was snarled for much of Tuesday after crumbling masonry fell off a bridge into the roadway. Some of the mayors who are most involved in pushing for more infrastructure money are Democratic mayors in Republican-led states—like Kasim Reed of Atlanta.

The article suggests this is primarily a political Republican vs. Democrat question with Democratic mayors pushing for things that Republicans at the national level don’t support. But, I think this ignores another factor: these mayors are at the level of government that is closest to some of these issues. For them, infrastructure is not an abstract concept but rather more often about specific projects that can enhance life in their city. It is the difference between saying “America’s bridges are in trouble” versus “Boston needs an underground highway in order to free up land, improve traffic, and reduce pollution.” And Americans tend to like local government as they see it as more responsive to immediate needs. Governors can lobby for particular projects but they also have to keep in mind the concerns of multiple actors, which might even up pitting cities against each other for limited funds (i.e., is LA or San Francisco more worthy of a major transportation project). Mayors like the applicable projects that they can point to as real change. (An odd thought to throw in here: dictators often like to memorialize themselves with large-scale planning efforts that will outlive them. When municipal power is concentrated in the hands of a single figure, such as a powerful mayor, is a similar process at work?)

While the mayors may be closer to the infrastructure issues, that doesn’t necessarily mean that they can get things done. What kind of clout do mayors have when there are other layers (like governors) to contend with?

What does “going full sociology professor” mean to conservatives?

One recent eventful flight may just confirm all the conservative stereotypes of sociology professors:

“The United States has declared war on Venezuela!” a woman aboard a plane says repeatedly in the video.

The Miami New Times identified the woman as 52-year-old Karen Halnon, an associate professor of sociology at Pennsylvania State University-Abington…

“In a democracy one must speak up and against injustice,” Halnon said in an e-mail to The Post on Tuesday after saying in another email that she was mistreated during her arrest. “To be tortured is not democracy!”…

According to “Inside Edition,” Halnon said she was not intoxicated. “Anyone who is speaking out for social justice, it is the usual situation that most people will think they’re crazy,” she said, according to the show’s news release…

The release noted that Halnon said she lit a cigarette on the plane “to show solidarity with her idol, Cuban dictator, Fidel Castro.”

Airplanes are not the best places to light up and loudly espouse political views. (I do wonder, however, if certain topics might be viewed more favorably by other passengers. What if the airline service was bad and a passenger got up to deliver a populist rant?) Here we have a sociology professor who wants to be deviant (political views, smoking, rant on a plane) in order to promote social justice as well as defend left-wing or Marxist regimes. According to conservatives, isn’t this what all sociology professors do or would secretly like to do?

This is one of those times that it would be interesting to gather a large group of sociologists to see how they would respond…

You’ve been warned (again): McMansions are back!

Newer American homes are bigger than ever:

New American homes were bigger than ever last year, according to data from the U.S. Census Bureau. After a few years of shrinkage in the aftermath of the Great Recession, the median square footage of newly-built homes last year tipped the scales at over 2,400 square feet. That’s nearly 1,000 square feet larger than the median home built in 1992. The death of the McMansion has been greatly exaggerated…

There are any number of explanations for this trend. Young first-time buyers, who are less inclined to buy big suburban houses, are largely sitting out of the market. Credit requirements are still much tighter than they were before the housing collapse, so much of the activity in the housing market is from wealthier families looking to trade up — and they’re looking for bigger and better.

Another, possibly overlooked contributor? Politics. A 2012 paper by Stanford political scientist Adam Bonica found that builders and construction firms were among the most politically conservative businesses in America, judged by their owners and employees’ contributions to political parties. And a Pew Research Center study last year found that conservatives overwhelmingly prefer communities where “the houses are larger and farther apart, but schools, stores and restaurants are several miles away.”

I don’t know how much of this is just political. To suggest so means that both sides can claim the other is trying to push a particular agenda: conservatives argue liberals are trying to force everyone into big cities and liberals can argue developers are politically connected people who only want to serve the wealthy. Either cities or McMansions become the big enemy. I would instead privilege two factors. First, an economic situation where many Americans don’t have the money to purchase a home (the homeownership rate is down overall) as well as a housing market that is primarily catering to wealthier buyers (there are more profits to be made in more expensive homes). Second, there is an American ideology that privileges individualism and private space, values that aren’t exclusively conservative or necessarily related to the exurbs. For example, the suburbs are not full of McMansions; suburbs range from inner-ring suburbs to exurbs with a wide range of housing and populations.

Growing Latino populations in American cities

Latinos constitute a growing share of American urban populations, raising implications for future political races:

While many cities are experiencing an influx of young whites, those gains are more than offset by the continuing exodus of working- and middle-class whites. The result is a net decline nationwide of the white share of city populations.

Hispanic ascendance is apparent in both cities and suburbs, increasing the likelihood of the election of Latinos to local, state and federal office.

Over time, blacks stand to lose leverage. Cities have been a crucial base of power for African-American politicians. Insofar as the black population becomes diffuse, black leaders will have to grapple with a decline in black-majority districts, especially city council districts, in cities with declining black populations…

Frey pointed toward the rapidly increasing strength of the Latino vote in the 100 largest metropolitan areas. Between 1990 and 2010, the percentage of city dwellers in such areas who are Hispanic grew to 26 percent from 17 percent; and the share of suburban residents who are Hispanic rose to 17 percent from 8 percent.

Some striking demographic changes that have potential consequences in areas like politics. The changes are numerous: an influx of younger, educated whites into city centers even as whites leave other areas of cities; an increase in the suburbanization of blacks; and growing Latino populations in both cities and suburbs. These changes may not quickly become apparent in the political landscape but should at least draw the attention of political operators. For example, is incumbent Mayor Rahm Emanuel really in danger in the run-off election? Given the demographic changes in large cities like Chicago, perhaps.

Gallup CEO criticizes measurement of unemployment in the US

The CEO of Gallup says the current unemployment rate is “a Big Lie” because of how it is calculated:

None of them will tell you this: If you, a family member or anyone is unemployed and has subsequently given up on finding a job — if you are so hopelessly out of work that you’ve stopped looking over the past four weeks — the Department of Labor doesn’t count you as unemployed. That’s right. While you are as unemployed as one can possibly be, and tragically may never find work again, you are not counted in the figure we see relentlessly in the news — currently 5.6%. Right now, as many as 30 million Americans are either out of work or severely underemployed. Trust me, the vast majority of them aren’t throwing parties to toast “falling” unemployment.There’s another reason why the official rate is misleading. Say you’re an out-of-work engineer or healthcare worker or construction worker or retail manager: If you perform a minimum of one hour of work in a week and are paid at least $20 — maybe someone pays you to mow their lawn — you’re not officially counted as unemployed in the much-reported 5.6%. Few Americans know this.

Yet another figure of importance that doesn’t get much press: those working part time but wanting full-time work. If you have a degree in chemistry or math and are working 10 hours part time because it is all you can find — in other words, you are severely underemployed — the government doesn’t count you in the 5.6%. Few Americans know this…

Gallup defines a good job as 30+ hours per week for an organization that provides a regular paycheck. Right now, the U.S. is delivering at a staggeringly low rate of 44%, which is the number of full-time jobs as a percent of the adult population, 18 years and older. We need that to be 50% and a bare minimum of 10 million new, good jobs to replenish America’s middle class.

How an official statistic is measured may seem mundane but it can be quite consequential, as is noted here. What exactly does it take to get a government agency to measure and report data differently?

This critique may make some interesting political bedfellows. Conservatives might jump on this in order to show that the current administration hasn’t made the kind of economic progress they claim. Liberals might also like this because it suggests a lot of Americans still aren’t doing well even as big corporations and Wall Street seem to have profited. Neither political party really wants to take on Wall Street so they might support these numbers so stocks keep moving up.

Can sociologists be the ones who officially define the middle class?

Defining the middle class is a tricky business with lots of potential implications, as one sociologist notes:

“Middle class” has become a meaningless political term covering everyone who is not on food stamps and does not enjoy big capital gains. Like a sociological magician, I can make the middle class grow, shrink or disappear just by the way I choose to define it.

What is clear and incontestable is the growing inequality in this country over the last three decades. In a 180-degree reversal of the pattern in the decades after World War II, the gains of economic growth flow largely to the people at the top.

I like the idea of a sociological magician but this is an important issue: many Americans may claim to be middle class but their life chances, experiences, and tastes can be quite different. Just look at the recent response to possible changes to the 529 college savings programs. A vast group may help political parties make broad appeals yet it doesn’t help in forming policies. (Just to note: those same political parties make bland and broad appeals even as they work harder than ever to microtarget specific groups for donations and votes.)

Given some recent conversations about the relative lack of influence of sociologists, perhaps this is an important area where they can contribute. Class goes much further than income; you would want to think about income, wealth, educational attainment, the neighborhood in which one lives, cultural tastes and consumption patterns, and more. The categories should clearly differentiate groups while remaining flexible enough to account for combinations of factors as well as changes in American society.

Indiana moving away from “Illinoyed” campaign to attract businesses?

Indiana continues campaigns to catch the attention of Illinois firms but it may soon take a different tone:

For three years, in an economic development strategy aimed squarely at jobs and revenue in higher-tax states, Indiana has been trying to poach Illinois businesses. While they say the tactic has succeeded wildly, officials in Illinois say the impact of cross-border moves largely has been a wash, more political theater than anything substantive…

Kelly Harrington Nicholl, head of marketing at the development corporation since 2009, is the woman behind Indiana’s most memorably catty catchphrases: “Illinoyed” and “Stillinoyed.” But after years of poking fun at its fiscally challenged neighbor, Indiana is about to soften its tone. “We’re not going to beat up on Chicago anymore,” Smith says.

This means that a cluster of billboards along I-90 cautioning northbound drivers that higher taxes lie ahead will come down soon, Nicholl says. “It’s time to play nice,” she says. She declines to say whether Illinois’ newly elected Republican governor, Bruce Rauner, has anything to do with it. “There is a sunset to everything.”…

Despite Indiana’s bravado, the number of state-to-state moves are increasing in both directions, according to an analysis of preliminary data by the Chicago Metropolitan Agency for Planning. The data, supplied by New Jersey-based research firm Dun & Bradstreet, show 70 companies in Illinois relocated their entire business or branches of their business to Indiana in 2013, up from 40 in 2012. During the same period, 48 companies in Indiana moved all or portions of their businesses to Illinois, up from 39 in 2012.

The shift in political theater is noteworthy. Did everyone in Indiana get the political things they wanted? While the shift may be due to Rauner’s election, I wonder if it could also be due to (1) the Illinoyed campaign wearing out (marketing campaigns have a limited shelf life before people stop responding and (2) recognition that, according to the data, the campaign has been a wash (even popular lines can’t hold up forever if not supported by evidence). The competition between the states is likely not completely over but it is interesting to consider how Illinois and Indiana might cooperate to enhance the economies of both states…

“Why Congress won’t raise the gas tax”

Gas prices are lower and the money is needed for highways but one writer suggests Congress is nowhere near raising the gas tax:

Fuel prices are plunging to their lowest level in years. The Highway Trust Fund is broke, and Congress faces a spring deadline to replenish it. The obvious answer—the only answer, according to many in Washington—is to raise the 18.4 cent-per-gallon gas tax, which hasn’t gone up in more than 20 years. Since prices at the pump have dropped more than a dollar per gallon in some areas, drivers would barely notice the extra nickel they’d be forced initially to pay as a result of the tax hike. That wasn’t true until recently: For years, the pocketbook punch of the Great Recession combined with gas prices that peaked above $4 made an increase both politically and economically untenable.

Yet even with prices at a four-year low, the odds of Congress touching the gas tax are as long as ever. “I think it’s too toxic and continues to be too toxic,” said Steve LaTourette, the former Republican congressman best known for his close friendship with his fellow Ohioan, Speaker John Boehner. “I see no political will to get this done.”…

Advocates on and off Capitol Hill are mounting a new push to lift the gas tax as Republicans prepare to assume full control of Congress in January. Funding for the Highway Trust Fund will run out May 31. On 60 Minutes last month, officials including former Transportation Secretary Ray LaHood and former Pennsylvania Governor Ed Rendell used the specter of a major bridge or highway collapse to warn of the need for new investments. LaHood, a Republican who was once rebuked by the Obama White House for suggesting a switch to a mileage-based tax, is now going public on the gas tax, in his typically colorful style. “The best argument for doing it is is that America is one big pothole,” he told me in a phone interview, “and America’s infrastructure is in the worst shape that we’ve seen in decades.”…

In a separate interview, Blumenauer said the administration had recently “dialed back” its opposition, with senior officials telling lawmakers that if Congress could somehow pass a gas tax hike, he would sign it. Yet just a few hours after his and Petri’s press conference, Obama himself seemed to put their plan back on ice. At a business roundtable at the White House, FedEx CEO Frederick Smith asked Obama why Congress couldn’t just raise the gas tax and solve the infrastructure problem. “In fairness to members of Congress, votes on the gas tax are really tough,” the president replied, after first chuckling that if it he were in charge on Capitol Hill, “I probably already would have done it.”

It sounds like Congress thinks that such a move would be very unpopular. Americans like driving (even if they have cut back in recent years), prefer cheaper gas, believe the country is still experiencing tough economic times, and many don’t want to personally pay more in taxes. Yet, it makes some sense that highways should be funded by the gas tax: if you use the highways and associated infrastructure, you should help bear some of the cost.

Is Congress responsible for this or the American people? The article suggests Congress won’t act but Congress suggests the American people wouldn’t want it. Are both groups pretty blind to infrastructure needs or long-term investments? In the short-term, few people want to pay the necessary costs but no one will like it if the situation becomes dire.