When the candidate with the big data advantage didn’t win the presidency

Much was made of the effective use of big data by Barack Obama’s campaigns. That analytic advantage didn’t help the Clinton campaign:

Clinton can be paranoid and self-destructively self-protective, but she’s also capable of assessing her own deficiencies as a politician in a bracingly clear-eyed way. And the conclusion that she drew from her 2008 defeat was essentially an indictment of her own management style: Eight years earlier, she had personally presided over a talented, sloppy, squabbling, sprawling menagerie of pals, longtime advisers and hangers-on who somehow managed to bungle the building of a basic political infrastructure to oppose Obama’s efficient, data-driven operation.

To do so, Mook hired a buddy who had helped Terry McAuliffe squeak out a win in the 2014 Virginia governor’s race: Elan Kriegel, a little-known data specialist who would, in many ways, exert more influence over the candidate than any of all-star team of veteran consultants. Kriegel’s campaign-within-a-campaign conducted dozens of targeted surveys—to test messaging and track voter sentiment day-by-day, especially in battleground states—and fed them into a computer algorithm, which ran hundreds of thousands of simulations that were used to steer ad spending, the candidate’s travel schedule, even the celebrities Clinton would invite to rallies.

The data operation, five staffers told me, was the source of Mook’s power within the campaign, and a source of perpetual tension: Many of Clinton’s top consultants groused that Mook and Kriegel withheld data from them, balking at the long lead time—a three-day delay—between tracking reports. A few of them even thought Mook was cherry-picking rosy polling to make the infamously edgy Clinton feel more confident…

In numerous interviews conducted throughout the campaign, Clinton staffers attested to Mook’s upbeat attitude and mastery of detail. But, in the end, Brooklyn simply failed to predict the tidal wave that swamped Clinton—a pro-Trump uprising in rural and exurban white America that wasn’t reflected in the polls—and his candidate failed to generate enough enthusiasm to compensate with big turnouts in Detroit, Milwaukee and the Philadelphia suburbs.

It would be fascinating to hear more. The pollsters didn’t get it right – but neither did the Clinton campaign internally?

The real question is what this will do to future campaigns. Was Donald Trump’s lack of campaign infrastructure and reliance on celebrity and media coverage (also highlighted nicely in the article above) something that others can or will replicate? Or, would the close margins in this recent presidential election highlight even more the need for finely-tuned data and microtargeting? I’m guessing the influence of big data in campaigns will only continue but data will only get you so far if it (1) isn’t great data in the first place and (2) people know how to use it well.

Connecting sundown towns and votes for Trump in Wisconsin

Sundown towns were once common in the North and one academic looks at the connections between such communities and voting for Donald Trump:

Did sundown towns elect Trump in Wisconsin? My research assistant, Kathryn Robinson, and I tried to find out. Since it is much easier to get county-level election returns than municipal ones, we concentrated on “sundown counties,” those having a county seat that could be established as a sundown town or likely sundown town in Loewen’s mapping. An incredible 58 of the state’s 72 counties fit into such a category. Of the 58 sundown counties 31 are 1% or less African American (and only eight more than 2%), suggesting that the proxy of the county seat works in identifying sundown areas at the county level.

The simple answer on Trump and sundown towns in Wisconsin is: “Clearly they elected him.” Sundown counties gave Trump almost 935,000 votes to Clinton’s just over 678,000. His margin in the sundown areas exceeded 256,000 votes. That Clinton won the fifteen non-sundown counties by almost 230,000 votes could not make up for Trump’s 58% to 42% margin in the sundown ones. Just short of two/thirds of all Trump voters in Wisconsin came from sundown counties. Only nine sundown counties chose Clinton with 49 for Trump…

Our appreciation of the critically important historical dimension to sundown voting—both Robinson and I are trained in that discipline—ironically came through a sociologist. That is, when I contacted Loewen to outline the project to him, he mentioned having recently been to Calhoun County, a tiny sundown county in Illinois near where I grew up. That county, he told me, had voted for Obama in the same proportions as the rest of the country in 2008. I then looked up its 2016 vote, a landslide for Trump. Robinson and I had reason to wonder if a similar swing from Obama to Trump characterized the 2008 to 2016 trajectory of sundown county voters in Wisconsin.

The pattern could hardly been more striking. In 2008, Barack Obama defeated John McCain in all but eight of Wisconsin’s sundown counties. These virtually all-white counties delivered to the African American candidate a majority of nearly 143,000 votes. The fifteen very small sundown counties discussed above supported Obama in 2008 by 57.4% to 42.6%. The countervailing continuity lay in the metro Milwaukee suburbancounties, where the vote went to the conservative candidate in both 2008 and 2016, by overwhelming margins in both cases. The intervening 2012 election proved a halfway house, with the Milwaukee suburban counties solidly for Romney but Obama splitting the other sundown counties with the Republican ticket. By 2016, just under 400,000 votes had switched from the Democratic to the Republican candidate in sundown Wisconsin. Outside of the sundown counties the pro-Republican swing from 2008 to 2016 was just 17,000 votes.

It would be worthwhile to see such research carried out elsewhere as there were more sundown towns than people imagine (even if actual laws or records about them are difficult to find).

While Loewen alerts us to this important history, it is also interesting to consider how sundown counties or towns can experience rapid racial and ethnic change. This article cites a rural community that suddenly had an influx of Latino workers for several manufacturing plants. Or, imagine some suburban areas after World War Two that had rapid development and demographic change. I’m thinking of Naperville, Illinois, a sundown town that due to high quality residential and job growth is a suburb today that is increasingly non-white and where city leaders praise the growing diversity. Is there a point where the effects of being a sundown town disappear or could such effects pop up again depending on the situation (economic factors, racial and ethnic change, certain leaders, etc.)?

Should Trump promote a third wave of American suburbanization?

Walter Russell Mead suggests Donald Trump could help usher in a new wave of suburbanization:

What President-elect Trump has the opportunity to do now is to launch a third great wave of suburbanization, one that can revive the American Dream for the Millennial generation, produce jobs and wealth that can power the American economy, and take advantage of changing technology to create a new wave of optimism and dynamism in American life.

There’s a confluence of trends that make this possible. In the first place, the Millennials, like the Boomers, are a large generation that needs both jobs and affordable homes. Second, the shale revolution means that energy in the United States will likely be relatively abundant and cheap for the foreseeable future. Third, both financial markets and the real economy have recovered from the shock of the financial crisis, and, whatever hiccups and upsets may come their way, are now ready for sustained expansion. Fourth, revolutions in technology (self-driving cars and the internet) make it possible for people to build a third ring of suburbs even farther out from the central cities, where land prices are still low and houses can be affordably built.

For national politicians, this is a huge opportunity. Creating the infrastructure for the third suburban wave—new highways, ring roads and the rest of it for another suburban expansion—will create enormous numbers of jobs. The opportunity for cheap housing in leafy places will allow millions of young people to get a piece of the American Dream. Funding the construction of this infrastructure and these homes gives Wall Street an opportunity to make a lot of money in ways that don’t drive the rest of the country crazy.

This approach meshes very well both with the President-elect’s economic instincts and with the economic interests of the people who voted for him. It also works for the Republican dominated states around the country. It capitalizes on one of America’s distinctive advantages: less densely-populated than other advanced countries, the United States has the elbow room for a new suburban wave.

There are all sorts of fascinating things going on with this argument. Let’s just pick out a few.

To start, this argument suggests Eisenhower and Reagan were great because they helped make the suburbs happen. How much did they do in this regard? By the early 1950s, suburbanization was well underway with a postwar housing shortage and lots of developers and local officials interested in building out. The Federal Highway Act of 1956 certainly helped the process and is often credited for helping urban residents flee cities (even though highways were already under construction in many places). This is a good example of presidents getting credit for things that don’t have much direct control over.

Second, this equates Republicans with suburbs. There are certainly patterns here: suburbanites have tended to vote Republican for a long time (particularly the further out one gets) and both Republicans and Democrats have argued more sprawl leads to more Republicans. At the same time, not every conservative loves suburbs nor does every Democrat love cities. If you had to summarize Republicanism since World War II, would suburbs come to mind or other things?

Third, it sounds like this argument is in favor of government spending to promote a certain way of life. In other words, the federal government should subsidize more suburban growth because it helps generate jobs and housing. While this may fit older images of moderate Republicans (Eisenhower was one, Reagan not so much), it doesn’t fit well with more libertarian/small government Republicans. Why should the government promote certain ways of life?

To conclude, it is clear that all of this requires an optimistic view of suburban life. It is the fulfillment of the American Dream. This is a common American image. Does it match all of reality? Are the suburbs open to all? Would the new spending even further from cities open new opportunities for non-whites, immigrants, and the lower class (who are increasingly in the suburbs) or would it allow whiter, wealthier residents to flee even further from urban problems? What are the environmental costs of another ring of suburbia? What does it do to civic life to continue to promote automobile driven culture (even if those self-driving cars are safer and more environmentally friendly)? These are not easy questions to answer even if many Americans would enjoy a third wave of suburbanization.

Count sociologists among the most liberal Americans – at least for one humorist

Imagining the exodus of Americans for Canada, here is who one humorist depicted as most distraught over the recent presidential election results:

Canadian border farmers say it’s not uncommon to see dozens of sociology professors, global warming activists, and “green” energy proponents crossing their fields at night.

“I went out to milk the cows the other day, and there was a Hollywood producer huddled in the barn,” said Southern Manitoba farmer Red Greenfield, whose acreage borders North Dakota . “The producer was cold, exhausted and hungry.  He asked me if I could spare a latte and some free-range chicken. When I said I didn’t have any, he left before I even got a chance to show him my screenplay, eh?”

Given all the academic content the 2016 election is likely to generate in the years to come, someone has to examine which groups had the strongest negative emotions about the results as well as which groups felt this pain the longest. Would sociologists rank up there?

When urban non-profits represent residents better than local government

A sociologist suggests the role of non-profit organizations has changed in urban areas:

To Levine, the incident illustrates something he’s been tracking over four years of monitoring the interactions between neighborhood nonprofits, city leaders, and private organizations in Boston. Based on his observations, he argues in the journal American Sociological Review, the role of nonprofits in disadvantaged city neighborhood has been changing. They’re no longer just extensions of the state or representatives of a few interest groups. They’re “legitimate representatives of poor urban neighborhoods,” and in many cases, “supersede” elected officials…

What’s happening now is that these organizations are directly negotiating for resources from public and private sector entities that hold the proverbial purse strings. Community organizations are now authoritative voices at the table, and often regarded by both private companies and bureaucrats as more invested and deeply knowledgable representatives of the neighborhoods. In Boston, “district-based elected officials, by contrast, attended ribbon cuttings and groundbreakings but were largely absent from substantive discussions of redevelopment planning,” Levine writes.

The phenomenon is particular to low-income communities for a reason: These communities have very specific needs for services. But also, these are the places where voices of residents can be easily unheard by politicians. Think about neighborhoods in Detroit left to fend for themselves for basic needs in the city’s worst days. It’s community organizations that are transforming them into livable spaces. In Flint, where residents’ concerns about poisonous water were essentially ignored for the longest time, it’s nonprofits that are stepping in to address the damage done. “There’s a political vacancy in these poor neighborhoods that these organizations can fill.”…

Obviously, this phenomenon has a lot of positives. For one, it’s a “victory for the motivation of the war on poverty,” Levine says. Empowered community organizations present a stronger front against displacement, environmental racism, and transit inequity. They can be more consistent than elected officials, because they don’t suffer from political turnover. But the good stuff only happens if these organizations know what the entire neighborhood actually needs. Sometimes they don’t. And in those cases, it’s not possible to vote them out or hold them accountable. If a nonprofit dissolves, it’s hard to pick up the pieces quickly, because the infrastructure for a new organization has to be rebuilt from scratch.

I’ve recently heard or read several critiques of national and local urban policy in the United States that suggest much of what has been tried has been ineffective. At the same time, this doesn’t necessarily mean that government needs to be completely eliminated from the equation. At times, only a larger government body can access certain resources or leverage certain opportunities. But, this new analysis suggests perhaps the best conduit between government (with the resources) and the people is a non-profit. Perhaps government can’t do everything, particularly in responding to local needs when politicians need to answer both to local voters as well as politicians and leaders above them.

Of course, we want to know whether the role of non-profits leads to better outcomes. National and local governments have been fighting a war on poverty and/or trying to address the issues present in poor urban decades for roughly half a century now.

Chicago suburbs largely go for Clinton

Bucking historical trends, all but McHenry County in the Chicago suburbs went for Hillary Clinton.

The Democratic Party of DuPage got a sudden influx of young foot soldiers, like organizer Alex Franklin, who campaigned for charismatic Democrat Bernie Sanders until the Vermont senator conceded to Clinton in July, then went to work for Clinton. Clinton won DuPage County by 14 percentage points on Tuesday.

“If you look at the holes right now, even where Democrats lost in DuPage there were absurdly high numbers, which are a direct result of the Sanders people and what we were doing out here,” said Franklin, of Glen Ellyn. He sees the merger of Clinton and Sanders supporters as the beginning of a beautiful friendship that will spill over into spring municipal elections…

This year, support for local candidates by minorities down ballot helped Clinton at the top of the ticket, experts said…

Shunning the New York billionaire might have cost Illinois Republicans down ballot, said Mark Fratella, a Trump delegate and Addison Township GOP organizer.

A variety of explanations. Yet, one is ignored here: the Chicago suburbs have experienced a lot of demographic change in recent decades: more non-white residents, more immigrants moving directly to the suburbs (rather than to neighborhoods of Chicago first), more lower and working-class residents. In other words, the images of Lake County and the North Shore or DuPage County as looking like Lake Forest, Highland Park, Hinsdale, Elmhurst, and Wheaton (all white and wealthy) simply do not hold.

A great graphic shows the change over time in recent elections:

Elections since 1960

The trends are clearly away from Republicans in the collar counties.

See earlier posts about presidential candidates fighting over the suburban vote here and here.

Both parties treat the President as too powerful and important

One of my takeaways from the long 2016 election season: both political parties put too much effort into electing a President who only has limited powers. The President is certainly an important symbol and they have a bully pulpit – and both parties in recent decades seem to be interested in increased executive powers, even if they want to exercise those powers in different areas – but they are only one part of the government. Voting for the right President is not a do or die affair: it is great for the media (and while they may not have liked Trump, they liked the attention he drew and the controversy around him) and perhaps more interesting to the public but I’m skeptical that a single good or bad leader can make all the difference.

I’d rather we view the American government as a complex system. Certain actors, like the President, may be more visible or powerful than others but they can rarely act unilaterally.

Sociology and totalitarian regimes

The discipline of sociology in Russia/the Soviet Union has faced problems over the decades:

Totalitarian regimes have a conflicted relationship with sociology. On the one hand, they have no elections or free media from which to learn about the public mood, so they need sociologists even more than democratic governments do. On the other hand, their fear of information is directly proportional to their need for it. They fear that sociologists, if allowed to work freely, will obtain knowledge about the vulnerabilities of the regime. An ideal totalitarian regime would find a way to obtain sociological data without the sociologists.

This push-pull relationship with sociology kept playing out throughout the Soviet period. For decades, sociology was effectively a banned discipline. Even Karl Marx, in official Soviet scholarship, was stripped of his sociological credentials, retaining the title only of “founder of scientific communism, teacher and leader of the international proletariat.” But starting in the 1950s, a little bit of sociology was allowed, under the auspices of philosophy — Marxist philosophy, of course…

The Levada Center retained its reputation as the most reliable source on Russian public opinion. Even federal ministries occasionally commissioned surveys from it. Sometimes the results of those differed little or not at all from those produced by the Kremlin-controlled pollsters.

But the Levada sociologists could not be controlled by the Kremlin, and that sealed their fate. In the end, the Kremlin’s fear of information became stronger than the desire to know, just as Mr. Gudkov knew it would.

This piece focus on one issue sociologists face within totalitarian regimes: dictators tend to want to control what information is available while sociologists generally want to make information available. Knowledge is power and those who try to subvert the official information stream are punished.

There is also at least one other issue regarding such information: what purpose should it serve? Do sociologists living in these conditions support or endorse the totalitarian actions? If so, are there justifiable reasons for doing so? Generally, sociology has thrived in places with more democratic governments and the discipline of sociology in the United States has shied away from ideas of fascism and totalitarianism, partly on the conservative end of the spectrum. (I’m sure there is work about this; the 1960s was an interesting point for sociology as prior to this, the discipline had some prominent conservative theorists.)

This could lead to an interesting question: is the practice of sociology generally limited to liberal democracies? In other words, it may only be possible under certain societal conditions and may not have emerged as it did without the changes to the nation-state and the start of the Scientific Revolution and the Enlightenment in Europe.

NYT: Yes, don’t trust online polls

Although the purpose here may truly be to discredit Donald Trump, here is another argument in the New York Times against online polls:

“Those do a good job of engaging audiences online, and they do a good job of letting you know how other people who have come to the webpage feel about whatever issue,” said Mollyann Brodie, the executive director for public opinion and survey research at the Kaiser Family Foundation. “But they’re not necessarily good at telling you, in general, what people think, because we don’t know who’s come to that website and who’s taken it.”

Professional pollsters use scientific statistical methods to make sure that their small random samples are demographically appropriate to indicate how larger groups of people think. Online polls do nothing of the sort, and are not random, allowing anyone who finds the poll to vote. They are thus open to manipulation from those who would want to stuff the ballot box. Users on Reddit and 4chan directed masses of people to vote for Mr. Trump in the instant-analysis surveys, according to The Daily Dot. Similar efforts were observed on Twitter and other sites.

Even when there is no intentional manipulation, the results are largely a reflection of who is likely to come to a particular site and who would be motivated enough to participate. Intuitively, it’s no surprise that readers of sites like Breitbart News and the Drudge Report would see Mr. Trump as the winner, just as Mrs. Clinton would be more likely to find support on liberal sites…

“In our business, the key is generalizability,” he said, referring to the ability of a sample group to apply to a wider population. “That’s the core of what we do. Typically, it takes a lot of time, and a lot of effort, and a lot of money to do it.”

One helpful solution may be to have media outlets refuse to use any online polls. On one hand, journalists often remind the public that they don’t mean anything while they consistently offer them on their website or on the evening news broadcast. They may have some marketing purpose – perhaps participants feel more engaged or it can give outlets some indication of how many people are going further than just passively taking it in – but why confuse people.

What do those post-debate snap polls tell us?

Ed Driscoll comments on the results of some of the post-debate snap polls:

TRUMP WINS MOST IMMEDIATE POLLS: “The newspaper collected screen shots of 19 ‘snap’ polls conducted immediately after the debate, and in 17 of them, most respondents said Trump won the debate, often by a wide margin. It isn’t just Drudge and Breitbart; Trump also got more votes than Clinton in instant polls at Time, Slate, Variety and other liberal outlets. I can’t explain it, other than to say that perhaps it tells us more about how people view Hillary Clinton than about how Donald Trump actually performed.”

Well, certainly one explanation is a repeat of the “Ron Paul Revolution” days of early 2008 – but as with Paul’s quixotic presidential bid, having a large enough group of dedicated zealots to tilt Internet polls does not necessarily translate into sufficient votes at the ballot box where it counts.

It seems safe to say that Trump’s core followers are much more passionate than Hillary’s. We’ll know soon enough if there are a majority of them.

The large issue with these snap polls is that they are unrepresentative. We don’t know who answered them and in what numbers. As suggested here, perhaps Donald Trump has more active followers who take such polls.

At the same time, if there are consistent patterns in non-helpful polls like this, perhaps they can provide insights into concerted online efforts. They may not reveal much about the electorate at large but they could help us understand patterns of partisans. Why is it important to “win” such snap polls? Are there dedicated efforts to win and how are these efforts organized?

Ultimately, does this suggest that snap polls are even worse than being unrepresentative: they are regularly used by particular groups to push a message? Winning in any arena is simply too important to be left to real survey methods…