Using plagiarism detection software to examine anti-Muslim bias in post-9/11 news coverage

A new sociological study suggests mainstream media sources tended to rely on the rhetoric of certain anti-Muslim groups after 9/11:

“The vast majority of organisations competing to shape public discourse about Islam after the September 11 attacks delivered pro-Muslim messages, yet my study shows that journalists were so captivated by a small group of fringe organisations that they came to be perceived as mainstream,” the paper’s author, University of North Carolina assistant professor of sociology Christopher Bail, told Wired.co.uk…

Bail and his team used plagiarism detection software to compare 1,084 press releases produced by 120 different organisations with more than 50,000 television transcripts and newspaper articles produced between 2001 and 2008. The software picked up damning similarities between the releases and stories from news outlets including the New York Times, USA Today, the Washington Times, CBS News, CNN and Fox News Channel.

“We learned the American media almost completely ignored public condemnations of terrorist events by prominent Muslim organisations in the United States,” Bail told Wired.co.uk. “Inattention to these condemnations, combined with the emotional warnings of anti-fringe organisations, has created a very distorted representation of the community of advocacy organisations, think tanks, and religious groups competing to shape the representation of Islam in the American public sphere.”…

Bail’s paper, published in the American Sociological Review, is part of a wider study which will investigate how the influence of these fringe groups has spread beyond media and in to the real world, where doors have been opened to elite conservative social circles and conservative think tanks — the first steps to influencing public policy and national opinion. Bail touched upon this in the current study after analysing publicly available information on the organisations’ membership, which revealed troubling crossovers between fringe and mainstream organisations.

Four quick thoughts:

1. It sounds like there could be some importance influence of social networks. These fringe groups may be on the edges of public discourse but they have connections or means to which to reach more mainstream media sources. How much of this reporting is built on previous personal connections?

2. This sounds like a clever use of plagiarism software. Such software is intended to catch students in using published material incorrectly but it can also be used to track common quotes, phrases, and narratives.

3. In general, how much does the media today rely on press releases and reports from mainstream or fringe groups without interviews, fact-checking, and sorting through all the information?

4. Would a similar study involving elite liberal social circles and think tanks find similar things?

Reading between the lines of an ABC News story on the bad odds of winning the $500 million Powerball lottery

Check out this ABC News video about the odds of winning the $500 million Powerball lottery.

Several things are striking about the content of the video beyond the bad odds of winning: 1 in 175 million chance.

1. A journalist admits he doesn’t know much about math or statistics. It is not uncommon for reporters to go to experts like statisticians in times like these (appealing to the expert boosts the credentials of the story) but it is more unusual for journalists to admit they are doing so because they don’t know the information. I’ve argued before we need more journalists who understand statistics and science.

2. The reporter mentions some interesting odds that are more favorable than winning the Powerball. One of these is the idea that you are more likely to be possessed by the devil today than win the lottery. Who exactly keeps track of these figures and how accurate are they?

3. The story includes some talk about being more likely to win in particular states than others. Really? This sounds more like statistical noise or something related to the population of the states with multiple Powerball winners (like Illinois and New Jersey).

4. Interesting closing: the math expert himself hasn’t bought a lottery ticket before. So the moral of the story is that people shouldn’t buy any tickets?

An argument for Amazon’s one-star reviews reveals the role of cultural critics

A professional critic praises Amazon’s one-star reviews:

About a year ago, while shopping online for holiday gifts, I became an unabashed connoisseur of the one-star amateur Amazon review. Here I found the barbed, unvarnished, angry and uncomfortably personal hatchet job very much alive. Indeed, I became so enamored of Amazon’s user-generated reviews of books, films and music that my interest expanded to the one-star notices on Goodreads, Yelp and Netflix, where, for instance, a “Moneyball” review notes the movie “did not make you feel warm and fuzzy at the end as a good sports film should.” How true! A rare opinion on a critical darling!…

But there is a visceral thrill to reading amateur reviewers on Amazon who, unlike professional critics, do not claim to be informed or even knowledgeable, who do not consider context or history or ambition, who do not claim any pretense at all. Their reviews, particularly of classics, often read as though these works had dropped out of space into their laps, and they were first to experience it. About “Moby-Dick,” one critic writes: “Essentially, they rip off the plot to ‘Jaws.'” About “Ulysses,” another critic writes: “I honestly cannot figure out the point, other than cleverness for cleverness’ sake.”

Likewise, to seriously dismiss “The Great Gatsby” as “‘Twilight’ without the vampires,” as an Amazon reviewer did, may be glib and reductive, but it’s also brilliantly spot on, the kind of comparison a more mannered critic might not dare. “Whoever made that ‘Twilight’ comparison, whether they know it, is showing their education, that they can connect new media with old works and draw fresh conclusions,” said David Raskin, chair of the art history, theory and criticism department at the School of the Art Institute of Chicago…

Speaking of honesty: It should be pointed out here that, in general, online amateur reviews are not mean but usually as forgiving as the professional sort. Bing Liu, a data-mining expert at the University of Illinois at Chicago who has studied online reviews — “partly because I was curious if they were real or just someone gaming the system” — told me that 60 percent of Amazon reviews are five-star reviews and another 20 percent are four-star. The information research firm Gartner released a study in September predicting that, within a couple of years, between 10 and 15 percent of online reviews will be paid for by companies — rigged.

It sounds like the argument is this: you can find the average American in the one-star Amazon reviews. Instead of getting the filtered, sophisticated review typically found in media sources, these reviewers give the unvarnished pop culture take. Discussed in this argument is the idea of social class and education. An approved reviewer or critic, the typical gatekeeper, is able to put a work in its context. The educated critic is trying to make the work understandable for others. The educated critic often has experience and education backing their opinions. In contrast, the Internet opens up spaces for individuals to post their own reactions and through aggregation, such as the Amazon five-star review system, have some say about how products and cultural works are perceived.

This new reality doesn’t render cultural gatekeepers completely irrelevant but it does do several things. One, it dilutes their influence or at least makes it possible for more critics to get involved. Second, it also makes more visible the opinions of average citizens. Instead of just theorizing about mass culture or pop culture, we can all see what the masses are thinking at the moment they are thinking it. (Think of the possibilities on Twitter!) Third, it provides space like in this article for reviewers to admit they don’t always want to write erudite pieces but want to have a “normal person reaction.”

Just one problem with this piece: the critic says he doesn’t really read the one-star Amazon reviews for information. Instead, he appreciates the “visceral thrill.” He quotes an academic who says such reviews reveal cultural gaps. Thus, celebrating the one-star reviews may be just another way to assert the traditional reviewer’s cultural capital. Read the one-star reviews for entertainment but continue to go back to the educated reviewer for the context and more valued perspective.

The intersection of Chinese bridal couples asking for cash, Facebook, and protests

This could be a poster story for globalization: on Facebook, a Hong Kong bride asked for money from wedding attendees and this has attracted protestors to the wedding.

That’s the prospect facing one Hong Kong couple, who infuriated hundreds after the bride’s Nov. 2 Facebook post went viral.

“I’m not opening a charity….If you really only want to give me a HK$500 [US$65] cash gift, then don’t bother coming to my wedding,” she wrote earlier this month, according to an article Thursday in the Wall Street Journal China.

The bride’s identity and wedding venue were identified by social media users, and a protest was organized via Facebook. Nearly 1,000 have claimed they will attend.

A spokesperson for the hotel where the wedding will be held said they plan on honoring their contract with the couple.

Though giving newlyweds cash is a traditional Chinese custom, sociologist Ting Kwok-fai told The Wall Street Journal that Hong Kong weddings have grown increasingly extravagant in recent years. Engaged couples feel pressured to minimize the cost of the affair, he said, and in this case, the bride may be seeking to recoup some of the costs of the wedding.

Multiple social forces are coming together here in a new kind of way: traditional social norms, new technology and interaction on Facebook, and more public concerns about inequality and conspicuous consumption. This reminds me of the classic 1929 work of the Chicago School of sociology titled The Gold Coast and the Slum. While studying neighborhoods just north of the Loop in Chicago, Zorbaugh discussed the social interaction between some of the wealthiest Chicagoans and some of the poorest Chicagoans. While the two groups certainly knew about each other through walking in or passing through neighborhoods or reading news in the newspaper, there was little direct social interaction. For example, some of the wealthy socialite women tried to start aid groups to help these nearby poor neighborhoods but could not get much participation from the poor neighborhoods.

Today, some of these barriers are reduced because of Facebook and other technology. Again, there is likely not a whole of physical social interaction between those with a lot of money and those without. In Hong Kong, you can walk down Nathan Road in Kowloon and find the some of the world’s most exclusive brands. If you turn off the road several blocks to the west, you are among nondescript apartment complexes with little glitter or glamour. Yet, these new technologies allow for more awareness and more reactions which could then coalesce around social action. The socialite wedding announcement in the prestigious newspaper 50 years ago that would have drawn less attention has now turned into Facebook-announced weddings that can quickly become very public.

Three changes that come with “The Rise of Poll Quants”

Nate Silver isn’t the only one making election predictions based on poll data; there are now a number of “poll quants” who are using similar techniques.

So what exactly do these guys do? Basically, they take polls, aggregate the results, and make predictions. They each do it somewhat differently. Silver factors in state polls and national polls, along with other indicators, like monthly job numbers. Wang focuses on state polls exclusively. Linzer’s model looks at historical factors several months before the election but, as voting draws nearer, weights polls more heavily.

At the heart of all their models, though, are the state polls. That makes sense because, thanks to the Electoral College system, it’s the state outcomes that matter. It’s possible to win the national vote and still end up as the head of a cable-television channel rather than the leader of the free world. But also, as Wang explains, it’s easier for pollsters to find representative samples in a particular state. Figuring out which way Arizona or even Florida might go isn’t as tough as sizing up a country as big and diverse as the United States.”The race is so close that, at a national level, it’s easy to make a small error and be a little off,” Wang says. “So it’s easier to call states. They give us a sharper, more accurate picture.”

But the forecasters don’t just look at one state poll. While most news organizations trot out the latest, freshest poll and discuss it in isolation, these guys plug it into their models. One poll might be an outlier; a whole bunch of polls are likely to get closer to the truth. Or so the idea goes. Wang uses all the state polls, but gives more weight to those that survey likely voters, as opposed to those who are just registered to vote. Silver has his own special sauce that he doesn’t entirely divulge.

Both Wang and Linzer find it annoying that individual polls are hyped to make it seem as if the race is closer than it is, or to create the illusion that Romney and Obama are trading the lead from day to day. They’re not. According to the state polls, when taken together, the race has been fairly stable for weeks, and Obama has remained well ahead and, going into Election Day, is a strong favorite. “The best information comes from combining all the polls together,” says Linzer, who projects that Obama will get 326 electoral votes, well over the 270 required to win. “I want to give readers the right information, even if it’s more boring.”

While it may not seem likely, poll aggregation is a threat to the supremacy of the punditocracy. In the past week, you could sense that some high-profile media types were being made slightly uncomfortable by the bespectacled quants, with their confusing mathematical models and zippy computer programs. The New York Times columnist David Brooks said pollsters who offered projections were citizens of “sillyland.”

Three things strike me from reading these “poll quants” leading up to the election:

1. This is what is possible when data is widely available: these pundits use different methods for their models but it wouldn’t be possible without accessible data, consistent and regular polling (at the state and national level), and relatively easy to use statistical programs. In other words, could this scenario have taken place even 20 years ago?

2. It will be fascinating to watch how the media deals with these predictive models. Can they incorporate these predictions into their typical entertainment presentation? Will we have a new kind of pundit in the next few years? The article still noted the need for these quantitative pundits to have personality and style so it their results are not too dry for the larger public. Could we end up in a world where CNN has the exclusive rights to Silver’s model, Fox News has rights to another model, and so on?

3. All of this conversation about statistics, predictions, and modeling has the potential to really show where the American public and elite stands in terms of statistical knowledge. Can people understand the basics of these models? Do they simply blindly trust the models because they are “scientific proof” or do they automatically reject them because all numbers can be manipulated? Do some pundits know just enough to be dangerous and ask endless numbers of questions about the assumptions of different models? There is a lot of potential here to push quantitative literacy as a key part of living in the 21st century world. And it is only going to get more statistical as more organizations collect more data and new research and prediction opportunities arise.

Sociologist defends statistical predictions for elections and other important information

Political polling has come under a lot of recent fire but a sociologist defends these predictions and reminds us that we rely on many such predictions:

We rely on statistical models for many decisions every single day, including, crucially: weather, medicine, and pretty much any complex system in which there’s an element of uncertainty to the outcome. In fact, these are the same methods by which scientists could tell Hurricane Sandy was about to hit the United States many days in advance…

This isn’t wizardry, this is the sound science of complex systems. Uncertainty is an integral part of it. But that uncertainty shouldn’t suggest that we don’t know anything, that we’re completely in the dark, that everything’s a toss-up.

Polls tell you the likely outcome with some uncertainty and some sources of (both known and unknown) error. Statistical models take a bunch of factors and run lots of simulations of elections by varying those outcomes according to what we know (such as other polls, structural factors like the economy, what we know about turnout, demographics, etc.) and what we can reasonably infer about the range of uncertainty (given historical precedents and our logical models). These models then produce probability distributions…

Refusing to run statistical models simply because they produce probability distributions rather than absolute certainty is irresponsible. For many important issues (climate change!), statistical models are all we have and all we can have. We still need to take them seriously and act on them (well, if you care about life on Earth as we know it, blah, blah, blah).

A key point here: statistical models have uncertainty (we are making inferences about larger populations or systems from samples that we can collect) but that doesn’t necessarily mean they are flawed.

A second key point: because of what I stated above, we should expect that some statistical predictions will be wrong. But this is how science works: you tweak models, take in more information, perhaps change your data collection, perhaps use different methods of analysis, and hope to get better. While it may not be exciting, confirming what we don’t know does help us get to an outcome.

I’ve become more convinced in recent years that one of the reasons polls are not used effectively in reporting is that many in the media don’t know exactly how they work. Journalists need to be trained in how to read, interpret, and report on data. This could also be a time issue; how much time to those in the media have to pore over the details of research findings or do they simply have to scan for new findings? Scientists can pump out study after study but part of the dissemination of this information to the public requires a media who understands how scientific research and the scientific process work. This includes understanding how models are consistently refined, collecting the right data to answer the questions we want to answer, and looking at the accumulated scientific research rather than just grabbing the latest attention-getting finding.

An alternative to this idea about media statistical illiteracy is presented in the article: perhaps the media perhaps knows how polls work but likes a political horse race. This may also be true but there is a lot of reporting on statistics on data outside of political elections that also needs work.

Obligatory sociological reminder that there is little evidence of Halloween candy tampering

Every Halloween, sociologist Joel Best reminds people that there is little  evidence of Halloween candy tampering:

For decades, parents have been warned to check sweet-wrappers for signs of tampering, chocolate bars for hidden needles, and apples for surreptitiously inserted razor blades when their children return home from knocking on strangers’ doors. But Dr Joel Best, a sociologist and criminologist at the University of Delaware, has researched every reported case of so-called “Halloween sadism” in the past 45 years, and has concluded that not one of them was genuine…

Dr Best has discovered 90 cases of alleged poisoning reported by newspapers or hospitals since 1958 but he says that none can be attributed to random attempts to harm kids. Most are pranks by children seeking attention; some are murkier attempts by parents to gain compensation…

The myth picked up speed in the late 1960s, as the popularity of Halloween also increased. At the time, many Americans apparently believed that hippies might get a kick from adding LSD to the sweets of unsuspecting children.

The phenomenon peaked in 1970 and 1971, when there were 10 and 14 reported incidents respectively. There was another mini-peak in 1982, when 12 alleged cases occurred. None have ever been confirmed, but the myth of “Halloween Sadism” nonetheless endures. Over the years, America’s National Association of Confectioners, for whom 31 October is crucial, have attempted to persuade the nation that trick-or-treating is safe. But Dr Best’s research, which has informed a book called Threatened Children, leads him to believe they face an uphill struggle.

Some urban legends live on. Here is what might contribute to the longevity of this particular story:

1. Journalists who are looking for such stories. If most of these cases did not pan out, did these same media outlets report this or issue a correction or retraction? Even if they did, the harm was likely already done.

2. Parents who are generally scared for their children in lots of areas, not just candy received on Halloween.

3. Are there any movies, books, or TV shows that have perpetuated this storyline? I can’t think of any but I wouldn’t be surprised if such works exist.

4. It seems like it could be plausible, perhaps even more so than cases like the unsolved 1982 Tylenol cases in Chicago (see a recent oral history here).

5. The holiday of Halloween lends itself to such stories. It is hard to imagine similar stories emerging out of Easter or Christmas, both holidays that involve candy and gifts that could be tampered with.

Young children should avoid secondhand TV watching but what about adult secondhand media consumption?

A new study in Pediatrics suggests there are detrimental effects to young children from secondhand TV:

The study, which appears in the November issue of the journal Pediatrics, finds that a child between the ages of 8 months and 8 years takes in nearly four hours of this “secondhand TV” which could have consequences on his or her well-being.

“Too much television can stop children from learning how to entertain themselves,” said Rutgers University Sociology Professor Deborah Carr. “And if they get used to having that background noise all the time, it’s very distracting. It’s distracting when they’re working on their homework, it keeps them from sleeping and stops them from engaging in conversation and and doing other things, like playing outside. The children, and the parents for that matter, can never invest 100 percent in what they’re supposed to be doing if the television is on in the background all the time.”

According to the study, background TV was especially common in certain populations. Children under the age of 2, African-American children, youngsters living in poverty and kids will less-educated parents had the highest levels of exposure, up to five hours a day. Meanwhile, exposure ranged from two and a half to three hours per day among white children and those from more affluent families.

Aside from the obvious distraction television can create for children, there are other consequences of too much “secondhand TV.” “If the television is constantly on in the background, children may absorb lessons that are not age appropriate,” said Carr. “Also, another issue is if you watch a half-hour of television, ten minutes of that time is going to be advertisements. Those advertisements are usually for unhealthy foods or toys that parents can’t afford or things of that nature. So, I think another problem is not just the programming, but this exposure 24/7 to advertisements.”

I suspect a lot of people today consume “secondhand” media. For example, here are some 2010 figures from the Kaiser Family Foundation:

With technology allowing nearly 24-hour media access as children and teens go about their daily lives, the amount of time young people spend with entertainment media has risen dramatically, especially among minority youth, according to a study released today by the Kaiser Family Foundation.  Today, 8-18 year-olds devote an average of 7 hours and 38 minutes (7:38) to using entertainment media across a typical day (more than 53 hours a week).  And because they spend so much of that time ‘media multitasking’ (using more than one medium at a time), they actually manage to pack a total of 10 hours and 45 minutes (10:45) worth of media content into those 7½ hours.

The amount of time spent with media increased by an hour and seventeen minutes a day over the past five years, from 6:21 in 2004 to 7:38 today.  And because of media multitasking, the total amount of media content consumed during that period has increased from 8:33 in 2004 to 10:45 today.

Is multitasking that different from secondhand exposure? Recommendations in a reputable journal like this notwithstanding, this sort of media usage is becoming more normal for lots of ages. For those beyond young childhood, if such exposure doesn’t lead to more distraction, at the least, being bombarded with advertisements is a potential issue.

Just wait till we all get our Google glasses and then see how much media we can consume…

The annual conference sessions ASA wants the press to know about

The American Sociological Association has a new press release telling the press they can register for the August meetings in Denver. The press release includes a list of sessions, presumably sessions ASA thinks journalists might be interested in. Here are the session highlights:

• Creating Workplace Gender Equality

• Global Warming and the Prospects for Real Utopias

• Real Utopian Visions of Health Care

• Is Marriage Part of a Utopian Future?

• Building a Better K-12 Education System

• Assessing the Impact of Social Networking and Mobile Internet Access

• Contemporary LGBT Sexualities and Social Justice

• Obstacles to Utopia: Race, Gender, Class, and Election 2012

• Islamic Utopias

While a number of these sessions are tied to the Utopian theme of the conference, these sessions appear to promoting another message: “Hey media types, we sociologists study and discuss relevant and hip topics!” This is not necessarily a bad idea; earlier this year, there was a newspaper back and forth in Britain about whether sociologists were really tackling the economic crisis. More broadly, sociologists don’t have the same kind of public clout as economists or psychologists so it makes sense to try to promote the field and its research.

Civilization II a good “sociological simulator”? I say no

I was amused earlier this week to see a report from a guy who has been playing the same game of Civilization II for ten years. Here is a little bit of his report on the state of the Civ II world:

  • The world is a hellish nightmare of suffering and devastation.
  • There are 3 remaining super nations in the year 3991 A.D, each competing for the scant resources left on the planet after dozens of nuclear wars have rendered vast swaths of the world uninhabitable wastelands.

While I loved playing Civ II (and I think the gameplay was superior to later versions of the game), I’m scratching my head at how much attention this report has received in the media. Does it really tell us anything about the world’s possible future? Here is one overview from the BBC that I think goes too far:

A man who has been playing the computer game Civilisation II for ten years describes the year 3991 AD as a hellish nightmare of suffering and devastation.

Daniel Knowles, from the Telegraph and a fan of the game, says the game has certain assumptions built in to it about what will happen if there is a nuclear war or if you stop producing green technology.

“It’s a kind of sociological simulator… a giant economical model” he told the Today programme.

He believes gamer James Moore “would not still be playing it if he had reached an Utopia”.

Civilization II is a “sociological simulator”? I doubt it. Granted, the game is intended to replicate real-world nation-building and interaction. As you build your society, you have to make decisions like what kind of government to have (for example, in latter stages of the game fundamentalism is quite effective when waging all-out war), what to build and produce in individual cities, how to move certain units (military and otherwise) around, and pursue scientific and technological advancements. But, all of these types of games (and I’ve also been a fan in recent years of Age of Empires III) are only as good as what they account for. In other words, this is a low-level simulator of anything. The real world is far more complicated and many more moving pieces that games like this can allow. Indeed, these sorts of games seem geared toward all-out war between nations even as some would argue the international scene is getting more peaceful.

We are still far from a true “sociological simulator” that could account for all of the human variability in real life. This hasn’t stopped some scientists from trying – there was news recently of a group trying to put together a “Living Earth Simulator.” But, we need to remember what Civ II really is: it is a fun game with some modeling of human behavior but it really tells us very little or nothing about what the world might look like in 3991 AD.