Author Archives: legallysociable

Social psychologist on quest to find researchers who falsify data

Posted on by

The latest Atlantic magazine includes a short piece about a social psychologist who is out to catch other researchers who falsify data. Here is part of the story:

Simonsohn initially targeted not flagrant dishonesty, but loose methodology. In a paper called “False-Positive Psychology,” published in the prestigious journal Psychological Science, he and two colleagues—Leif Nelson, a professor at the University of California at Berkeley, and Wharton’s Joseph Simmons—showed that psychologists could all but guarantee an interesting research finding if they were creative enough with their statistics and procedures.

The three social psychologists set up a test experiment, then played by current academic methodologies and widely permissible statistical rules. By going on what amounted to a fishing expedition (that is, by recording many, many variables but reporting only the results that came out to their liking); by failing to establish in advance the number of human subjects in an experiment; and by analyzing the data as they went, so they could end the experiment when the results suited them, they produced a howler of a result, a truly absurd finding. They then ran a series of computer simulations using other experimental data to show that these methods could increase the odds of a false-positive result—a statistical fluke, basically—to nearly two-thirds.

Just as Simonsohn was thinking about how to follow up on the paper, he came across an article that seemed too good to be true. In it, Lawrence Sanna, a professor who’d recently moved from the University of North Carolina to the University of Michigan, claimed to have found that people with a physically high vantage point—a concert stage instead of an orchestra pit—feel and act more “pro-socially.” (He measured sociability partly by, of all things, someone’s willingness to force fellow research subjects to consume painfully spicy hot sauce.) The size of the effect Sanna reported was “out-of-this-world strong, gravity strong—just super-strong,” Simonsohn told me over Chinese food (heavy on the hot sauce) at a restaurant around the corner from his office. As he read the paper, something else struck him, too: the data didn’t seem to vary as widely as you’d expect real-world results to. Imagine a study that calculated male height: if the average man were 5-foot?10, you wouldn’t expect that in every group of male subjects, the average man would always be precisely 5-foot-10. Yet this was exactly the sort of unlikely pattern Simonsohn detected in Sanna’s data…

Simonsohn stressed that there’s a world of difference between data techniques that generate false positives, and fraud, but he said some academic psychologists have, until recently, been dangerously indifferent to both. Outright fraud is probably rare. Data manipulation is undoubtedly more common—and surely extends to other subjects dependent on statistical study, including biomedicine. Worse, sloppy statistics are “like steroids in baseball”: Throughout the affected fields, researchers who are too intellectually honest to use these tricks will publish less, and may perish. Meanwhile, the less fastidious flourish.

The current research may just provide incentives for researchers to cut corners and end up with false results. Publishing is incredibly important for the career of an academic and there is little systematic oversight of a researcher’s data. I’ve written before about ways that data could be made more open but it would take some work to put these ideas into practice.

What I wouldn’t want to happen is have people read a story like this and conclude that fields like social psychology have nothing to offer because who knows how many of the studies might be flawed. I also wonder about the vigilante edge to this story – it makes a journalistic piece to tell about a social psychologist who is battling his own field but this isn’t how science should work. Simonsohn should be joined by others who should also be concerned by these potential issues. Of course, there may not be many incentives to pursue this work as it might invite criticism from inside and outside the discipline.

Multiplicity of Illinois governments just symptomatic of American government overall?

Posted on by

Whet Moser at the 312 Blog links Illinois’ long-standing issue of having lots of government bodies with how government works at the national level:

Yesterday I went on CNBC to talk with Rick Santelli about the unusually large number of governments (not just cities and counties and townships, but school districts and mosquito abatement districts and whatnot) the state of Illinois has. It’s a lot—more than any other state, including states with bigger populations and more square mileage. I wrote about this awhile ago; the BGA did a report last year; it’s been a political issue for awhile, one that both Kirk Dillard and Pat Quinn have floated…

It’s not big government; it’s kludge government. I loved this passage from Teles (emphasis mine):

Conservatives over the last few years have increasingly claimed that America is, in Hayek’s terms, on the road to serfdom. This is ridiculous, for it ascribes vastly greater coherence to American government than we have ever achieved. If anything, we have arrived at a form of government with no ideological justification whatsoever…

This comes from Suzanne Mettler’s “submerged state” thesis. It’s a kludge in action: keeping the political system functioning by burying the actual actions of government under a confusing web of laws. And the greater the number of laws, the more nooks and crannies for the “kludge industry” to embed itself: “having pulled the fundamental knowledge needed for government out of the state and into the private sector, thus becomes nearly indispensable.”

This argument could provide a way between the current debate about whether to have a big or limited federal government: let’s just make sure the system actually works rather than burying itself under a blizzard of rules and exceptions that few people can fully understand. Both small and big government can be run poorly or in less efficient ways.

This also provides good insight into the nature of complex social systems. When institutions become larger and larger (and don’t forget American government today is setting policy for over 300 million people), it is really hard to keep things simple. This reminds me of Max Weber’s warnings one hundred years ago about the threats of bureaucracy. While such systems might be the best way to deal with complex problems on a broad scale, they can become bloated and reified. Weber was pessimistic about the options but the fate of modern nation states like the United States might just depend on being able to cut through some of the complicated structures.

Look for a F(underpass) near you

Posted on by

A New York City pedestrian underpass is getting a makeover and a new name: F(underpass).

The news broke that the New York City Department of Small Business Services had awarded a $75,000 grant to the Atlantic Avenue BID to transform the dark, empty stretch of Atlantic Avenue beneath the Brooklyn-Queens Expressway into a funderpass. (Or, as it’s sometimes spelled, F(underpass).)

The details of the funderpass — a collaboration between the BID, Planning Corps, and the Design Trust for Public Space — are still being hashed out. It could include colorful artwork by Groundswell and a bicycle pump, and will bridge the space between the shops of Atlantic Avenue and the brand-new park space beyond.

These sorts of pedestrian underpasses are often dreary affairs: the lighting often isn’t very good, they can attract graffiti, and they may be noisy if the overhead noise is loud or consistent enough. This all is not very inviting to pedestrians. So including artwork and help for bicyclists might bring some vibrancy and perhaps even connect two spaces.

Here is what I wonder: once these improvements are made, how much work would it take to maintain it and who will do it? This could just be the details that need to be worked out but this is an important question as an improvement like this should be sustainable.

Thursday Night Football logo takes over Philadelphia skyline

Posted on by

While watching a bit of the match-up last night featuring the Cincinnati Bengals at the Philadelphia Eagles, I saw this image where the Thursday Night Football takes over the Philadelphia skyline:

Sports broadcasts have been using this technique for at least a few years now. I first noticed it on Fox NFL broadcasts. They will often put fake video boards at different points around the stadium and then show the Fox logo or advertisements on this fake board before panning back to the field and game action. The NBA on TNT also uses this quite a bit though I’ve noticed they tend to use the same settings when in certain cities. For example, when they do Bulls home games, the same location is used: the camera, probably mounted on a tall building, looks southeast from Wolf Point with the fake video board mounted on the first bridge, Lake Street, on the South Branch of the Chicago River. Imagine if the board in Chicago moved around a bit: there it is popping out of the trees in Grant Park. There it is on the top of the John Hancock building. There it is on Navy Pier blocking the view of the Ferris Wheel.

However, these examples feature fake video screens built on existing structures while this Thursday Night Football segue involved a giant logo attached to two buildings on the Philadelphia skyline. In my opinion, this stretches the idea a little too far. It doesn’t look very realistic and even among big buildings it looks disproportionately large. At the same time, perhaps it is meant to be commentary about the power of the NFL: it is so big that it dominates the skyline of a major American city!

Narratives of racial segregation in private and public schools in the South

Posted on by

A larger story about segregated schools in the South contains this bit about the competing narratives behind the more white private schools and the more non-white public schools:

According to one narrative, white leaders and residents starved the public schools of necessary resources after decamping for the academy, an institution perpetuated by racism. According to the opposing narrative, malfeasance and inept leadership contributed to the downfall of the public schools, whose continued failings keep the academy system alive.Hury Minniefield is a purveyor of the former narrative. He was one of the first black students to integrate the town’s public schools in 1967 through a voluntary — and extremely limited — desegregation program. He and his two younger brothers spent a single academic year at one of the town’s white schools. “Because the blacks were so few in number, we didn’t interfere with the white students too much and never did hear the ‘n word’ too much,” he said.

Despite his unique personal history, Minniefield does not believe the schools in Indianola will ever truly integrate. “It has not been achieved and it will likely never be achieved,” he said. “It’s because of the mental resistance of Caucasians against integrating with blacks. … Until the white race can see their former slaves as equals, it will not happen.”

Steve Rosenthal, the mayor, takes a different view. He argues that many white families have no problem sending their children to school with black students, but choose Indianola Academy because the public schools are inferior. His two children, both in their 20s, graduated from the academy, where he believes they received a strong education. “I would not have had a problem sending them to public schools had the quality been what I wanted,” he said, adding a few minutes later, “If there’s mistrust, it’s the black community toward the whites.”…

Students tend to offer the most nuanced perspective on why wholesale segregation endures. “It’s because of both races,” said Brown. “No one wants to break that boundary or cross that line. Both sides are afraid.”

And this is tied to larger concerns about segregation in schools throughout the country:

As the Atlantic reported last week, throughout the country, public schools are nearly as segregated as they were in the late 1960s when Indianola Academy opened. In many areas, they are rapidly resegregating as federal desegregation orders end. White families continue to flee schools following large influxes of poor or minority students. And in Indianola, as in the rest of the country, there’s stark disagreement as to why: Whites often cite concerns over school quality, while blacks are more likely to cite the persistence of racism.

As an urban sociologist, I can’t help but think that residential segregation plays into these issues across the country. Schools tend to draw kids from particular geographic areas and people are pushed into and also choose to live in particular places. Whites tend to want to live with other whites while other racial and ethnic groups have higher tolerances for mixed-race neighborhoods. One attempt to rectify this decades ago was busing students to different schools, something my current students tend to recognize best only when I mention the movie Remember the Titans.

But this may not explain all of the story. One way to segregated public schools is to have segregated neighborhoods. Another way is to simply opt out of the public school system. While the narrative about this decision involves a better educational opportunity or having children in a school with particular values, it is still tied to issues of race and social class.

Elgin-O’Hare highway project to take 12 years to complete

Posted on by

I saw the news that the Elgin-O’Hare highway extension just received the final approval from the federal government. But, one piece of information in the story stunned me:

The action, which was expected, allows the Illinois Tollway to proceed with the $3.6 billion project, which will take an estimated 12 years to complete.

Twelve years? Chicagoans are used to a lot of construction but this seems like a really long time. Here is a brief schedule according to the Elgin O’Hare West Bypass FAQ page:

Construction of the Elgin O’Hare West Bypass project could be initiated by the Illinois Tollway as soon as 2013, and would extend through 2025. While the staging plan will be refined as the Tollway advances project design, the general sequencing described in the Tollway’s Move Illinois Program includes: widening of the existing Elgin-O’Hare expressway and upgrading the I-90/Elmhurst interchange to full access, followed by the extension of the Elgin O’Hare Expressway. When the Elgin O’Hare construction is complete construction would begin on the south leg of the west bypass, with the final piece being the north leg of the west bypass. The phasing of the improvements is intended to provide the most benefit to the public as early as possible while complementing other Tollway improvements on adjacent facilities such as I-90 and I-294.

In fact, this might be the best argument I have heard for constructing highways earlier rather than latter. In addition to costs which continue to grow over time, it can often be quicker to build when there is less development.

NCAA Scholarly Colloquium: ideology versus “In God we trust; everyone else should bring data”

Posted on by

The Chronicle of Higher Education examines how much criticism of the NCAA will be allowed at its upcoming annual Scholarly Colloquium and includes a fascinating quote about how data should be used:

The colloquium was the brainchild of Myles Brand, a former NCAA president and philosopher who saw a need for more serious research on college sports. He and others believed that such an event could foster more open dialogue between the scholars who study sport issues and the people who work in the game.

Mr. Brand emphasized that the colloquium should be data-based and should avoid ideology. “Myles always used to joke: ‘In God we trust; everyone else should bring data,'” said Mr. Renfro, a former top adviser to Mr. Brand.

But as Mr. Renfro watched presentations at last year’s colloquium, which focused on changes the NCAA has made in its academic policies in recent years, he did not see a variety of perspectives.

“I was hearing virtually one voice being sung by a number of people … and it was relatively critical of the NCAA’s academic-reform effort,” he said. “I don’t care whether it was critical or not, but I care about whether there are different perspectives presented.”

This is a classic argument: data versus ideology, facts versus opinions. This short bit about Myles Brand makes it sound like Brand thought bringing more data to the table when discussing the NCAA would be a good thing. Data might blunt opinions and arguments and push people with an agenda to back up their arguments. It could lead to more constructive conversations. But, data is not completely divorced from ideology. Researchers choose what kind of topics to study. Data has to be collected in a good manner. Interpreting data is still an important skill; people can use data incorrectly. And it sounds like an issue here is that people might be able to use data to continue to criticize the NCAA – and this does not make the NCAA happy.

Generally, I’m in favor of bringing more data to the table when discussing issues. However, having data doesn’t necessarily solve problems. As I tell my statistics classes, I don’t want them to be people who blindly believe all data or statistics because it is data and I also don’t want them to be people who dismiss all data or statistics because they can be misused and twisted. It sounds like some of this still needs to be sorted out with the NCAA Scholarly Colloquium.

Younger American adults looking for “print-like” news on their tablets and mobile devices

Posted on by

Derek Thompson discusses new data from Pew that suggests young adult Americans are looking for “print-like” experiences when reading online news:

But a new report from the Pew Research Center (pdf) suggests that, when it comes to reading the news on mobile devices, young people aren’t so different. First, they use their tablets and smartphones to read the news at nearly identical rates to 30- and 40-somethings. According to Pew, between 30 and 50 percent of practically every demographic, except seniors, uses mobile phones and tablets to read news — whether it’s men or women, college-educated or not, making less than $30,000 per year or more than $75,000. All told: Thirtysomethings and fortysomethings are just as likely as teens and twentysomethings to use their smartphones and tablets for news…

Here’s another surprise. Young mobile readers don’t want apps and mobile browsers that look like the future. They want apps that look like the past: 58% of those under 50, and 60% of Millennials, prefer a “print-like experience” over tech features like audio, video, and complex graphics. That preference toward plain text “tends to hold up across age, gender and other groups.” Pew reports: “Those under 40 prefer the print-like experience to the same degree as those 40 and over.”

While this report suggests different age groups consume news in similar ways, even with differences in video watching and how much news they share, I wonder if they get the same things out of their reading. Are they reading different kinds of stories? On different websites? Are they reading the same volume of news stories? Physically reading the screen in the same way? Reading the news with the same purposes? Retaining the same information? Wanting to read “print-like” news with similar devices means something but I suspect there could still be some major differences between these groups.

Daily Herald discusses appropriate tablet use in school but misses bigger point: do new tablets help students learn more?

Posted on by

The Daily Herald had an editorial yesterday that argued tablets used by students at school and home need to be used appropriately:

Other districts also have committed to the devices’ use, though some taxpayers might see them as an extravagance. Educators get just as starry-eyed over new technology as the rest of us, and why shouldn’t they? Kids are growing up with lightning-fast change in the electronic tools we use every day. This is the world they know and will need to keep knowing, and schools are adapting.

But how they adapt is key. Without good policies and solid technology plan that includes training and evaluation, the tablet revolution — called “one-to-one” programs by educators — could amount to little more than handing kids high-tech notebooks at best or, worse, free video gaming.

Gurnee Elementary District 56, for one, is rolling out its iPad initiative for middle-schoolers this week and appears to be doing things right by involving parents in a checkout night with consent forms, user agreements, guidelines and a downloadable instruction manual. It cannot stop there, however, nor can administrators be certain those 46-page manuals will be read.

Perhaps the most important way to make these devices as cost-effective as possible is to ensure teachers on the front lines have the training to use them to their fullest and to focus the instruction on learning, not the device.

The rest of the article goes on to talk about the appropriate use of tablets but the key is here in the last sentence of the quote above. Do the tablets and iPads contribute to student learning? It is one thing to suggest students need to learn about new technology. This is helpful in itself, particularly for kids who may not have consistent access at home. And tablets may help students to be more engaged in the classroom. But, there is a bigger question that should be asked here: does using a tablet help students learn math or reading or science or social studies or other subjects better?

Comparing New York locations “Then and Now”

Posted on by

Photographer Evan Joseph has co-authored a book that compares New York City locations Then and Now.

The book, an update to an earlier edition, pairs old photos of New York City with current photos of the same location. While photos in the previous edition didn’t always match exactly the heights and camera angles of the originals, in this edition, Joseph went through a painstaking process of matching the angle of each old photo. He did so by loading each historical image onto his iPad, he explained to us last week, going to each street photographed, and looking around until he could lock down the location of at least one building in the old photo. “Then I would keep doing it…keep moving around and around until I could get that building into the same location.”

While Joseph had no desire to use 100-year-old photography equipment to replicate the old photos—and is, in fact, known in the photography community for carrying around a lot of modern equipment—he found that he did miss one aspect of “then” photography. “What I quickly figured out was that the elevated subway lines that ran all over New York…were amazing photographic vantage points that no longer exist. So many of them were taken from 25 feet off the ground,” he says. “That is just an amazing place to shoot a building. It gets you above the traffic, it gets you above people, but not so high up that it’s a rooftop view. It renders the target…in a very natural and flattering perspective.” Joseph was left to replicate that perspective as best he could with a monopod, “really like a window-washer’s stick that I attached a photo mount too. Then I rigged up some remote triggers so I could fire the camera from holding a stick 10 feet about my head.” (Joseph also used his connections to developers and real estate brokers to get some of his shots from within other buildings.)

The book also gave Joseph the opportunity to do a little aerial photography, with a helicopter shoot of lower Manhattan. The goal was to replicate a photo that was probably taken from an airplane c. 1935—the result is the then-now pairing above.

Aside from that photo of lower Manhattan, downtown is underrepresented in the book, Joseph says, because most of the century-old photos of New York were taken by commercial architectural photographers, and there wasn’t much call for them to take photos of residential buildings. Instead, the photos of residential areas are snapshots, incorporating streets more than buildings. Still, Joseph thinks there may be material there for a future edition of the book, and we look forward to it.

I’ve always been fascinated by this concept. Once buildings disappear, people tend to forget about them and, of course, new generations have difficulty picturing what was there before. What was once a common streetscape known to thousands (or potentially millions in big cities) simply disappears. Skylines can change quickly as well.

Photography projects like these can also help residents and others get a quick view of urban change. While certain changes get a lot of attention (like the Prentice Women’s Hospital in Chicago), smaller changes frequently take place and may not be noticed until a whole series of changes occur.

A few years ago, I remember seeing an aerial black and white photograph of Lake Shore Drive crossing the Chicago River. In this photo, Lake Shore Drive still had its famous S-curve (see here) and there weren’t many big buildings in the immediate area. This area has been transformed quite a bit throughout Chicago’s history: it was once a railroad and dock area along the Chicago River that in recent years has become a center for condominiums (like the Aqua building which attracted attention after opening in 2010) and office buildings after Lake Shore Drive being moved closer to the lake. I spent a lot of this with this photo and thinking how much had changed in just several decades.