If dismissing research based on the research methodology, discuss what methods would have been better

An easy way to dismiss a study is to criticize the research methodology. The burden is often on the researcher(s) to explain how their methodology effectively addresses their research question or their hypotheses.

Photo by lil artsy on Pexels.com

Is there any burden on the person delivering the critique of methods to discuss what methodology might be better? Adopting this practice could serve multiple purposes. It could highlight what methods the critic prefers and for what reasons. It could help move research agendas forward as researchers consider different approaches. It also raises the bar for critique; it is easy to say a methodology does not work but it requires more effort to suggest what methodology is more effective.

Here are at least a few factors to consider when proposing other research methods in response to completed research:

-Researchers differ on what research methods they like to use and what research methods they feel should be used. Approaches can differ across individuals, subfields, and disciplines.

-Approaching a research question using multiple methods can be helpful for answering the question. Often, a single methodological approach cannot address all the complexity we wish to uncover.

-Researchers are constrained by time and money. There are ideal plans researchers want to pursue and then there is what is possible.

Pitching an alternative methodological approach in addition to questioning the methods employed could lead to more helpful outcomes.

The two reasons I try to work far ahead of deadlines

I recently completed a draft of a research paper a day and a half of a deadline. I had worked on launching this paper for months and it felt good to complete it. After I met the deadline, I thought again about the process: why do I regularly work ahead of deadlines? Here are two reasons:

  1. I have more time to think. If I can start writing earlier, the writing process helps me think. Just having to write means I think about what I am saying and then having words down also pushes me to think about how the argument will continue or resolve. The time it takes to think through and develop academic arguments is underrated as I find it difficult to come up with a nicely framed argument in one sitting or at a particular moment. Even when I think I have the writing complete or have completed a section, working ahead of a deadline means I then have time to let it sit and I can consider it more clearly.
  2. You never know what might come up day to day to prevent writing, thinking, and making progress toward the deadline. This can range from things that limit thinking – a new issue that arises – to changes in the calendar or daily schedule – a person to care for, a new meeting – to who knows what. As a deadline approaches, it is hard to know what might arise, even if I have clearly blocked out time to work on a project. If I work further ahead, I can accept these changes and work around them more easily.

Would this approach work for everyone? No. It might not even have worked for me earlier as a student or as a sociologist where I had greater capacity to sit down and write a lot in one long sitting and had fewer interruptions or impediments to such sessions. Deadlines can be helpful motivators, even if some work ahead of them and others work on projects more closely to their due dates.

Robot vacuum as mapper and research tool for homes

The Roomba may also be a cartography tool to map homes:

Photo by Kindel Media on Pexels.com

The company announced a $1.7 billion deal on Friday for iRobot Corp., the maker of the Roomba vacuum cleaner. And yes, Amazon will make money from selling those gadgets. But the real value resides in those robots’ ability to map your house. As ever with Amazon, it’s all about the data

The Bedford, Mass.-based company’s most recent products include a technology it calls Smart Maps, though customers can opt out of sharing the data. Amazon said in a statement that protecting customer data is “incredibly important.”

Slightly more terrifying, the maps also represent a wealth of data for marketers. The size of your house is a pretty good proxy for your wealth. A floor covered in toys means you likely have kids. A household without much furniture is a household to which you can try to sell more furniture. This is all useful intel for a company such as Amazon which, you may have noticed, is in the business of selling stuff…

Amazon would not be alone in wanting to map your home. Apple Inc. also unveiled a tool in June for the next release of iOS, its mobile operating system, that uses the laser scanner on the latest iPhones to build 3-D models that it’s dubbed “RoomPlan”.

While I can imagine the commercial potential of this mapping (beyond retailers, this can be very useful for real estate businesses as well), I am also interested in the research potential. Such mapping could reveal how residents use space, floor plans, and people and pets moving through areas. Rather than relying on people’s reports on their interior activity or direct observations of this, the Roomba can be the research “eyes.” Equip it with a camera, microphone, and other sensors and it could collect all sorts of information (all agreed to by the research participants, of course). A vacuum and research device, all in one.

The academic rabbit trails to watching a particular TV show for fun/analysis

In a recent trip to the campus library, I checked out the first season of a television show. I briefly interacted with the checkout clerk who remarked that I was in for a good viewing experience. My path to this show was not a straightforward one; rather, it involved reading, my own research, and a lot of time. Here is the path to this one TV show:

Photo by Jean van der Meulen on Pexels.com
  1. I develop an interest in the sociology of culture as an undergraduate studying both sociology and anthropology. The study of the “processes of meaning-making” becomes one of my primary graduate school interests and I continue to work within this subfield today. In my daily life, any cultural product or expression can then be both experienced and analyzed. This can be applied both to cultural activity as well as places, connected to my interest in suburbs and cities.
  2. Even as I continue with the sociology of culture, I also run into media studies, a field that combines insights from multiple fields and tackles all sorts of media. I teach a class titled “Culture, Media, and Society” where we consider multiple media and cultural forms including documentaries, films, television, comics, theater, music, art, news coverage, social media, and other phenomena. In conducting research on social media (several studies here, here, and here), I also encounter media studies research and journals.
  3. Several years later, I combine an interest in places and media by publishing two studies: one considers television shows set in suburbs and one examines the role of McMansion on The Sopranos. These works straddle the lines between sociology and media studies.
  4. In the summer of 2021, I read the book Divine Programming by television studies scholar Charlotte Howell. I watch one television shows Howell points out treats religion seriously (see posts here and here).
  5. With a little more flexibility in my schedule as we reach the holidays and approach the end of the semester, I decide to watch a second show featured in Howell’s book to continue to explore and enjoy how religion is depicted in television.

There are certainly other ways to come to a television show, including receiving recommendations from friends and family, reading a review, browsing or receiving a recommendation on a streaming service, and more. My path is probably not a typical one. But, I am also reminded of the ways that knowledge and studies develop as an academic: there is not necessarily a linear path toward a predetermined goal and a guaranteed outcome plus there can be a lot of time involved as ideas and projects wax and wane.

Why I would choose to read a 700+ page book versus an 11 page summary on an important historical period

I recently read two histories of a similar time period and both texts addressed the North American aspects of the Seven Years’ War. However, the texts had very different lengths. One book was over 700 pages and included many details. The other book included a summary of the same war in 11 pages. Which was the better read?

Photo by Polina Zimmerman on Pexels.com

Much of this answer depends on what I hoped to accomplish in my reading. Months ago, I had stumbled onto the Wikipedia page for the Seven Years’ War and realized I knew relatively little about it. The North American branch of this conflict involved relatively few troops yet had very important implications for the subsequent history of the United States. I searched out some recommendations on notable academic histories that addressed this period and received a few books from my library. I wanted to know more and now I had options.

I enjoyed reading the 700+ page book. Did I need all the details in my life? Probably not, but much of what I read was fascinating and provided insights that shorter summaries could not. I am glad that I read all of this so that at least at one point in life I could say I tried to take in all of this knowledge.

The 11 page summary was also interesting and well-written. It also took much less time. I recognized the high points of the conflict from the much longer narrative. These high points made a lot more sense given all the details I had read not too long before.

In the academic world, we run into these sorts of issues all the time: how much knowledge do I need to proceed? Would a one page summary be sufficient or should I devote years to studying this? We publish different length materials, ranging from encyclopedia entries and shorter notes to longer articles and books. One cannot read and study everything so we must be judicious in what we spend our time on. Yet, the joys of diving deeply into material is one of the best parts of study and research.

Having read both texts, I am still in favor of reading the much longer text. I may go years before reading anything on the Seven Years’ War and the longer text gave me plenty to consider. I had the time to spend on it and I may not make the same decision regarding another subject area given different circumstances. But, for two weeks this summer, reading a lot about the Seven Years’ War was a good decision.

The rush and consternation in finalizing a manuscript for submission

I have gone through this process many times…and it still is not much fun. Here is what submitting a paper to an academic journal can look like:

  1. Come to the point when you feel that you have said all that there is to be said and in a satisfactory way. Perhaps this comes in response to feedback from a previous submission or from your own thinking and conversations. This may have been a quick turnaround or a lengthy period of contemplation and rewriting. Time to find the submission page for a journal.
  2. Go through the author’s guidelines for that particular journal. Even with commonly-used bibliographic formats and some consistency of how papers are put together, there might be changes or small details to attend to. Formatting ensues.
  3. Time to submit the paper. Go through a process that looks similar across journals but might ask for slightly different information or in a different order. Get the details right and look over key parts of the paper again including the abstract and keywords. Approve your submission.

Time to sit back and wait. Will it make it past the editors? Linger in peer reviews? Come back with mixed reviews, get a revise and resubmit, or be accepted? In some ways, the publication process is just underway.

I understand why the process is what it is: each journal has its own approach as does each publisher. The publishing system is meant to provide peer review for academic work, helping to insure good research is published. Even going through the final steps for submission as outlined above can help crystallize arguments and writing.

But, simplifying the process, even within publishers or within disciplines, could help researchers feel better about their submissions. Some of this cannot be changed; it is still a vulnerable point to send off a manuscript into the great unknown and to reviewers who may or may not like what is there. Some of it can be changed: the basic details are usually the same even across venues.

When I see “study” in a news story, I (wrongly) assume it is a peer-reviewed analysis

In the last week, I have run into two potentially interesting news stories that cite studies. Yet, when I looked into what kind of studies these were, they were not what I expected.

Photo by Pixabay on Pexels.com

First, the Chicago Tribune online headline: “Why are Chicagoans moving away during the pandemic? As study suggests outbound migration is spiking, we asked them.” The opening to the story:

Chicago’s population has been on the decline for years, with the metropolitan area suffering some of the greatest losses of any major U.S. city. But new research suggests that the pandemic might be exacerbating the exodus.

For the first time in four years, moving concierge app Updater has helped more people move out of Chicago than to it, the company said. The catch-all moving service estimates that it takes part in one-third of all U.S. moves, providing unique, real-time insight into pandemic-driven trends, said Jenna Weinerman, Updater’s vice president of marketing.

“All these macro conditions — job insecurity, remote work, people wanting to gain more space — are coming together to create these patterns,” Weinerman said.

The Chicago figures are based on approximately 39,000 moves within city limits from March 1 to Sept. 30. Compared to 2019, this year saw more moving activity in general, with an 8% jump in moves into the city — but a 19% increase in the number of people leaving.

The second article involved a study at Cafe Storage and the headline “Average Home Size in the US: New Homes Bigger than 10 Years Ago but Apartments Trail Behind” (also cited in the Chicago Tribune) From the story:

According to the latest available US Census data, the average size of single family homes built in the US was trending upwards from 2010 until 2017, when sizes hit a peak of 2,643 square feet. Since then, single family homes began decreasing in size, with homes built in 2019 averaging 2,611 square feet…

Location matters when it comes to average home size. Some urban hotspots follow the national trend, while others move in the opposite direction. Here’s how single family home and apartment sizes look in the country’s top 20 largest cities, based on Yardi Matrix, Property Shark and Point2Homes data.

As an academic, here is what I expect when I hear the word study:

  1. Peer-reviewed work published in an academic outlet.
  2. Rigorous methodology and trusted data sources.

These steps do not guarantee research free from error but it does impose standards and steps intended to reduce errors.

In both cases, this analysis does not meet those standards. Instead, they utilize more proprietary data and serve the companies or websites publicizing the findings. This does not necessarily mean the findings are untrue. It does, however, make it much more difficult for journalists or the public to know how the study was conducted, what the findings are, and what it all means.

Use of the term study is related to a larger phenomena: many organizations, businesses, and individuals have potentially interesting data to contribute to public discussions and policy making. For example, without official data about the number of people moving out of cities, we are left searching for other data sources. How reliable are they? What data is anecdotal and what can be trusted? Why don’t academics and journalists find better data?

If we use the word “study” to refer to any data analysis, we risk making it even harder for people to discern what is a trustworthy study and what is not. Call it an analysis, call it a set of findings. Make clear who conducted the research, how the analysis was conducted, and with what data. (These three steps would be good for any coverage of an academic study.) Help readers and interested parties put the findings in the context of other findings and ongoing conversations. Just do not suggest that this is a study in the same way that other analyses are studies.

The Twitter world versus the world of academic research

A recent conversation about Twitter and my own acknowledgement of my lack of Twitter participation pushed me to think about the differences between Twitter conversations and academic research. These rough thoughts may be obvious to many but I think they are helpful to enumerate as we think about good information and data.

apple applications apps cell phone

Photo by Tracy Le Blanc on Pexels.com

1. The speed of Twitter, and social media, is quite fast. An opinion expressed or a “story” (link/video/article/”text”) can generate a lot of feedback but the process usually happens over just a few days. In contrast, academic studies routinely take years as researchers develop good questions, collect and analysis data/evidence/”texts”, and respond to hypotheses, theories, and existing conversations while also thinking about the implications of their findings and then go through the publication process. Academic work can sometimes go quicker but that length also theoretically allows time for more reflection.

2. Posts on Twitter are limited to a certain number of characters through tweet threads or good conversation following a post can effectively convey a longer argument or set of information. Academic studies also have space restrictions – while there are indeed examples of very lengthy books or articles, journals tend to have proscribed word count or page limits depending on their audience and the format of papers – but there is more space to make and develop an argument.

3. Twitter offers more immediate feedback, possibly much more, compared to academic works. When students ask me how many people read academic studies, it is hard to know: we have citation counts (which suggest at least those citing the work read it or are familiar with it) and journal websites now often offer the ability to see how many times an article has been viewed. But, how to count students who read pieces for class or projects, researchers who access material through databases and repositories, and other means of accessing academic work? However, I would assume the viral posts of Twitter gain more readers in a shorter amount of time than almost all academic works.

4. Those with Twitter accounts can post or access tweets. Those who publish in the academic world are a small subset of the population generally with advanced degrees and specialized knowledge. Yet, the percent of the American population who engage regularly on Twitter is low.

5. Tweets are validated or not by likes, retweets, and comments made by other users. Academics have more formal processes to vet work including peer review and presentations at conferences, lectures, and colloquia plus responses from audience members. A published academic work likely has had multiple eyes on it; tweets do not require this.

On the whole, academic research involves a longer, more formal process to get to publication and information available to other academics and the public. In contrast, Twitter offers speed, quick feedback, and is easier for both readers and posters to access. Thus, when the two worlds collide – academic posting about research or Twitter users engaging with academic work – it can seem as if two worlds with different processes and rules are trying to engage. The overlap can go successfully but it does not always; the advantages each system has do not necessarily complement what the other side does well. And the two systems may influence each other: the world of Twitter may prompt academics to speed up research and/or communicate their work differently while academics participating in Twitter may engage in deeper and longer conversations since much study involves nuance and complexity.

I do not spend much time on Twitter. It can be used effectively to quickly gather or share information. And if you follow engaging Twitter users in a particular subject area or field, there is much to be learned. I am grateful there are academics who can effectively use Twitter to engage audiences regarding their research and knowledge. But, the speed of the conversation can gloss over the depth of the issues at the heart of conversations or leave little room for the important context and background knowledge of phenomena.

(An aside: attempts to find a middle ground between such universes are worth thinking about. TED Talks seem to offer some compromises: an expert on the subject gets roughly 10-20 minutes to share out of their vast expertise. The videos are easy to follow and digest and they tend to come from people with advanced experience or education. The visual format has some appeal as opposed to text-based communication on Twitter and in academic writing. Podcasts could offer some similar benefits: there is more space for the storyteller to share but the audio cannot go on too long.)

Researching the downsizing claim: “every single person I interviewed who has made the transition says they are so happy they did”

A recent book looks at downsizing and the author says everyone who does it is pleased with the outcome:

“It scares people to think of moving into a smaller space, but every single person I interviewed who has made the transition says they are so happy they did,” Koones says. “Time and again, people used the word ‘liberated’ to describe their move to a smaller space, with homes requiring far less time and money to maintain.”

Who are the people downsizing?

“It’s not just empty nesters anymore,” she adds. “Younger people too are in couples where they’re both working, they’re having children later, they want to be active and they don’t want to be doing maintenance on the weekends. They don’t want to be tied down to mowing lawns and doing all the other chores that come with living in a big house.”

Living more sustainably and saving on energy costs is also part of the attraction of downsizing, Koones says.

So is aging in place. There are people of all ages looking for features like a master bedroom on the main floor, or barrier-free showers.

I would be interested to see academic studies of this shift as it could help answer some questions regarding downsizing and the choices people make regarding homes. Here are some of the questions:

1. How widespread is downsizing? My guess is that it is a pretty small movement. In a related question, how do individual decisions to downsize work at a broader level? These choices could influence families, neighborhoods, communities, builders, and others.

2. How much do the people who are downsizing share in common? There are multiple possible reasons for downsizing – economic reasons (including saving on energy costs), wanting less space to maintain, environmental imperatives, prizing location over a home – and it would be interesting to look at more prevalent factors. A similar question: what drives people to downsize (when Americans as a whole are pushed toward larger homes)? Or, is there a particular cultural ethos about downsizing that can be persuasive for some and not others?

3. What are satisfaction rates after downsizing? Are downsizers 100% satisfied or somewhat satisfied and what downsides do they report? Do they stay in smaller homes for the long-term?

4. How exactly should we define downsizing? It looks like this book primarily focuses on single-family homes. Others might see a move away from a single-family home and its property to an apartment, condo, or townhome as downsizing or accomplishing some of the same goals even if the difference in square feet is not that much. Is choosing to live in a multigenerational home a form of downsizing if households are combined and there is reduction of square feet per person? An involuntary move to a care facility might be technically downsizing but it does not carry the same agency.

Gendered McMansions, Part 4: figuring out the role of gender

Thus far, I have discussed how the size and architecture of McMansions, the large kitchen and living spaces, and the emphasis on raising children in the suburbs interacts with gender. How might researchers examine the gender dynamics of McMansions? A few ideas:

  1. How many McMansion owners are women and how many are men? (This could require a master list of McMansions in a location or across a broader geography.)
  2. When choosing a home and where to live, are men or women more likely to select a McMansion? Related: when asked to compare McMansions and their features to other kinds of homes, how do men and women compare in what traits they prefer? (A series of experiments with sets of choices could reveal differences.)
  3. Which gender spends more time in different parts of the McMansion? Studies have looked at use patterns in homes; why not break it down further by gender within McMansions? Are family rooms, basements, and garages used more by men and kitchens and nearby living spaces used more by women? Does a “man cave” truly exist or is it more of a luxury item? (Use observation or some kind of recording device to track movement in the home.)
  4. When people see McMansions (either driving/walking/biking by or on screen), who do they imagine lives there (men or women, in addition to a whole other sets of questions about race/ethnicity, social class, age, education, personal tastes, etc.)? Looking at the exterior (and maybe parts of the interior), what gender do they associate with the different aspects (and how does this compare to other homes)? (More experiments.)
  5. Do McMansions simply carry on the gender stereotypes of other single-family homes and suburban locations or they challenge some aspect of this developed and experienced knowledge about gender and homes? (Need comparative work between different styles of single-family homes.)

Perhaps all of this might be of best use to builders, developers, real estate agents, and marketers who could profit off this information. On the other hand, there are many Americans who live in McMansions (and who will do so in the future or have done so in the past). Have these homes, the hours spent in them, the ways the design, size, and connotations shaped social interactions had an impact on individuals, families, and communities as well as our understandings of gender?