Thursday, June 14, 2012

It's all (culturally) relative

Last week I put up a post regarding a study on sexism levels in men whose wives stay at home.  I argued that due to the diversity of that group of men, and the variety of reasons a woman might stay home, this study was essentially meaningless.

Another issue came up in the comments section that I wanted to touch on: cultural relevance of data.

Most studies that get press here in the US are from the US, performed on American subjects.  This is sketchy business.

In the study about stay at home moms, mothers who worked part time were lumped in with the stay at home mothers.  Interestingly, in the Netherlands, this would actually be 90% of the women.  Does that mean that nearly every Dutch man married to a woman is more likely to be sexist?  Or does it mean that part time work has different value in different cultures?

I took a look around for some other examples, and found that in China, many women see working as part of a new found freedom.  At a conference I attended a few months ago, I talked to a man from Shanghai who mentioned that his wife went back to work because she couldn't have handled trying to fight off the two grandmother's, both of whom wanted to watch the child.  Due to the one child policy, this was the only chance they would get to have a grandbaby.  In many ways, it was actually the hierarchical/patriarchal culture there that pushed his wife to go back to work, as opposed to having her stay home.  

As the world continues to flatten out, and as America continues to welcome new immigrants, we must be conscious of who studies are actually looking at and how generalizable the results are.  In the sexism study, even the authors admitted their findings were meant to be a commentary on the US only....but it should raise some questions that they seemed to be chasing after a structure that doesn't exist in some very liberal countries.

Something to consider, depending on the goal of the study.

Wednesday, June 13, 2012

How long do you study to become one of the cultural elite?

I took one class on assessment in my master's, and it gave me a whole new respect for teachers (or anyone who routinely prepares questionnaires for people).

Figuring out how to assess whatever topic you're assessing is really really hard.

That being said, I found this quiz particularly interesting.  It's called "Do You Live In a Bubble?", but it's target is particularly the "new upper class" and how much they do or do not understand about the lives of most Americans.

What he chose to assess is fairly interesting....people you know, where you've lived, smoking and drinking patterns, jobs you've had, knowledge of popular media, etc.  Lots of interesting issues to be taken with those categories, especially for those who clearly didn't get the score they were hoping for.  The comments are pretty amusing actually...I feel like one of the questions should have been "is it important to you that this quiz tell you that you are "of the people"?

The most interesting point here was actually the entire purpose of the quiz.  The author of the quiz answered a few follow up questions, but I thought this was the most telling one:


2. Do you feel that people scoring higher on the quiz are not culturally sequestered as well? 
Question from Reddit: HillbillyThinkTank[S]: "You're right that everyone lives in a bubble of some kind; the tendency to cluster with similarly situated people is not a behavior limited to the "elite." The way the quiz is structured, he is suggesting that a low-scoring person is culturally sequestered in a way that a high scoring person is not. I don't think I agree with that." 
Sure, they're sequestered. We all live in bubbles of one kind or another. The problem is an asymmetry. As I put it in the book, it isn't a problem if a truck driver doesn't understand the priorities of a Yale law professor, or news anchor, or cabinet secretary. It's a problem if the ignorance is the other way around, because the elites are busily affecting the lives of everyone else. When they haven't the slightest idea what the rhythms and feel of life are like in mainstream America, they tend to make mistakes.
I thought this was an interesting case of trying measure a very abstract concept through concrete questioning.  He includes an explanation of each question and why it was included.

Agree or not with his questions, it certainly succeeds at being provocative.

Also, in case you're curious, I scored a 56.


Tuesday, June 12, 2012

Monday, June 11, 2012

Researching New Family Structures...Cutting Through Politics with Facts

I've been reading Bad Science by Ben Goldacre, and I highly recommend it.

In it, he quotes an interesting study regarding how likely people are to pick apart studies that challenge their preconceived notions.  Unsurprisingly, people are far more likely to notice flaws in studies they don't agree with than those they do.  He then made a somewhat tongue in cheek suggestion that perhaps all papers should have to list the method section first, to make sure that it was assessed before you knew what the conclusion was.

That came to mind today when I was reading Mark Regnerus's explanation of his new research in to new family structures.

I was unsure what to think of this study just from the headline.  I've actually read some of Regnerus's research in the past and disliked it, so I wasn't sure what I'd think of his take on this issue.

I found the paper fascinating.

Part of his premise started from his observation that adoption presents a unique challenge for parents, as is well acknowledged by research.  Thus, it interested him that many studies on gay and lesbian parenting showed no differences between that and heterosexual couples.  That appealed to my data analysis side, it's certainly not an observation I would have put together right away.  The study was focused on the young adult (18 to 39) population, and thus the slightly longer term outcomes of products of these families.

What impressed me so much about this study was how many pains they took to correct methodological errors in previous studies.  With such a highly politically charged topic, it would have been easy for him to just shy away from this study.  While critics were quick to point out that his funding came from two conservative organizations, his conclusions are not necessarily conservative.  While he does find that the outcomes for children of gay parents have worse outcomes on most metrics*, he acknowledge the high level of broken homes from these parents as a huge contributing factor.  His population makes the study a bit retrospective, and he acknowledges these limitations.  From his Slate.com article:
Let me be clear: I’m not claiming that sexual orientation is at fault here, or that I know about kids who are presently being raised by gay or lesbian parents. Their parents may be forging more stable relationships in an era that is more accepting and supportive of gay and lesbian couples. But that is not the case among the previous generation, and thus social scientists, parents, and advocates would do well from here forward to avoid simply assuming the kids are all right.
 William Saletan (and others) have quickly responded with the idea that this study actually supports the need for gay marriage by proving that the broken homes of the past were damaging to children.  Clearly Regenrus does not rule that out in his study....he is quite clear that he knows the selected age group covers only those children born 1971 to 1994 (pre legal gay marriage), and he goes very in depth with the broken homes angle.....acknowledging that many of the broken homes were fractured hetero marriages that preceded the same gender relationships.

The value of a study like this however, is not merely in the conclusions.  The value is that it unsettles the debate, and hopefully precipitates a response from those who disagree with him.  In emotionally and politically charged fields, the response to data should be newer and better data that corrects the perceived problems in the last study.  Politics should not be a reason to consider something "settled", and we need researchers who are at least willing to entertain the other side, if only to give people something to respond to.

I know most people will not make up their mind on this issue because of a research study, but I don't think that's a reason to not do research. Whatever a person believes, I would hope this study could be read with unbiased eyes, methods first....just to see what you think.

*As I commented in this post metrics on child rearing can be hard to determine.  Some of the ones used in this study were: being unemployed, less healthy, more depressed, more likely to have cheated on a spouse or partner, smoke more pot, had trouble with the law, report more male and female sex partners, more sexual victimization, and were more likely to reflect negatively on their childhood family life.  The full list is in the paper here.

Saturday, June 9, 2012

Weekend moment of Zen 6-9-12

If you are a baseball fan who hasn't yet read Mark Lisanti's "Derek Jeter's Diary" over at Grantland yet, go now.  Enjoy.

Though I don't often do sports stats, "Jeter" has a few words about stats blogs:

I don't read those blogs, they're just negativity disguised as indisputable math...
That does about sum it up Derek.  I kind of want that stitched on a pillow.

He also has some words of wisdom on the limitations of statisticss:
The stats guys are always trying to tell you there's no such thing as clutch, that there's no special skill to it, it's all probabilities and math. Look: I also know that math exists. I've taken math classes, I've seen numbers be added and subtracted in front of my very eyes. Those symbols on the back of baseball cards mean something real.  
But you can't tell me that there's not some magic ability some players have that makes them rise to the occasion when it counts most. I've seen Alex Rodriguez fail in huge situations too many times not to believe what I have is special. 
Have a good weekend everyone!

Friday, June 8, 2012

Sexism and stay at home moms

I was just thinking I wanted to find a good marriage and family research paper to sink my teeth in to.

This one came across my inbox today, and I didn't have to get much further than the abstract before I knew it was going to be a doozy.  Read for yourself:
In this article, we examine a heretofore neglected pocket of resistance to the gender revolution in the workplace: married male employees who have stay-at-home wives. We develop and empirically test the theoretical argument suggesting that such organizational members, compared to male employees in modern marriages, are more likely to exhibit attitudes, beliefs, and behaviors that are harmful to women in the workplace.
*Bias Alert*
My mother was a stay at home mom.  Therefore my father would have qualified for this study, and it is hard for me to even read their hypothesis without remembering that.  I happen to credit my father with giving me my passion for statistics and data analysis, and he has never once discouraged me from doing anything I wanted to professionally (with the exception of when I mentioned law school....that he soundly discouraged as a waste of talent....and this was  15 years before anyone was talking about a law school bubble).  I will not go in to all the details of my parents marriage here, but I doubt you could find anyone who would call my parents marriage anything less than an equal partnership focused on doing what was best for the family.

As an extra level of bias, I will be continuing my (full-time) job post baby.
*End Alert*

I've noticed a disturbing trend in both the general population and academic research: people seem to get very hung up on conflating "stay at home mom" with "traditional marriage".  The study authors do this openly....they admit that they classify a marriage as "modern" based solely on whether or not the wife works full time.  The only criteria for "traditional" is that she doesn't work at all, and part time work is all classified as "neo-traditional".

To ignore the economic realities that drive families to make decisions about work seems to me to be an immense oversight.  I have met plenty of stay at home mothers who were in very equitable marriages, and I have met quite a few working mothers whose primary source of stress was their husbands continued expectation that they were still responsible for all child care/household duties.  I believe that using only one metric to rank a marriage as "traditional" or "modern" is a horrible over generalization....especially since most women with small children would prefer to work part time.  In fact (from the Pew study):

The public is skeptical about full-time working moms. Just 14% of men and 10% of women say that a full-time job is the “ideal” situation for a woman who has a young child. A plurality of the public (44%) say a part-time job is ideal for such a mother, while a sizable minority (38%) say the ideal situation is for her not to work outside the home at all.
So 90% of women don't think the "modern" setup is ideal when there are young children involved.  If one of these women than chooses to stay home with her kids, has her husband truly regressed from "modern" to "traditional"?

For both the economic reasons and the "women's choice" reasons, I reject studies that try to tie stay at home motherhood to anything else.  The sample is just too broad, and the reasons too varied.  It also undermines exactly how expensive child care can be....by my estimate, my mom would have had to bring home at least $4000 a month (in today's dollars)  to pay for child care for 4 children.  $4000 after tax is a pretty hefty before tax salary.

I don't argue that personal life can affect professional attitudes, and I would never advocate for sexism in the workplace.  In this study however, I really had to question the motives.  Is it really the best idea to fight gender stereotypes with stereotypes about very broad choices?  Is the point here that the workplace will only be fair when women participate as much as men?  Isn't it a bit sexist to totally disregard the role women play in the decision to work or not work?  Shouldn't we all just be able to do what's best for our families, no questions asked?