Showing posts with label Mean data. Show all posts
Showing posts with label Mean data. Show all posts

Sunday, August 12, 2012

Anti-conservative bias and social psychology

My most popular blog post of all time was the one I did on conservative trust in the scientific community vs retraction rates.   I called it "Paranoia is just good sense if people really are out to get you" because I had a suspicion (confirmed when I ran the data) that conservatives might actually be behaving rationally when they said they trusted science less, given the ever increasing retraction rates in prominent journals.

Now, a new study shows that this distrust of the scientific community is even more well founded than I originally thought.

In a survey conducted by two self proclaimed liberals, it was found that there is heavy evidence that conservatives are being systematically discriminated against in the field of social psychology.  What unnerved the authors even more is that this was not a case where people were hiding their bias:

To some on the right, such findings are hardly surprising. But to the authors, who expected to find lopsided political leanings, but not bias, the results were not what they expected.
"The questions were pretty blatant. We didn't expect people would give those answers," said Yoel Inbar, a co-author, who is a visiting assistant professor at the Wharton School of the University of Pennsylvania, and an assistant professor of social psychology at Tilburg University, in the Netherlands.
He said that the findings should concern academics. Of the bias he and a co-author found, he said, "I don't think it's O.K."


The study isn't available yet, so I can't say I've read the nuances.  Still, it's hard for me to believe two liberal authors would have attempted to skew the results in this direction.  Conservatives have claimed this bias exists for years (look no further than the ethics complaint lodged against Mark Regnerus for proof), and will no doubt find nothing shocking about the results.  For liberals to have to face what this means however, that's something new.  Even in the comments on this article, the vitriol is surprising, with many saying that conservatives are so out of touch that it is an ethical responsibility to keep them out of fields like social psychology.

Yikes.

It is much to my chagrin that social science gets lumped in with harder science, but since findings in this field are so often reported in the media, it makes sense to take them in to account.  We have a vicious cycle here now where some fields are dominated by one party, who then do studies that slam the other party, then accuse that party of being anti-science when they don't agree with the results.  This is crazy.  The worst thing that can happen to any scientific research is too much consensus....especially when it involves moving targets like social psychology.  With 40% of the population identifying as conservative, how can we leave those perspectives out?  Everyone, liberal and conservative, should be troubled by these findings.  Those untroubled by this should take a good look at themselves and truly ask the question "what am I so afraid of?".

Monday, August 6, 2012

Growth charts and tiny babies


This is another post that reflects my current life situation, but it highlighted some pretty interesting issues with data tables.

This issue is particularly interesting to me because I delivered via unplanned/urgent c-section, in part because of some abnormal measurements found during a routine ultrasound.  We had to have quite a few follow up consults and testing (among other things, they actually had to assess for achondroplasia - better known as the major cause of dwarfism)*.

Given this, my mother thought I'd find this Wall Street Journal article on baby growth charts interesting.  Essentially, baby growth charts were set several decades ago based on a population that's different from what we have now.  The CDC does not want to readjust the charts, as it would make obesity look more normal than they think it should, and this is causing a situation where a high number of children are measuring "off the charts".

It's an interesting situation when you realize that 95th percentile doesn't actually mean "larger than 95% of children of the same age" but rather "larger than 95% of children the same age 40 years ago".

Additionally, it also points out that the CDC growth chart is based largely on formula fed babies, who grow slightly differently from breast fed babies.  So at the same time Mayor Bloomberg is pushing breastfeeding, doctors are potentially telling parents their children need formula to speed their growth up to match a chart that only tracks where they would be if they had done formula to begin with (this is why state mandated health policy drives me nuts so often....you solve one aspect while leaving several causes unadressed).

As the availability of testing goes up, we have to be particularly vigilant to make sure our standards charts keep up as well.  Otherwise we routinize unnecessary testing and freak out new parents.  And from personal experience, I can say that's just not nice.

*It was ruled unlikely, though apparently we can't get a definitive no until he actually starts growing, or not as the case may be.  There's no genetic history of it in my family or the husband's, though we are both on the short side.  In this case, us being short is actually a positive....it means the abnormalities are more likely natural variations.  Our genetic consult doctor was hilariously terrible though....she suggested if we wanted more information about the condition we watch the reality TV show about it (Little People Big World).  Then she said it was unlikely, but maybe we should still watch the show.  She ended it all with a comment about how it was never good when genetics doctors had too much to say, so we should be happy she wasn't talking too much.  I don't think she was very self aware.  

Thursday, May 31, 2012

Real World Bad Data: The Airlines

I hate flying.  I hate nearly everything about the entire experience really....getting to airports, the way they look, the lines, the fees, the TSA, the complete absence of food I'm not allergic to in most terminals, the boarding process, the plane itself, the proximity to other people, the feeling of being totally trapped, trying to get up and maneuver the aisles at all, and baggage claim.

Flying is terrible.

That being said, I was quite interested in reading this article that addressed why airline seats are so darn uncomfortable.  While they address the obvious issues such as increasing obesity and airline companies incentives to cram as many seats in as possible, I was struck by this quote:

In 1962, the U.S. government measured the width of the American backside in the seated position. It averaged 14 inches for men and 14.4 inches for women. Forty years later, an Air Force study directed by Robinette showed male and female butts had blown up on average to more than 15 inches.....But the American rear end isn't really the important statistic here, Robinette says.  Nor are the male hips, which the industry mistakenly used to determine seat width sometime around the 1960s, she says.
"It's the wrong dimension. The widest part of your body is your shoulders and arms. And that's much, much bigger than your hips. Several inches wider." Furthermore, she says, women actually have larger hip width on average than men.
So even back when the airlines might have made an attempt at having adequate seat size, they picked the wrong metric to play to, and everybody suffers.

I thought this was an interesting example of picking your data points.  Hip width makes intuitive sense to build a seat around, but it turns out it's wrong.

The article also has some good discussion of perception and how moving rows closer together can give you a sense the seat itself has gotten smaller.  Interesting real world applications of statistics.


Tuesday, May 15, 2012

The price of bad data

Yesterday Instapundit linked to a story on "the perfect data storm".

Thinking that sounded up my alley, I went and read the article.  It's from a professor named David Clemens at Monterey Peninsula College, complaining about the use of data in higher education:

While knowing full well data’s vulnerability, education managers cannot resist the temptation to be data driven because data absolves them of responsibility; to be data driven lets them say “the data made me do it” (hat tip to Flip Wilson).

That made me sad.  

He cited a few numbers floating around his campus that he knew were bad...transfer rates that only counted transfers to state schools for example....and yet they were still being included in policy decisions as though they were comprehensive.

That made me really sad.

While I enjoy mocking bad data, it's important to remember that there is a real price to it.  That's why I think it's important to empower people to question the data they're hearing and to know what weaknesses to look for when you hear numbers that sound implausible.  

Clemens continues:
....we discover that information does not touch any of the important problems of life. If there are children starving in Somalia, or any other place, it has nothing to do with inadequate information. If our oceans are polluted and the rain forests depleted, it has nothing to do with inadequate information. 
I am going to make a radical suggestion about data and higher education:  colleges and universities will be better served if they avoid kneeling at the altar of data and instead fill key positions with people driven by intuition, experience, values, conviction, and principle.  A good place to start would be looking for leadership guided by a transcendent educational narrative.


I both agree and take issue with this statement.  Data doesn't solve problems, but in a world of limited resources, data can guide us on where to put our efforts.  It's not that most of us don't agree children shouldn't starve in Somalia, it's that the "act first figure out if it works later" approach has the potential to cause as much harm as good.  That's why health care is data driven by necessity.....courts are notoriously unsympathetic to the excuse "I treated the patient this way because my transcendent narrative said it was a good idea".  Data is a good idea when you have an outcome you can't afford to take a chance with.

In the end, I don't think data is to blame for this backlash.  I am relatively sure that the same people who "kneel at the altar of data" to justify their own behavior are the same people who would, absent data, pursue their own gut feelings to the exclusion of rationality.  Intuition is very easily confused with emotion, experience can lead to falsely limiting possibilities, values can be misguided, conviction is dangerous in the wrong hands, and principle is easily warped.  No amount of data can change the way people are, but the more people who can spot the flaws in data and call BS, the better.

*Steps off soap box*

Trudge on friends, and don't let the weasels get you down.



Sunday, April 22, 2012

Bad data vs False Data

We here at Bad Data Bad would like to note that when we pick studies to criticize, we operate under the assumption that what the studies actually published are accurate, and that most of the mistakes are made in the interpretation or the translation of those findings in to news.

This article from the New York Times last week reminds us that this may not always be a good assumption.

A few fabricated papers have managed to make news headlines over the past few years....the Korean researcher who said he'd cloned a stem cell....the UConn researcher who falsified data in a series of papers on the health benefits of red wine....and a Dutch social scientist who faked entire experiments to get his data.

This is where the scientific principle of replication is supposed to step in, and why it's always a decent idea to withhold judgement until somebody else can find the same thing the first study did.  Without that, it's nearly impossible to know if someone falsified their data, without people in their own lab blowing the whistle.

If you're curious about these retractions, the Retraction Watch blog is a pretty good source for papers that get yanked.

Wednesday, April 11, 2012

There's bad data, and then there's data that's just plain mean....

I've worked at teaching hospitals for pretty much my whole post-college career, so I generally heave a bit of a sigh when I hear the initials "IRB".  IRB's (Institutional Review Board) are set up to protect patients and approve of research, but they also have power to reject proposed studies and cause lots of paperwork.  Sometimes though, you need a good reminder of why they were invented.

Apparently, some scientists in the 1940's tried to develop a pain scale based on burning people and rating the pain.  Then, to make sure they had a good control, they burned pregnant women while in between contractions.

While it actually wasn't a half bad way of figuring out what their numerical scale should look like, that is just WRONG.  As a pregnant women, I can pretty confidently say that anyone coming at me with a flat iron during labor will be kicked.  Hard.

Unethical gathering of data is not only not worth it, but also frequently wasted.  In the study mentioned above, the data proved useless, as pain is too subjective to be really quantified.  After this fiasco, it wouldn't be until 2010 that someone came up with a really workable pain scale.