Showing posts with label Good data. Show all posts
Showing posts with label Good data. Show all posts

Tuesday, July 31, 2012

New data point

Today I would like to announce the start of a new study, with n=1.  Results will trickle in sporadically from here on in.

His name is Finn.

This morning I spent a few minutes explaining to him about correlation and causation, and his uncle took confirmation bias.  I think he understood.

They say the best data can be explained in pictures, so I'll leave you with this:
Good data, good.  Please excuse some sporadic posting for a bit!

Tuesday, July 17, 2012

Deadliest weapons and causes of death

There's an apocryphal story in the international public health sphere about the time someone tried to figure out total mortality in Africa in any given year.  Apparently they went through the newsletters/press releases of  charities dedicated to various diseases, and found that if you added all the "x number of people die every year" numbers up, everyone in Africa died every year.  Twice.

While there's likely some data inflation there, the other explanation is that it's really hard to classify causes of death (I've covered some of this before).  Even with infectious disease, this can be tricky.  If an HIV positive person contracts tuberculosis and dies, do they go under HIV mortality, or tuberculosis?  If malnutrition leaves on susceptible to other infections, what's the real cause of death?  How about a bad water supply that carries ringworm?

I bring this up because I saw a fascinating stat today over at the New Yorker (via Farnam St):

What Is The Most Effective Killing Machine Man Has Ever Seen?Mosquitoes.
There has never been a more effective killing machine. Researchers estimate that mosquitoes have been responsible for half the deaths in human history.Malaria accounts for much of the mortality, but mosquitoes also transmit scores of other potentially fatal infections, including yellow fever, dengue fever, chikungyunga, lymphatic filariasis, Rift Valley fever, West Nile fever, and several types of encephalitis. Despite our technical sophistication, mosquitoes pose a greater risk to a larger number of people today than ever before. Like most other pathogens, the ciruses and parasites borne by mosquitoes evole rapidly to resist pesticides and drugs.
via “The Mosquito Solution,” ($$$) The New Yorker, July 9 & 16, 2012, p. 40
Definitely made me a bit nervous, especially since it seems malaria, etc would actually be some of the more accurately counted causes of death.  So, um, take care of yourselves this summer, okay?

Tuesday, June 12, 2012

Monday, June 11, 2012

Researching New Family Structures...Cutting Through Politics with Facts

I've been reading Bad Science by Ben Goldacre, and I highly recommend it.

In it, he quotes an interesting study regarding how likely people are to pick apart studies that challenge their preconceived notions.  Unsurprisingly, people are far more likely to notice flaws in studies they don't agree with than those they do.  He then made a somewhat tongue in cheek suggestion that perhaps all papers should have to list the method section first, to make sure that it was assessed before you knew what the conclusion was.

That came to mind today when I was reading Mark Regnerus's explanation of his new research in to new family structures.

I was unsure what to think of this study just from the headline.  I've actually read some of Regnerus's research in the past and disliked it, so I wasn't sure what I'd think of his take on this issue.

I found the paper fascinating.

Part of his premise started from his observation that adoption presents a unique challenge for parents, as is well acknowledged by research.  Thus, it interested him that many studies on gay and lesbian parenting showed no differences between that and heterosexual couples.  That appealed to my data analysis side, it's certainly not an observation I would have put together right away.  The study was focused on the young adult (18 to 39) population, and thus the slightly longer term outcomes of products of these families.

What impressed me so much about this study was how many pains they took to correct methodological errors in previous studies.  With such a highly politically charged topic, it would have been easy for him to just shy away from this study.  While critics were quick to point out that his funding came from two conservative organizations, his conclusions are not necessarily conservative.  While he does find that the outcomes for children of gay parents have worse outcomes on most metrics*, he acknowledge the high level of broken homes from these parents as a huge contributing factor.  His population makes the study a bit retrospective, and he acknowledges these limitations.  From his Slate.com article:
Let me be clear: I’m not claiming that sexual orientation is at fault here, or that I know about kids who are presently being raised by gay or lesbian parents. Their parents may be forging more stable relationships in an era that is more accepting and supportive of gay and lesbian couples. But that is not the case among the previous generation, and thus social scientists, parents, and advocates would do well from here forward to avoid simply assuming the kids are all right.
 William Saletan (and others) have quickly responded with the idea that this study actually supports the need for gay marriage by proving that the broken homes of the past were damaging to children.  Clearly Regenrus does not rule that out in his study....he is quite clear that he knows the selected age group covers only those children born 1971 to 1994 (pre legal gay marriage), and he goes very in depth with the broken homes angle.....acknowledging that many of the broken homes were fractured hetero marriages that preceded the same gender relationships.

The value of a study like this however, is not merely in the conclusions.  The value is that it unsettles the debate, and hopefully precipitates a response from those who disagree with him.  In emotionally and politically charged fields, the response to data should be newer and better data that corrects the perceived problems in the last study.  Politics should not be a reason to consider something "settled", and we need researchers who are at least willing to entertain the other side, if only to give people something to respond to.

I know most people will not make up their mind on this issue because of a research study, but I don't think that's a reason to not do research. Whatever a person believes, I would hope this study could be read with unbiased eyes, methods first....just to see what you think.

*As I commented in this post metrics on child rearing can be hard to determine.  Some of the ones used in this study were: being unemployed, less healthy, more depressed, more likely to have cheated on a spouse or partner, smoke more pot, had trouble with the law, report more male and female sex partners, more sexual victimization, and were more likely to reflect negatively on their childhood family life.  The full list is in the paper here.

Sunday, May 27, 2012

Everything old is new again

One of my favorite things about growing up in the family I did, surrounded by the friends my parents had, was the large amount of historical context I was fed for nearly every topic that interested me.

People like my father (who posts here as Michael) and David (the Assistant Village Idiot) were always quick to fill me in on the history of whatever topic I happened to bring up.  This always gave me a good appreciation for the story behind the story as it were, and made me truly relish a good piece of context.  Growing up in the 80's, this was like having Wikipedia just sort of follow me around.  Come to think of it, some kids may not have appreciated that as much as I did.

I mention all this because I'm packing up my condo this weekend, and have been toting around my laptop to watch Hans Rosling's hour long documentary "The Joy of Stats" while I work.  I highly recommend this, if not for any new stats knowledge, than at least for the examples he gives and the history lesson.

One of the more interesting points he made actually related to some of my census data posts from earlier this week, so I thought I'd pass it along.

First, if you haven't read the comment from Glenn, the former Census Bureau employee, on my post about racial categorizations, you should.  He filled in some details I didn't know....I would never have guessed that it was the Office of Budget Management that set racial categories for the government....and he concludes his comments with this:

Confusing? Yes. Please keep in mind that the purpose of these categories isn't always statistical but political. Politics makes for strange statistics at times.
I liked that phrase.  I think that "The politics of statistics" should be an interdisciplinary undergrad class of some sort.

Anyway, according to Rosling's documentary, it was actually the government of Sweden that helped invent the modern study of statistics, and they began to find it so useful that other governments started using it too.  Apparently, it was not actually referred to as statistics, but instead "political arithmetic".

It is almost surreal to realize that up until that point, countries often didn't know how many residents they had, or what their biggest challenges were.  An extra bonus in the film is the map of "Bastardy in England".  Highly recommended.

Saturday, May 26, 2012

Weekend Moment of Zen 5-26-2012

Hans Rosling's enthusiasm gets me every time.  Here, he takes on the ideas of unlimited population growth and religions influence on baby making:




Apparently he has a one hour documentary on stats.  I'm adding watching it to my list of goals for the long weekend.

Wednesday, April 25, 2012

Begin with the end in mind

Most of what I do all day is in the loose category known as operations research.  This is an interesting sort of research that typically starts with a question, and then involves gathering qualitative and quantitative data until you get a hypothesis.  Adjustments are made until you get going in the right direction, which is normally related to either getting more of a good thing or less of a bad thing...or often both.

This is my favorite type of research for any field for a variety of reasons: it's practical, it helps people, it tends to cut through feelings and deals with facts, and it leaves room for people to be surprised.   

The downside is that the questions are often complex and the answers multi-dimensional.  That's why good research of this kind is so darn impressive.  I read a great article today about Jacqueline Campbell and her work to reduce domestic homicide.  She started with a complex problem, and worked both forward and backwards until she came up with something that worked.  Working backwards, she went deep in to the statistics to figure out which situations were the most likely to result in homicide, and then trained the front end responders how to reach out to those who were at the most risk.  While she will not claim credit, it is noted that  the state where she implemented this program (Maryland) has cut their domestic homicide rate in half.  

Domestic violence is an issue that can very easily get mired down in politics and emotion, so it's interesting to note that this is one of the few programs that is getting bipartisan support.  That's such a good outcome when somebody actually pragmatically addresses an issue rather than just catering to their own pet theories.

To note: starting research with a goal in mind is beneficial only when it's not a guise to push an agenda.  It's only good if you really don't know how to get there.   I feel this is research at it's best, research that actually helps a real world problem.  I have nothing against research that helps us see the world in new ways, but my practicality bias is probably why I did engineering and not theoretical physics.  It takes all types, I just wish more would focus on the "how do we get there" type questions.