Yesterday a facebook friend of mine put up an angry post regarding misuse of the word "decimate". His chief complaint was that people used it as a synonym for destroy, when really it meant a reduction of 10% or so. That cleared up the "deci" part of the word for me, but I was surprised that the proper definition was so narrow....so of course I went to dictionary.com to check his facts.
Turns out the "one in ten" definition is specifically marked as obsolete. The current accepted definition is merely "to destroy a great number of". So basically it can't be used to sub in for obliterate, but the 10% definition was only valid through the year 1600 or so. Sigh.
I'm not a big fan of people who try to get too cute when picking on the language of others. While I certainly am irritated by some of the more obvious errors in language (irregardless makes me cringe, and please don't mix up "less" and "fewer" in my presence), I dislike when people go back several hundred verbal years and then attempt to claim that's the "proper" way of doing things. This annoys me enough that my brother bought me this book a few years ago, just to help me out. I believe language will always be morphing to a certain extent, and while rules are good we just need to accept that all language is pretty much arbitrary. Thus, I refer to myself as a linguistic pragmatist. Adhere to the rules, but accept that sometimes society just moves on.
Why am I bringing this up? Well, after going through that internal rant, I found it very interesting that this study is being reported with the headline "Popular kids who tortured you in high school are now rich".
Basically, researchers assessed how popular kids were in high school, based on how many people gave you "friendship nominations" and found that those in the top 20% made 10% more money 40 years later than those in the bottom 20%.
Now I think this makes a certain amount of sense. While the outcast nerd makes good story is appealing, it stands to reason that many of the least popular kids in high school might be unpopular because of real issues with social skills that hurt them later in life (to note, social skill impairment is a co-morbidity with all sorts of things that could make this worse....ADHD, depression, etc). Conversely of course, those with more friends probably have skills that help them maintain networks later. Basically, I think this study tells us that the number of friends you have in high school isn't totally random.
My issues with the reporting/reading of this study is in the semantics. I think there's a disconnect between our common interpretation of "popular in high school" and the actual definition of "popular in high school". The researchers in this study weren't assessing the kids other kids aspired to be, they were assessing the kids who actually had lots of friends and were well liked. While the classic football player who beats up kids in the locker room may get referred to as a popular kid, it's likely he would not have had many people naming him as a friend on a survey. So basically, the study had a built in control for those kids who were temporarily at the top of the social ladder, but lacked actual getting along with people skills. I had an incredibly small high school class (<30) and I could name several kids who fell in the "perceived popular" category but not the "actually popular" category.
All this to come back to my original point. Words mean different things depending on context, and this should always be taken in to account when assessing research and reading subsequent report. It's not bad data, just a different set of definitions.
Showing posts with label Basic Guidelines. Show all posts
Showing posts with label Basic Guidelines. Show all posts
Wednesday, October 24, 2012
Wednesday, July 11, 2012
Good hospital/Bad hospital
Several years ago, back when I was working in the Emergency Department, I had a rather fascinating encounter with a patient's wife. It was late in the evening on a Friday....a generally bad time to come in to the ER....and she had brought her husband in with a large cut on his arm. He needed stitches for sure, but the place was hopping that night, and so she, her husband, and her two small children had been stuck in the waiting room for several hours. After some time, she had come in asking me when someone was going to come get him. At that point, I think they still had 4 or 5 people ahead of them, and I let her know.
She (fairly understandably) flipped out.
As I tried to calm her down, she started to lecture me about how long they had been waiting....and then proceeded to let me know that this wait had come after she had driven her husband over an hour and a half to get there. "You are SUPPOSED to be the best hospital in the country" she raged. "How can you be if you make patients wait so long????".
Now I had the "why am I waiting so long" conversation with literally thousands of patients in my time in the ER, but something really struck me about this poor woman's frustration. She had brought her husband to a hospital that was supposed to be the best (this particular hospital bounces around the top 5 in the country pretty routinely), but not for what he needed done that night. What he needed was a simple set of stitches, the likes of which nearly any doctor in the country could have done. When I took a look at her address, I realized she had driven by at least five different hospitals with ERs to get to ours. Most likely any one of them would have gotten her faster service with the same quality of care. In fact, within the next few years, three of them would devise marketing strategies around publicizing that fact. The problem is, this woman had confused "the best" with "good at everything".
When it comes to hospitals, that's just not true.
Given my professional experience, I was unsurprised to see Time reporting that not one of the 17 best hospitals (according to US News and World Report) made the consumer reports list of safest hospitals.
There's a couple reasons for this, some good and some bad:
- Best hospitals tend to be large teaching hospitals. Large teaching hospitals have a lot of residents. Residents can be a little dicey.
- Best hospitals tend to see huge numbers of patients. This can complicate things.
- Best hospitals tend to see cases other hospitals can't help. Almost all of your top hospitals will have higher mortality rates than smaller community hospitals. Why? Because unless you're literally DOA, the first thing a small hospital will do with a really sick patient is to ship them off to a hospital with a good intensive care unit. The top hospitals almost never transfer their patients.
- Best hospitals are ranked in large part on how they treat the toughest cases. The more unique your condition, or the worse your risk factors, the more selective you need to be. The more routine your complaint, the more a top hospital can actually work against you....you're going to be one of many, and nothing makes you stand out.
- Large medical centers, specifically in urban settings, give away a lot of free care to a lot of high risk populations. These patients are unlikely to do well in any setting, and can skew the data tremendously. Location counts.
There's constant strife over how to accurately rank hospitals, because professionals skew hospital rankings in the direction of valuing medical uniqueness. Patients on the other hand, tend to value things like "comfort of chairs in the waiting room" nearly as high as they do "physician competence". Patient's also claim to want things that they don't really....for example nearly everyone says they value physician competence over bedside manner, yet patient's routinely rate physicians with good bedside manner higher than those with good technical skill. Patient's receiving appropriate care also file plenty of complaints if it wasn't the care they expected. No hospital ranking is going to hit every part of the hospital equally regardless of who ranks it, and every department can have a bad day.
I don't have a lot of answers to these issues, but it's important to keep them in mind when you hear ideas for improvement. While the Time article got a bit too political for my taste, it is true that patients can only make informed decisions if the information they have is what they think it is.
Thursday, March 29, 2012
Why most nutritional research is useless
Nutrition research is big money these days. Our national obsession with weight loss is at a fever pitch, and any new or interesting research is sure to make headlines.
Like, oh say this recent study Maxed Out Mama referred me to on how people who eat more chocolate tend to be thinner. Only a partial abstract is available free, but here it is.
Here's some basic guidelines on what to look for in nutritional research (any study, not just this one):
- Was the data self reported? Even CNN brought this up in their article. People, especially those embarrassed about their weight, don't accurately assess what they eat. My mother, skinny little thing that she is, could eat one peppermint patty and tell you she'd had a serving of chocolate. I don't think I'd even count it until I had 3 or so.
- How much was "more"? I actually can't find this for this study. Is it the difference between 1 and 2 servings per week? Or the difference between 1 and 5? Both would produce statistically significant correlations, but the practical outcome would be different. In 2005, researchers made news by saying that eating more fruits and veggies did not, in fact, prevent cancer. The cancer treating establishment (which I work in, btw) promptly responded by pointing out that they compared people who ate half a fruit per day to those who at 1-2 fruits per day. It was all reported in grams too, so the data look extra impressive "Those eating less than 114 grams showed no difference from those eating 367 grams". The link gives more examples, but 250 grams is one medium apple. Watch out for this.
- Who classified people as "normal weight" or "overweight"? If this was also self reported (and in this study, it looks like there were clinic visits), then look out. There's a great study I can't find right now that shows that women tend to lie about weight, and men tend to lie about height. Both lies will screw up the BMI calculation (the most common metric for assessing "normal").
- Were the overweight people actively (or even somewhat) trying to modify their diets to lose weight? A few years ago, I heard about the study that suggested diet soda was linked to obesity. I remember my first reaction was "are we sure they're all not just on diets?". This seemed like a classic correlation/causation issue. All the analysis seemed to presume they were overweight because they drank diet soda. I wondered why they never seemed to look at the idea that they could be drinking diet soda because they were overweight. That's one of the first swaps most people I know make when they try to lose weight.
- Don't even get me started if it's a population study. That's a big topic for another time, but lets just say they're really really tricky.
If you ever want a fabulous crash course in how nutrition research can be skewed, pick up two diet books that contradict each other, and read through their parts on research. Take something like Atkins (high protein, low carb) and Joel Fuhrman (nearly vegan), and watch them rip to shreds the research the other one builds their whole case on.
He may have his own controversy, but this is why I like Michael Pollan. The book I linked to has a great crash course in why most nutritional research just sees what it wants to. He refused to take a strict nutritional stance and instead condensed it down to a few "rules" that he gleaned from quizzing nutritionists on "what they could say for sure". The answer? Eat real food, not too much, mostly plants.
Subscribe to:
Posts (Atom)