Showing posts with label Data for the pure love of data. Show all posts
Showing posts with label Data for the pure love of data. Show all posts

Wednesday, July 4, 2012

4th of July, Census Bureau style

Here's hoping everyone had a relaxing 4th of July!

Today I learned that the White House sponsors two official Independence Day parties at the White House. One of them is for service men and women and their families, the other is for a broader group of friends of the White House.  I bring this up because apparently my younger brother finagled a ticket to the second one. Kind of makes my day feel a little lame, but hey, at least the house is coming along, and I'm the most relaxed I have been in a while.

I was looking for some good stats about the White House, but then I found this which I thought was equally interesting.  It's no West Lawn Party....but we here at Bad Data Bad do what we can with what we have.

Without further ado, here's some (year old) fun facts, courtesy of our Census Bureau:


The Fourth of July 2011


On this day in 1776, the Declaration of Independence was approved by the Continental Congress, setting the 13 colonies on the road to freedom as a sovereign nation. As always, this most American of holidays will be marked by parades, fireworks and backyard barbecues across the country.

2.5 million

In July 1776, the estimated number of people living in the newly independent nation.
Source: Historical Statistics of the United States: Colonial Times to 1970
<http://www.census.gov/prod/www/abs/statab.html>

311.7 million

The nation's estimated population on this July Fourth.
Source: Population clock <http://www.census.gov/main/www/popclock.html>

Flags

$3.2 million

In 2010, the dollar value of U.S. imports of American flags. The vast majority of this amount ($2.8 million) was for U.S. flags made in China.
Source: Foreign Trade Statistics <http://www.census.gov/foreign-trade/www/>
<http://www.usatradeonline.gov>

$486,026

Dollar value of U.S. flags exported in 2010. Mexico was the leading customer, purchasing $256,407 worth.
Source: Foreign Trade Statistics <http://www.census.gov/foreign-trade/www/>
<http://www.usatradeonline.gov>

$302.7 million

Annual dollar value of shipments of fabricated flags, banners and similar emblems by the nation's manufacturers, according to the latest published economic census data.
Source: 2007 Economic Census, Series EC0731SP1, Products and Services Code 3149998231
<http://www.census.gov/econ/census07/>

Fireworks

$190.7 million

The value of fireworks imported from China in 2010, representing the bulk of all U.S. fireworks imported ($197.3 million). U.S. exports of fireworks, by comparison, came to just $37.0 million in 2010, with Japan purchasing more than any other country ($6.3 million).
Source: Foreign Trade Statistics <http://www.census.gov/foreign-trade/www>
<http://www.usatradeonline.gov>

$231.8 million

The value of U.S. manufacturers' shipments of fireworks and pyrotechnics (including flares, igniters, etc.) in 2007.
Source: 2007 Economic Census, Series EC0731SP1, Products and Services Code 325998J108
<http://www.census.gov/econ/census07/>

Patriotic-Sounding Place Names

Thirty-one places have “liberty” in their names. The most populous one as of April 1, 2010, is Liberty, Mo. (29,149) Iowa, with four, has more of these places than any other state: Libertyville, New Liberty, North Liberty and West Liberty.
Thirty-five places have “eagle” in their names. The most populous one is Eagle Pass, Texas (26,248).
Eleven places have “independence” in their names. The most populous one is Independence, Mo. (116,830).
Nine places have “freedom” in their names. The most populous one is New Freedom, Pa. (4,464).
One place with “patriot” in the name. Patriot, Ind. (209).
Five places have “America” in their names. The most populous is American Fork, Utah (26,263).
Source: American FactFinder <www.census.gov>

Early Presidential Last Names

138

Ranking of the frequency of the surname of our first president, George Washington, among all last names tabulated in the 2000 Census. Other early presidential names that appear on the list, along with their ranking, were Adams (39), Jefferson (594), Madison (1,209) and Monroe (567).
Source: Census 2000 Genealogy <http://www.census.gov/genealogy/www/freqnames2k.html>

The British are Coming!

$98.3 billion

Dollar value of trade last year between the United States and the United Kingdom, making the British, our adversary in 1776, our sixth-leading trading partner today.
Source: Foreign Trade Statistics <http://www.census.gov/foreign-trade/statistics/highlights/top/top1012yr.html#total>
<http://www.usatradeonline.gov>

Fourth of July Cookouts

More than 1 in 4

The chance that the hot dogs and pork sausages consumed on the Fourth of July originated in Iowa. The Hawkeye State was home to 19.0 million hogs and pigs on March 1, 2011. This estimate represents more than one-fourth of the nation's estimated total. North Carolina (8.6 million) and Minnesota (7.6 million) were also homes to large numbers of pigs.
Source: USDA National Agricultural Statistics Service
<http://usda.mannlib.cornell.edu/usda/current/HogsPigs/HogsPigs-03-25-2011.pdf>

6.8 billion pounds

Total production of cattle and calves in Texas in 2010. Chances are good that the beef hot dogs, steaks and burgers on your backyard grill came from the Lone Star State, which accounted for about one-sixth of the nation's total production. And if the beef did not come from Texas, it very well may have come from Nebraska (4.6 billion pounds) or Kansas (4.1 billion pounds).
Source: USDA National Agricultural Statistics Service
<http://usda.mannlib.cornell.edu/usda/current/MeatAnimPr/MeatAnimPr-04-28-2011.pdf>

6

Number of states in which the value of broiler chicken production was $1 billion or greater between December 2009 and November 2010. There is a good chance that one of these states — Georgia, Arkansas, North Carolina, Alabama, Mississippi or Texas — is the source of your barbecued chicken.
Source: USDA National Agricultural Statistics Service
<http://usda.mannlib.cornell.edu/usda/current/PoulProdVa/PoulProdVa-04-28-2011.pdf>

Over 1 in 3

The odds that your side dish of baked beans originated from North Dakota, which produced 36 percent of the nation's dry, edible beans in 2010. Another popular Fourth of July side dish is corn on the cob. Florida, California, Georgia, Washington and New York together accounted for 68 percent of the fresh market sweet corn produced nationally in 2010.
Source: USDA National Agricultural Statistics Service
<http://usda.mannlib.cornell.edu/usda/current/CropProdSu/CropProdSu-01-12-2011_new_format.pdf> and
<http://usda.mannlib.cornell.edu/usda/current/VegeSumm/VegeSumm-01-27-2011.pdf>

Please Pass the Potato

Potato salad and potato chips are popular food items at Fourth of July barbecues. Approximately half of the nation's spuds were produced in Idaho or Washington state in 2010.
Source: USDA National Agricultural Statistics Service
<http://usda.mannlib.cornell.edu/usda/current/CropProdSu/CropProdSu-01-12-2011_new_format.pdf>

More than three-fourths

Amount of the nation's head lettuce production in 2010 that came from California. This lettuce may end up in your salad or on your burger.
Source: USDA National Agricultural Statistics Service
<http://usda.mannlib.cornell.edu/usda/current/VegeSumm/VegeSumm-01-27-2011.pdf>

7 in 10

The chances that the fresh tomatoes in your salad came from Florida or California, which combined accounted for 71 percent of U.S. fresh market tomato production last year.
Source: USDA National Agricultural Statistics Service
<http://usda.mannlib.cornell.edu/usda/current/VegeSumm/VegeSumm-01-27-2011.pdf>

Florida

The state that led the nation in watermelon production last year (750 million pounds). Other leading producers of this popular fruit included California, Georgia and Texas, each had an estimate of more than 600 million pounds.
Source: USDA National Agricultural Statistics Service
<http://usda.mannlib.cornell.edu/usda/current/VegeSumm/VegeSumm-01-27-2011_new_format.pdf>

81 million

Number of Americans who said they have taken part in a barbecue during the previous year. It's probably safe to assume a lot of these events took place on Independence Day.
Source: Mediamark Research & Intelligence, as cited in the Statistical Abstract of the United States: 2011
<http://www.census.gov/compendia/statab/>, Table 1239

Tuesday, June 26, 2012

Causes of death and perception skewing

My first job out of college was working in one of the busiest Emergency Departments in the country.  I learned a lot of interesting things about human behavior there, and some random facts about the way the ED interacts with the government as far as reporting goes.  

One of the smaller parts of my job was making sure the proper reports got filed at the appropriate times, and this included death certificates.  Contrary to what you might think, not many people actually die in the Emergency Department.  Trauma victims almost always have enough time to get to the operating room before they die, and people with more chronic illnesses tend to die in the intensive care units.  Thus, when death certificates come up, most residents have no idea how to fill them out.  I don't remember much about them, but I will always remember one thing: heart failure is NOT a valid cause of death in Massachusetts.  You can put unknown, or heart disease or many many other things, but you can't put heart failure.  The reason?  Everyone dies of heart failure.  If your heart is still beating, you're not getting a death certificate.  

I'm thinking of all this because of a very cool new interactive graph put out by the New England Journal of Medicine about causes of death over the years.  I can only post the static graph, but I suggest you check out the interactive one:
Another list here, comparing 1900 and 2010 directly:
It's interesting to see causes that have dropped due to actual dips (tuberculosis) and those that are not there any more due to medical reclassification (senility).

It's a good study in how medical reporting can change over time for various reasons, and why changes should always viewed from both a broad view as well as up close.

Sunday, June 24, 2012

Life goes on, and so does life expectancy

Life expectancy is a funny thing.  It's a pretty often quoted statistic that not many people realize is just that - a statistic.  It's also fairly misunderstood, in that many people presume it's static.

Truthfully, your life expectancy changes over the course of your life based on how long you've already lived. Most people accept this as making sense once it's pointed out, but it's not often the first thought people have when they here it (and journalist's are ABYSMAL at clarifying the "at birth" part of most life expectancy estimates).  Anyway, this week chartporn.org posted this chart, which I think illustrates the changes nicely.  I didn't check all the other data they put on there (though I was surprised to see how low the median age for first divorces is), but I thought the overall affect was quite informative.

In particular, I like the beginning of the chart, where it shows that if you make it beyond your first year, you actually get a bump up pretty quickly.  Infant mortality is not often thought of as affecting overall life expectancy in developed countries, but it does.

Thursday, May 17, 2012

...and now for something completely different.

I don't normally get that involved with sports statistics, if only because it's the one place in the stats world where you could study them for an hour every day and still be barely a rookie.  However, something awfully strange is happening in my house recently, and I feel it's worth mentioning:  the Orioles are leading the AL East (in fact the whole American League), and the Red Sox are last.

Now, this is particularly interesting to my household, as my husband happens to be a lifelong Orioles fan.  I on the other hand, have always been a Red Sox fan.  Since we met almost 6 years ago, this has pretty much meant that I have had exclusive bragging rights when it came to baseball.  I know it's not even a quarter of the way in to the season, but this is the longest we've gone so far, and it's surreal.

Yesterday, Grantland put up an article on the Orioles under .500 curse.  Apparently they have not finished over .500 since 1997....more than enough seasons for the baseball stats guys to go nuts with.  I was curious exactly how bad it was, so I looked around until I found this graph generator*.

For those of you who don't know much about the Orioles, here's what they've looked like since 1998

Yowza.  Even if this season doesn't hang in there, it's still the most encouraging thing to happen in 7 years or so.

Now, here's the Red Sox in the same time period:
Yikes.  If they don't pick it up soon this will be the worst they've started off in 15 years.  

Sweetly enough, if the Sox win tonight against the Rays, that will both increase the Oriole's lead in the AL East, and look good for the Red Sox.  

Honey, the data proves it, tonight we're both Red Sox fans.

*If it shows you how crazy sports stats people are, I found that graph generator in exactly one try on google.  Conversely, when I tried to find historic gas prices for this post, I searched for almost half an hour trying to find an official source for anything pre-1978.  Didn't happen.  


Tuesday, May 8, 2012

Greetings from Maine

After a treacherous journey up Route 1 (over an hour to clear the city of Boston), I'm pleased to tell you that we're coming to you tonight from Portland, Maine.

I'm running a conference tomorrow at University of Southern Maine about bone marrow transplant patients who have to travel long distances....or as it's more flourishingly called "Improving Patient Pathways for Complex Care Across Multiple Healthcare Systems".  This is not my forte, and thus I have nothing long winded tonight....but after the stress of conference planning, I'm sure I'll have to spend several weeks with nothing but numbers and spreadsheets before I calm down.

While we wait to see where that takes me, I thought I'd continue my pattern of figuring out a good Google Ngram for the trips I take.  This time I decided to run all the New England states to see who got mentioned the most.  


I'm happy to see Massachusetts made a strong showing.  Connecticut managed to eek a win over Maine, and it looks like Vermont, New Hampshire and Rhode Island have just been hanging out for years.

Monday, April 23, 2012

Paranoia is just good sense if people really are out to get you

Yesterday I posted about retractions in scientific journals, and the assertion that they are going up.  I actually woke up this morning thinking about that study, and wishing I could see more data on how it's changed year to year (yes, I'm a complete nerd...but what do you ponder while brushing your teeth????).  Anyway, that brought to mind a post I did a few weeks ago, on how conservatives trust in the scientific community has gone steadily down.

It occurred to me that if you superimposed the retraction rate of various journals over the trust in the scientific community rates, it could actually be an interesting picture.   It turns out PubMed actually has a retraction rate by year available here.  For purposes of this graph I figured that would be a representative enough sample.

I couldn't find the raw numbers for the original public trust study, so these are eyeballed from the original graph in blue, with the exact numbers from the PubMed database in green.  

So it looks like a decreasing trust in the scientific community may actually be a rational thing*.  

It's entirely possible, by the way, that the increased scrutiny of the internet led to the higher retraction rate...but that would still have given people more reasons not to blindly trust.  As the title of this post suggests, skepticism isn't crazy if you actually should be skeptical.

Speaking of trust, I obviously had to manipulate the axes a bit to get this all to fit.  Still not sure I got it quite right, but if anyone wants to check my work, the raw data for the retraction rate is here and the data for the public trust study is here.  These links are included earlier as well, just wanted to be thorough.  

*Gringo requested that I run the correlation coefficients.  Conservatives r = -0.81 Liberals r = 0.52 Moderates r = 0.  I can't stand by these numbers since my data points were all estimates based on the original chart, but they should be about correct.

Tuesday, April 17, 2012

Boston vs Chicago

This week, Bad Data Bad is coming to live from downtown Chicago, just a few feet away from the Magnificent Mile!

I'm at the Science of Team Science conference, and so far it's going pretty well.  I got a chance to present and discuss some of my research with people last night, and it's fun having people recognize more of the psych aspect of what I've been doing.  Your normal bone marrow transplant crowd really doesn't care about that part of anything, so it was nice to have people recognize the theories behind what I was doing.  They're posting the abstracts online at some point, I'll link to them when I figure that out.

Anyway, on my flight out here the data geek in me realized that a Boston/Chicago comparison would be a great input for the Google Ngram Viewer.  If you haven't played with this yet, it's fun.  Basically it tracks how many times the words you put in were mentioned in books over the last 200 years.  They uploaded a massive number of books to get the data, so the results are kind of fun.  Here's Boston vs. Chicago:

For reference, Chicago wasn't founded until 1837.  I tried running it starting at Boston's founding in 1630, but that made a weird spike that made the rest of the graph look silly.  My guess is that's a function of fewer books from that era loaded in to the database, since the y-axis is percentage.

For more about the project behind google ngrams, here's my good friend TED to explain:

Thursday, April 5, 2012

That's some bad data, bad to the bone

Not the most useful data on the planet, but fun never the less....especially if you are a data geek married to a metal head.  Not that I'd know anything about that.

Heavy metal bands per capita for every country except Bhutan:


In case you're curious, here's an article explaining more, including the actual numbers used.

Thanks to some research carried out by me and my wonderful husband, we discovered that Bhutan now has 1 metal band that was formed in 2008.  Their name is Metal Visage.  Here's a review.  Oh, and if you're super curious, here's a video.  I have no idea if they're good or offensive or what, as my dog started barking as soon as I hit play, but my husband assures me they are better than Ugra Karma (one of Nepal's 12 metal bands)

Anyway, not much to criticize here, as sadly this is probably more accurate than most of the studies I write about.  I did find it amusing that I saw a comment about this where someone was greatly disturbed that the CIA world factbook was cited as a source.  I considered politely explaining to them that that was probably where the population numbers came from, not the metal band numbers, but I decided not to.  Read ALL the sources folks, thank you.