Monday, November 23, 2015

How not to get ripped off by Safeway

In my classes where we study or review statistical inference, I often give the following example of a hypothesis test concerning a single mean: you suspect your sardine cans contain fewer sardines than indicated on the packaging.  The packaging says there are 10 sardines per can but you are often finding 8 or 9.  So, you open up 100 cans and find the average is 9.5 with a standard deviation of 1.  Is this evidence that the tins are lighter than advertised?

The other day I read a news story (here) that describes an almost identical situation, but it is was for tuna fish, not sardines (In my examples I like to pick a fish that you can count by either heads or tails.)

To learn how to do a hypothesis concerning a single mean, read the Appendix to Chapter 1 of Mastering Metrics, which you can find here.

The answer to my question above is, it is very unlikely that there are 10 sardines per can, given our findings.  It could be true, and we just happened to find a mean of 9.5 by chance alone.  But this would be a major fluke and it is highly, highly unlikely.  To see this, use the formulas presented on page 39 of Mastering Metrics.  You will find the test statistic is much larger (in absolute value) than 2.  On page 41, the authors explain why the finding of a large test statistic is "...unlikely to be consistent with the null hypothesis..."  In other words, it is unlikely the mean is 10 in my example.

Now, this analysis assumes the sample of cans opened was a random sample (you didn't pick an unrepresentative sample of cans to open.)  I'm no lawyer, but I would guess a finding like the one in my (fictional) example is probably grounds for a class action lawsuit. 

In the analysis reported in the tuna fish story linked to above, in one of their samples, they didn't find a single can that was over the advertised amount.  That will certainly make the job of explaining the analysis to a jury much, much easier!

p.s.  If you want to calculate the test statistic, and the associated p-value, post your answer as a comment and I will grade it for you for free!

1 comment: