Skip to content

It is conservative to assess significance by the degree of overlap of confidence intervals

February 25, 2013

Here Here is a really interesting paper with a very simple message:

1. When two confidence intervals do not overlap, then the two parameters are significantly different.
2. When two confidence intervals overlap, then the two parameters may or may not be significantly different.

In other words, when there is no overlap, you don’t really need to test for significance. But when there is overlap, you do need to test for significance.

Hope I’m not oversimplifying.

Advertisements
2 Comments leave one →
  1. August 11, 2014 9:00 pm

    Unfortunately, your our eyeball is not a well-defined statistical procedure. It’s always best to use the appropriate hypothesis test instead. Overlapping confidence intervals do not mean two values are not significantly different. There’s more information here on that: http://www.statisticsdonewrong.com/significant-differences.html

    • August 12, 2014 12:38 am

      “Overlapping confidence intervals do not mean two values are not significantly different.”

      I know. That’s what I meant by “When two confidence intervals overlap, then the two parameters may or may not be significantly different.”

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: