How to quantify the evidence for the absence of a correlation

Behav Res Methods. 2016 Jun;48(2):413-26. doi: 10.3758/s13428-015-0593-0.

Abstract

We present a suite of Bayes factor hypothesis tests that allow researchers to grade the decisiveness of the evidence that the data provide for the presence versus the absence of a correlation between two variables. For concreteness, we apply our methods to the recent work of Donnellan et al. (in press) who conducted nine replication studies with over 3,000 participants and failed to replicate the phenomenon that lonely people compensate for a lack of social warmth by taking warmer baths or showers. We show how the Bayes factor hypothesis test can quantify evidence in favor of the null hypothesis, and how the prior specification for the correlation coefficient can be used to define a broad range of tests that address complementary questions. Specifically, we show how the prior specification can be adjusted to create a two-sided test, a one-sided test, a sensitivity analysis, and a replication test.

Keywords: Bayes factor; Hypothesis test; Statistical evidence.

MeSH terms

  • Bayes Theorem*
  • Humans
  • Statistics as Topic / methods*