Beyond inference by eye: Statistical and graphing practices in JEAB, 1992-2017

Abstract

<p>Debates about the utility of <i>p</i> values and correct ways to analyze data have inspired new guidelines on statistical inference by the <i>American Psychological Association (APA)</i> and changes in the way results are reported in other scientific journals, but their impact on the <i>Journal of the Experimental Analysis of Behavior (JEAB)</i> has not previously been evaluated. A content analysis of empirical articles published in <i>JEAB</i> between 1992 and 2017 investigated whether statistical and graphing practices changed during that time period. The likelihood that a <i>JEAB</i> article reported a null hypothesis significance test, included a confidence interval, or depicted at least one figure with error bars has increased over time. Features of graphs in <i>JEAB</i>, including the proportion depicting single-subject data, have not changed systematically during the same period. Statistics and graphing trends in <i>JEAB</i> largely paralleled those in mainstream psychology journals, but there was no evidence that changes to <i>APA</i> style had any direct impact on <i>JEAB</i>. In the future, the onus will continue to be on authors, reviewers and editors to ensure that statistical and graphing practices in <i>JEAB</i> continue to evolve without interfering with characteristics that set the journal apart from other scientific journals.</p>