While I've had in the back of my mind for years a thought that a scholarly journal--dedicated to replication efforts--might emerge, it looks as though something like this has. Specifically, the Journal of Robustness Reports ("JRR") sets out to, not only report results on replication efforts (however defined) but, as well, on efforts to reanalyze previously published empirical findings. An excerpt of the journal's mission follows.
"The vast majority of empirical research articles report a single primary analysis outcome that is the result of a single analysis plan, executed by a single analysis team (usually the team that also designed the experiment and collected the data). However, recent many-analyst projects have demonstrated that different analysis teams generally adopt a unique approach and that there exists considerable variability in the associated conclusions. . . . In order to showcase the practical feasibility and epistemic benefits of this approach we have founded the Journal of Robustness Reports, which is dedicated to publishing short reanalyses of empirical findings. . . ."
Additional information about this open-access Journal can be found here. I have a hunch many of this blog's readers (certainly those based in law schools) might find one of the Journal's "features or bugs" intriguing. Specifically, the JRR "limits Robustness Reports to only 500 words (excluding the Acknowledgments and Disclosures section, the References section, figure/table captions, and the title page) and one display element (table/figure)." Motivation for this word count limitation includes JRR's goal to "convince mainstream empirical journals to adopt the format and arrange their own robustness reports to accompany articles of substantial interest — an investment of 500 words is minimal and similar to that of a comment or a letter to the editor (which which many journals are already familiar)."
While I remain curious about how scholarly demand for such an outlet might unfold, I certainly hope JRR succeeds as a journal and applaud such an initiative.
Recent Comments