M-Turk's Important Limitations

Dan Kahan (Yale) has been a leading critic of the increasingly-popular "M-Turk" studies. And despite, as Andy Gelman (Columbia--Statistics) notes, "M-Turk’s combination of low cost and low validity [make] it an attractive option for many researchers," such attractiveness, as Kahan points out (here), should be measured due to critical limitations incident to an array of M-Turk's sampling issues. Whether one agrees or disagrees with Kahan, researchers using M-Turk-generated data certainly need to engage Kahan's critique.