Many interventions aim to protect people from misinformation. Here, we review common measures used to assess their efficacy. Some measures only assess the target behavior (e.g., ability to spot misinformation) and therefore cannot determine whether interventions have overly general effects (e.g., erroneously identifying accurate information as misinformation). Better measures assess discernment, the ability to discriminate target from non-target content. Discernment can determine whether interventions are overly general but is often measured by comparing differences in mean ratings between target and non-target content. We show how this measure is confounded by the configuration of response criteria, leading researchers to incorrectly conclude that an intervention improves discernment. We recommend using measures from signal detection theory, such as the area under the receiver operating characteristic curve, to assess discernment.

中文翻译：

---

平均评分差异分数是辨别力的不良衡量标准：反应标准的作用

许多干预措施旨在保护人们免受错误信息的影响。在这里，我们回顾了用于评估其功效的常用措施。一些措施仅评估目标行为（例如，发现错误信息的能力），因此无法确定干预措施是否具有过于普遍的效果（例如，错误地将准确信息识别为错误信息）。更好的衡量标准是评估洞察力，即区分目标内容和非目标内容的能力。辨别力可以确定干预措施是否过于笼统，但通常通过比较目标内容和非目标内容之间的平均评分差异来衡量。我们展示了这一衡量标准如何与反应标准的配置相混淆，从而导致研究人员错误地得出干预措施可以提高辨别力的结论。我们建议使用信号检测理论中的测量值（例如接收器操作特征曲线下的面积）来评估辨别力。