Nonparametric estimation of the rediscovery rate

Donghwan Lee, Andrea Ganna, Yudi Pawitan, Woojoo Lee

Research output: Contribution to journalArticlepeer-review

Abstract

Validation studies have been used to increase the reliability of the statistical conclusions for scientific discoveries; such studies improve the reproducibility of the findings and reduce the possibility of false positives. Here, one of the important roles of statistics is to quantify reproducibility rigorously. Two concepts were recently defined for this purpose: (i) rediscovery rate (RDR), which is the expected proportion of statistically significant findings in a study that can be replicated in the validation study and (ii) false discovery rate in the validation study (vFDR). In this paper, we aim to develop a nonparametric approach to estimate the RDR and vFDR and show an explicit link between the RDR and the FDR. Among other things, the link explains why reproducing statistically significant results even with low FDR level may be difficult. Two metabolomics datasets are considered to illustrate the application of the RDR and vFDR concepts in high-throughput data analysis.

Original languageEnglish
Pages (from-to)3203-3212
Number of pages10
JournalStatistics in Medicine
Volume35
Issue number18
DOIs
StatePublished - 15 Aug 2016

Keywords

  • false discovery rate
  • multiple testing
  • rediscovery rate
  • validation study

Fingerprint

Dive into the research topics of 'Nonparametric estimation of the rediscovery rate'. Together they form a unique fingerprint.

Cite this