Multiple Testing under Dependence via Semiparametric Graphical Models
The 31st International Conference on Machine Learning (ICML), 2014 .
Jie Liu, Chunming Zhang, Elizabeth Burnside, and David Page.
- Abstract: It has been shown that graphical models can be used to leverage the dependence in large-scale multiple testing problems with significantly improved performance (Sun & Cai, 2009; Liu et al., 2012). These graphical models are fully parametric and require that we know the parameterization of f_1 --- the density function of the test statistic under the alternative hypothesis. However in practice, f_1 is often heterogeneous, and cannot be estimated with a simple parametric distribution. We propose a novel semiparametric approach for multiple testing under dependence, which estimates f_1 adaptively. This semiparametric approach exactly generalizes the local FDR procedure (Efron et al., 2001) and connects with the BH procedure (Benjamini & Hochberg, 1995). A variety of simulations show that our semiparametric approach outperforms classical procedures which assume independence and the parametric approaches which capture dependence.
- Paper: download
- Supporting material: download
- Code: link
- Other related paper: Coming soon.