A comprehensive evaluation of computational tools to identify differential methylation regions using RRBS data

Abstract

DNA methylation plays a vital role in transcription regulation. Reduced representation bisulfite sequencing (RRBS) is becoming common for analyzing genome-wide methylation profiles at the single nucleotide level. A major goal of RRBS studies is to detect differentially methylated regions (DMRs) between different biological conditions. The previous tools to predict DMRs lack consistency. Here, we simulated RRBS datasets with significant attributes of real sequencing data under a wide range of scenarios, and systematically evaluated seven DMR detection tools in terms of type I error rate, precision/recall (PR), and area under ROC curve (AUC) using different methylation levels, sequencing coverage depth, length of DMRs, read length, and sample sizes. DMRfinder, methylSig, and methylKit were our preferred tools for RRBS data analysis, in terms of their AUC and PR curves. Our comparison highlights the different applicability of DMR detection tools and provides information to guide researchers towards the advancement of sequence-based DMR analysis.