Abstract
High-throughput RNA sequencing is an increasingly accessible method for studying gene structure and activity on a genome-wide scale. A critical step in RNA-seq data analysis is the alignment of partial transcript reads to a reference genome sequence. To assess the performance of current mapping software, we invited developers of RNA-seq aligners to process four large human and mouse RNA-seq data sets. In total, we compared 26 mapping protocols based on 11 programs and pipelines and found major performance differences between methods on numerous benchmarks, including alignment yield, basewise accuracy, mismatch and gap placement, exon junction discovery and suitability of alignments for transcript reconstruction. We observed concordant results on real and simulated RNA-seq data, confirming the relevance of the metrics employed. Future developments in RNA-seq alignment methods would benefit from improved placement of multimapped reads, balanced utilization of existing gene annotation and a reduced false discovery rate for splice junctions.
MeSH Terms
Animals
Chromosome Mapping/methods
Computational Biology/methods
Exons
False Positive Reactions
High-Throughput Nucleotide Sequencing/methods
Humans
K562 Cells
Mice
RNA Splicing
RNA, Messenger/metabolism
Reproducibility of Results
Sequence Alignment/methods
Sequence Analysis, RNA/methods
Software
Authors & Affiliations
12 authors, click to expand affiliations / ORCID
Engström Pär G
1] European Molecular Biology Laboratory, European Bioinformatics Institute, Cambridge, UK. [2].
Steijger Tamara
Sipos Botond
Grant Gregory R
Kahles André
Rätsch Gunnar
Goldman Nick
Hubbard Tim J
Harrow Jennifer
Guigó Roderic
Bertone Paul
RGASP Consortium
Investigators
35 investigators, click to expand
Alioto Tyler
Behr Jonas
Bertone Paul
Bohnert Regina
Campagna Davide
Davis Carrie A
Dobin Alexander
Engström Pär G
Gingeras Thomas R
Goldman Nick
Grant Gregory R
Guigó Roderic
Harrow Jennifer
Hubbard Tim J
Jean Géraldine
Kahles André
Kosarev Peter
Li Sheng
Liu Jinze
Mason Christopher E
Molodtsov Vladimir
Ning Zemin
Ponstingl Hannes
Prins Jan F
Rätsch Gunnar
Ribeca Paolo
Seledtsov Igor
Sipos Botond
Solovyev Victor
Steijger Tamara
Valle Gioirgio
Vitulo Nicola
Wang Kai
Wu Thomas D
Zeller Georg
References (24)
24 references, click to expand
-
High levels of RNA-editing site conservation amongst 15 laboratory mouse strains.
Genome Biol. 2012 Apr 23;13(4):26
PMID: 22524474
-
Comparative analysis of RNA-Seq alignment algorithms and the RNA-Seq unified mapper (RUM).
Bioinformatics. 2011 Sep 15;27(18):2518-28
PMID: 21775302
-
Transcript assembly and quantification by RNA-Seq reveals unannotated transcripts and isoform switching during cell differentiation.
Nat Biotechnol. 2010 May;28(5):511-5
PMID: 20436464
-
Comparative analysis of information contents relevant to recognition of introns in many species.
BMC Genomics. 2011 Jan 19;12:45
PMID: 21247441
-
Landscape of transcription in human cells.
Nature. 2012 Sep 6;489(7414):101-8
PMID: 22955620
-
RNA-Seq read alignments with PALMapper.
Curr Protoc Bioinformatics. 2010 Dec;Chapter 11:Unit 11.6
PMID: 21154708
-
Critical assessment of methods of protein structure prediction (CASP)--round IX.
Proteins. 2011;79 Suppl 10:1-5
PMID: 21997831
-
BLAT--the BLAST-like alignment tool.
Genome Res. 2002 Apr;12(4):656-64
PMID: 11932250
-
Wisdom of crowds for robust gene network inference.
Nat Methods. 2012 Jul 15;9(8):796-804
PMID: 22796662
-
MapSplice: accurate mapping of RNA-seq reads for splice junction discovery.
Nucleic Acids Res. 2010 Oct;38(18):e178
PMID: 20802226
-
TopHat2: accurate alignment of transcriptomes in the presence of insertions, deletions and gene fusions.
Genome Biol. 2013 Apr 25;14(4):R36
PMID: 23618408
-
The Sequence Alignment/Map format and SAMtools.
Bioinformatics. 2009 Aug 15;25(16):2078-9
PMID: 19505943
-
TopHat: discovering splice junctions with RNA-Seq.
Bioinformatics. 2009 May 1;25(9):1105-11
PMID: 19289445
-
Assemblathon 1: a competitive assessment of de novo short read assembly methods.
Genome Res. 2011 Dec;21(12):2224-41
PMID: 21926179
-
Fast and SNP-tolerant detection of complex variants and splicing in short reads.
Bioinformatics. 2010 Apr 1;26(7):873-81
PMID: 20147302
-
Fast gapped-read alignment with Bowtie 2.
Nat Methods. 2012 Mar 04;9(4):357-9
PMID: 22388286
-
The GEM mapper: fast, accurate and versatile alignment by filtration.
Nat Methods. 2012 Dec;9(12):1185-8
PMID: 23103880
-
STAR: ultrafast universal RNA-seq aligner.
Bioinformatics. 2013 Jan 1;29(1):15-21
PMID: 23104886
-
Finishing the euchromatic sequence of the human genome.
Nature. 2004 Oct 21;431(7011):931-45
PMID: 15496913
-
EGASP: the human ENCODE Genome Annotation Assessment Project.
Genome Biol. 2006;7 Suppl 1:S2.1-31
PMID: 16925836
-
PASS: a program to align short sequences.
Bioinformatics. 2009 Apr 1;25(7):967-8
PMID: 19218350
-
All Your Base: a fast and accurate probabilistic approach to base calling.
Genome Biol. 2012 Feb 29;13(2):R13
PMID: 22377270
-
Tools for mapping high-throughput sequencing data.
Bioinformatics. 2012 Dec 15;28(24):3169-77
PMID: 23060614
-
Mouse genomic variation and its effect on phenotypes and gene regulation.
Nature. 2011 Sep 14;477(7364):289-94
PMID: 21921910