Target-decoy Approach Research Articles

NeoMS: Mass Spectrometry-based Method for Uncovering Mutated MHC-I Neoantigens.

Major Histocompatibility Complex (MHC) molecules play a critical role in the immune system by presenting peptides on the cell surface for recognition by T-cells. Tumor cells often produce MHC peptides with amino acid mutations, known as neoantigens, which evade T-cell recognition, leading to rapid tumor growth. In immunotherapies such as TCR-T and CAR-T, identifying these mutated MHC peptide sequences is crucial. Current mass spectrometry-based peptide identification methods primarily rely on database searching, which fails to detect mutated peptides not present in human databases. In this paper, we propose a novel workflow called NeoMS, designed to efficiently identify both non-mutated and mutated MHC-I peptides from mass spectrometry data. NeoMS utilizes a tagging algorithm to generate an expanded sequence database that includes potential mutated proteins for each sample. Furthermore, it employs a machine learning-based scoring function for each peptide-spectrum match (PSM) to maximize search sensitivity. Finally, a rigorous target-decoy approach is implemented to control the false discovery rates (FDR) of the peptides with and without mutations separately. Experimental results for regular peptides demonstrate that NeoMS outperforms four benchmark methods. For mutated peptides, NeoMS successfully identifies hundreds of high-quality mutated peptides in a melanoma-associated sample, with their validity confirmed by further studies.

An algorithm for decoy-free false discovery rate estimation in XL-MS/MS proteomics.

Cross-linking tandem mass spectrometry (XL-MS/MS) is an established analytical platform used to determine distance constraints between residues within a protein or from physically interacting proteins, thus improving our understanding of protein structure and function. To aid biological discovery with XL-MS/MS, it is essential that pairs of chemically linked peptides be accurately identified, a process that requires: (i) database search, that creates a ranked list of candidate peptide pairs for each experimental spectrum and (ii) false discovery rate (FDR) estimation, that determines the probability of a false match in a group of top-ranked peptide pairs with scores above a given threshold. Currently, the only available FDR estimation mechanism in XL-MS/MS is the target-decoy approach (TDA). However, despite its simplicity, TDA has both theoretical and practical limitations that impact the estimation accuracy and increase run time over potential decoy-free approaches (DFAs). We introduce a novel decoy-free framework for FDR estimation in XL-MS/MS. Our approach relies on multi-sample mixtures of skew normal distributions, where the latent components correspond to the scores of correct peptide pairs (both peptides identified correctly), partially incorrect peptide pairs (one peptide identified correctly, the other incorrectly), and incorrect peptide pairs (both peptides identified incorrectly). To learn these components, we exploit the score distributions of first- and second-ranked peptide-spectrum matches for each experimental spectrum and subsequently estimate FDR using a novel expectation-maximization algorithm with constraints. We evaluate the method on ten datasets and provide evidence that the proposed DFA is theoretically sound and a viable alternative to TDA owing to its good performance in terms of accuracy, variance of estimation, and run time. https://github.com/shawn-peng/xlms.

MS Annika 2.0 Identifies Cross-Linked Peptides in MS2-MS3-Based Workflows at High Sensitivity and Specificity.

Cross-linking mass spectrometry has become a powerful tool for the identification of protein-protein interactions and for gaining insight into the structures of proteins. We previously published MS Annika, a cross-linking search engine which can accurately identify cross-linked peptides in MS2 spectra from a variety of different MS-cleavable cross-linkers. In this publication, we present MS Annika 2.0, an updated version implementing a new search algorithm that, in addition to MS2 level, only supports the processing of data from MS2-MS3-based approaches for the identification of peptides from MS3 spectra, and introduces a novel scoring function for peptides identified across multiple MS stages. Detected cross-links are validated by estimating the false discovery rate (FDR) using a target-decoy approach. We evaluated the MS3-search-capabilities of MS Annika 2.0 on five different datasets covering a variety of experimental approaches and compared it to XlinkX and MaXLinker, two other cross-linking search engines. We show that MS Annika detects up to 4 times more true unique cross-links while simultaneously yielding less false positive hits and therefore a more accurate FDR estimation than the other two search engines. All mass spectrometry proteomics data along with result files have been deposited to the ProteomeXchange consortium via the PRIDE partner repository with the dataset identifier PXD041955.

DeepFLR facilitates false localization rate control in phosphoproteomics

Protein phosphorylation is a post-translational modification crucial for many cellular processes and protein functions. Accurate identification and quantification of protein phosphosites at the proteome-wide level are challenging, not least because efficient tools for protein phosphosite false localization rate (FLR) control are lacking. Here, we propose DeepFLR, a deep learning-based framework for controlling the FLR in phosphoproteomics. DeepFLR includes a phosphopeptide tandem mass spectrum (MS/MS) prediction module based on deep learning and an FLR assessment module based on a target-decoy approach. DeepFLR improves the accuracy of phosphopeptide MS/MS prediction compared to existing tools. Furthermore, DeepFLR estimates FLR accurately for both synthetic and biological datasets, and localizes more phosphosites than probability-based methods. DeepFLR is compatible with data from different organisms, instruments types, and both data-dependent and data-independent acquisition approaches, thus enabling FLR estimation for a broad range of phosphoproteomics experiments.

Quality Control for the Target Decoy Approach for Peptide Identification.

Reliable peptide identification is key in mass spectrometry (MS) based proteomics. To this end, the target decoy approach (TDA) has become the cornerstone for extracting a set of reliable peptide-to-spectrum matches (PSMs) that will be used in downstream analysis. Indeed, TDA is now the default method to estimate the false discovery rate (FDR) for a given set of PSMs, and users typically view it as a universal solution for assessing the FDR in the peptide identification step. However, the TDA also relies on a minimal set of assumptions, which are typically never verified in practice. We argue that a violation of these assumptions can lead to poor FDR control, which can be detrimental to any downstream data analysis. We here therefore first clearly spell out these TDA assumptions, and introduce TargetDecoy, a Bioconductor package with all the necessary functionality to control the TDA quality and its underlying assumptions for a given set of PSMs.

Protein Probability Model for High-Throughput Protein Identification by Mass Spectrometry-Based Proteomics.

Shotgun proteomics is the method of choice for high-throughput protein identification; however, robust statistical methods are essential to automatize this task while minimizing the number of false identifications. The standard method for estimating the false discovery rate (FDR) of individual identifications and keeping it below a threshold (typically 1%) is the target-decoy approach. However, numerous works have shown that FDR at the protein level may become much larger than FDR at the peptide level. The development of an appropriate scoring model to identify proteins from their peptides using high-throughput shotgun proteomics is highly needed. In this study, we present a novel protein-level scoring algorithm that uses the scores of the identified peptides and maintains all of the properties expected for a true protein probability. We also present a refinement of the picked method to calculate FDR at the protein level. These algorithms can be used together as a robust identification workflow suitable for large-scale proteomics, and we show that the identification performance of this workflow is superior to that of other widely used methods in several samples and using different search engines. Our protein probability model offers the scientific community an algorithm that is easy to integrate into protein identification workflows for the automated analysis of shotgun proteomics data.

OCCAM: prediction of small ORFs in bacterial genomes by means of a target-decoy database approach and machine learning techniques.

Small open reading frames (ORFs) have been systematically disregarded by automatic genome annotation. The difficulty in finding patterns in tiny sequences is the main reason that makes small ORFs to be overlooked by computational procedures. However, advances in experimental methods show that small proteins can play vital roles in cellular activities. Hence, it is urgent to make progress in the development of computational approaches to speed up the identification of potential small ORFs. In this work, our focus is on bacterial genomes. We improve a previous approach to identify small ORFs in bacteria. Our method uses machine learning techniques and decoy subject sequences to filter out spurious ORF alignments. We show that an advanced multivariate analysis can be more effective in terms of sensitivity than applying the simplistic and widely used e-value cutoff. This is particularly important in the case of small ORFs for which alignments present higher e-values than usual. Experiments with control datasets show that the machine learning algorithms used in our method to curate significant alignments can achieve average sensitivity and specificity of 97.06% and 99.61%, respectively. Therefore, an important step is provided here toward the construction of more accurate computational tools for the identification of small ORFs in bacteria.

False Discovery Rate Estimation for Hybrid Mass Spectral Library Search Identifications in Bottom-up Proteomics.

We present a method for FDR estimation of mass spectral library search identifications made by a recently developed method for peptide identification, the hybrid search, based on an extension of the target-decoy approach. In addition to estimating confidence for a given identification, this allows users to compare and integrate identifications from the hybrid mass spectral library search method with other peptide identification methods, such as a sequence database-based method. In addition to a score, each hybrid score is associated with a "DeltaMass" value, which is the difference in mass of the search and library peptide, which can correspond to the mass of a modification. We explored the relation between FDR and DeltaMass using 100 concatenated random decoy libraries and discovered that a small number of DeltaMass values were especially likely to result from decoy searches. Using these values, FDR values could be adjusted for these specific values and a reliable FDR generated for any DeltaMass value. Finally, using this method, we find and examine common, reliable identifications made by the hybrid search for a range of proteomic studies.

PValid: Validation Beyond the Target-Decoy Approach for Peptide Identification in Shotgun Proteomics.

As the de facto validation method in mass spectrometry-based proteomics, the target-decoy approach determines a threshold to estimate the false discovery rate and then filters those identifications beyond the threshold. However, the incorrect identifications within the threshold are still unknown and further validation methods are needed. In this study, we characterized a framework of validation and investigated a number of common and novel validation methods. We first defined the accuracy of a validation method by its false-positive rate (FPR) and false-negative rate (FNR) and, further, proved that a validation method with lower FPR and FNR led to identifications with higher sensitivity and precision. Then we proposed a validation method named pValid that incorporated an open database search and a theoretical spectrum prediction strategy via a machine-learning technology. pValid was compared with four common validation methods as well as a synthetic peptide validation method. Tests on three benchmark data sets indicated that pValid had an FPR of 0.03% and an FNR of 1.79% on average, both superior to the other four common validation methods. Tests on a synthetic peptide data set also indicated that the FPR and FNR of pValid were better than those of the synthetic peptide validation method. Tests on a large-scale human proteome data set indicated that pValid successfully flagged the highest number of incorrect identifications among all five methods. Further considering its cost-effectiveness, pValid has the potential to be a feasible validation tool for peptide identification.

Pytheas: A Software to Map RNA Modifications via Tandem Mass Spectrometry

Ribonucleic acids (RNA) such as ribosomal RNA (rRNA) and messenger RNA (mRNA) are decorated at the post-transcriptional level by more than 150 characterized chemical modifications. These modifications range from positional isomerization to the addition of complex chemical groups to nucleosides. In the last decades, RNA modifications have been shown to enhance RNAs structural diversity and their intramolecular interactions, as well as promoting RNA diverse functions within complex regulatory networks involved in cellular metabolism. To characterize and quantify RNA modifications, tandem Mass Spectrometry (MS/MS) has been proven to be a powerful and flexible analytical tool. We present here a novel software pipeline, Pytheas, to assist in the interpretation of MS/MS data with the goal to characterize modified RNAs. Through an interactive multi-step process, Pytheas generates a theoretical database from arbitrary RNA sequences and the user-defined parameters such as digestion enzymes, nucleotide chemical compositions and isotopic labeling. Then it uses an empirical scoring function derived from the SEQUEST proteomics platform to score measured MS/MS spectra vs the theoretical library, adopting the target-decoy approach for the false discovery rate (FDR) estimation. The final steps allow visualization of the scored spectra and map the modifications on the RNA sequence. Pytheas is freely available, easy to use and highly customizable; at any step the user can set parameters relevant for their experiments, such as type and number of modifications or instrument-based uncertainty windows on m/z measurements. The applicability of Pytheas has been tested using the Liquid Chromatography MS/MS datasets acquired on different instruments, and was successful in mapping known and discover novel modifications present in tRNAs and B. subtilis 16S and 23S RNA.

Detecting protein variants by mass spectrometry: a comprehensive study in cancer cell-lines

BackgroundOnco-proteogenomics aims to understand how changes in a cancer’s genome influences its proteome. One challenge in integrating these molecular data is the identification of aberrant protein products from mass-spectrometry (MS) datasets, as traditional proteomic analyses only identify proteins from a reference sequence database.MethodsWe established proteomic workflows to detect peptide variants within MS datasets. We used a combination of publicly available population variants (dbSNP and UniProt) and somatic variations in cancer (COSMIC) along with sample-specific genomic and transcriptomic data to examine proteome variation within and across 59 cancer cell-lines.ResultsWe developed a set of recommendations for the detection of variants using three search algorithms, a split target-decoy approach for FDR estimation, and multiple post-search filters. We examined 7.3 million unique variant tryptic peptides not found within any reference proteome and identified 4771 mutations corresponding to somatic and germline deviations from reference proteomes in 2200 genes among the NCI60 cell-line proteomes.ConclusionsWe discuss in detail the technical and computational challenges in identifying variant peptides by MS and show that uncovering these variants allows the identification of druggable mutations within important cancer genes.

Unbiased False Discovery Rate Estimation for Shotgun Proteomics Based on the Target-Decoy Approach.

Target-decoy approach (TDA) is the dominant strategy for false discovery rate (FDR) estimation in mass-spectrometry-based proteomics. One of its main applications is direct FDR estimation based on counting of decoy matches above a certain score threshold. The corresponding equations are widely employed for filtering of peptide or protein identifications. In this work we consider a probability model describing the filtering process and find that, when decoy counting is used for q value estimation and subsequent filtering, a correction has to be introduced into these common equations for TDA-based FDR estimation. We also discuss the scale of variance of false discovery proportion (FDP) and propose using confidence intervals for more conservative FDP estimation in shotgun proteomics. The necessity of both the correction and the use of confidence intervals is especially pronounced when filtering small sets (such as in proteogenomics experiments) and when using very low FDR thresholds.

GroupFilter: A software tool for efficient filtering of Morpheus search engine results

Morpheus is a search algorithm developed recently for high-resolution tandem mass spectra. According to the developers, its intrinsic property is discriminating short sequence length peptides. Therefore, elimination of direct comparisons between peptide spectrum matches (PSMs) for short and long peptides may potentially increase the search sensitivity for a given FDR level. In the proposed approach, all PSMs are grouped according to the number of matched fragment ions, followed by separate filtering of identifications in each group using target-decoy approach. The approach is applied to Morpheus output results and does not cause a significant increase in the overall data analysis time. The proposed approach was implemented as a Python command-line tool, called GroupFilter. Several data sets from different types of mass spectrometers were used for testing of the software, including the data from the original Morpheus search engine paper. Separate FDR filtering for grouped identifications increased the number of identified peptides by up to 18% compared with the default Morpheus post-processing procedure. The proposed approach can be considered as an addition to the Morpheus search engine.

Adaptation of Decoy Fusion Strategy for Existing Multi-Stage Search Workflows.

A number of proteomic database search engines implement multi-stage strategies aiming at increasing the sensitivity of proteome analysis. These approaches often employ a subset of the original database for the secondary stage of analysis. However, if target-decoy approach (TDA) is used for false discovery rate (FDR) estimation, the multi-stage strategies may violate the underlying assumption of TDA that false matches are distributed uniformly across the target and decoy databases. This violation occurs if the numbers of target and decoy proteins selected for the second search are not equal. Here, we propose a method of decoy database generation based on the previously reported decoy fusion strategy. This method allows unbiased TDA-based FDR estimation in multi-stage searches and can be easily integrated into existing workflows utilizing popular search engines and post-search algorithms. Graphical Abstract ᅟ.

Large Scale Mass Spectrometry-based Identifications of Enzyme-mediated Protein Methylation Are Subject to High False Discovery Rates

All large scale LC-MS/MS post-translational methylation site discovery experiments require methylpeptide spectrum matches (methyl-PSMs) to be identified at acceptably low false discovery rates (FDRs). To meet estimated methyl-PSM FDRs, methyl-PSM filtering criteria are often determined using the target-decoy approach. The efficacy of this methyl-PSM filtering approach has, however, yet to be thoroughly evaluated. Here, we conduct a systematic analysis of methyl-PSM FDRs across a range of sample preparation workflows (each differing in their exposure to the alcohols methanol and isopropyl alcohol) and mass spectrometric instrument platforms (each employing a different mode of MS/MS dissociation). Through (13)CD3-methionine labeling (heavy-methyl SILAC) of Saccharomyces cerevisiae cells and in-depth manual data inspection, accurate lists of true positive methyl-PSMs were determined, allowing methyl-PSM FDRs to be compared with target-decoy approach-derived methyl-PSM FDR estimates. These results show that global FDR estimates produce extremely unreliable methyl-PSM filtering criteria; we demonstrate that this is an unavoidable consequence of the high number of amino acid combinations capable of producing peptide sequences that are isobaric to methylated peptides of a different sequence. Separate methyl-PSM FDR estimates were also found to be unreliable due to prevalent sources of false positive methyl-PSMs that produce high peptide identity score distributions. Incorrect methylation site localizations, peptides containing cysteinyl-S-β-propionamide, and methylated glutamic or aspartic acid residues can partially, but not wholly, account for these false positive methyl-PSMs. Together, these results indicate that the target-decoy approach is an unreliable means of estimating methyl-PSM FDRs and methyl-PSM filtering criteria. We suggest that orthogonal methylpeptide validation (e.g. heavy-methyl SILAC or its offshoots) should be considered a prerequisite for obtaining high confidence methyl-PSMs in large scale LC-MS/MS methylation site discovery experiments and make recommendations on how to reduce methyl-PSM FDRs in samples not amenable to heavy isotope labeling. Data are available via ProteomeXchange with the data identifier PXD002857.

DecoyPyrat: Fast Non-redundant Hybrid Decoy Sequence Generation for Large Scale Proteomics.

Accurate statistical evaluation of sequence database peptide identifications from tandem mass spectra is essential in mass spectrometry based proteomics experiments. These statistics are dependent on accurately modelling random identifications. The target-decoy approach has risen to become the de facto approach to calculating FDR in proteomic datasets. The main principle of this approach is to search a set of decoy protein sequences that emulate the size and composition of the target protein sequences searched whilst not matching real proteins in the sample. To do this, it is commonplace to reverse or shuffle the proteins and peptides in the target database. However, these approaches have their drawbacks and limitations. A key confounding issue is the peptide redundancy between target and decoy databases leading to inaccurate FDR estimation. This inaccuracy is further amplified at the protein level and when searching large sequence databases such as those used for proteogenomics. Here, we present a unifying hybrid method to quickly and efficiently generate decoy sequences with minimal overlap between target and decoy peptides. We show that applying a reversed decoy approach can produce up to 5% peptide redundancy and many more additional peptides will have the exact same precursor mass as a target peptide. Our hybrid method addresses both these issues by first switching proteolytic cleavage sites with preceding amino acid, reversing the database and then shuffling any redundant sequences. This flexible hybrid method reduces the peptide overlap between target and decoy peptides to about 1% of peptides, making a more robust decoy model suitable for large search spaces. We also demonstrate the anti-conservative effect of redundant peptides on the calculation of q-values in mouse brain tissue data.

Revisiting peptide identification by high-accuracy mass spectrometry: problems associated with the use of narrow mass precursor windows.

Peptide identification is increasingly achieved through database searches in which mass precursor tolerance is set in the ppm range. This trend is driven by the high resolution and accuracy of modern mass spectrometers and the belief that the quality of peptide identification is fully controlled by estimating the false discovery rate (FDR) using the decoy-target approach. However, narrowing mass tolerance decreases the number of sequence candidates, and several authors have raised concerns that these search conditions can introduce inaccuracies. Here, we demonstrate that when scores that only depend on one sequence candidate are used, decoy-based estimates of the number of false positive identifications are accurate even with an average number of candidates of just 200, to the point that remarkably accurate FDR predictions can be made in completely different search conditions. However, when scores that are constructed taking information from additional sequence candidates are used together with low precursor mass tolerances, the proportion of peptides incorrectly identified may become significantly higher than the FDR estimated by the target-decoy approach. Our results suggest that with this kind of score the high mass accuracy of modern mass spectrometers should be exploited by using wide mass windows followed by postscoring mass filtering algorithms.

Computational Framework for Identification of Intact Glycopeptides in Complex Samples

Glycosylation is an important protein modification that involves enzymatic attachment of sugars to amino acid residues. Understanding the structure of these sugars and the effects of glycosylation are vital for developing indicators of disease development and progression. Although computational methods based on mass spectrometric data have proven to be effective in monitoring changes in the glycome, developing such methods for the glycoproteome are challenging, largely due to the inherent complexity in simultaneously studying glycan structures with their corresponding glycosylation sites. This paper introduces a computational framework for identifying intact N-linked glycopeptides, i.e. glycopeptides with N-linked glycans attached to their glycosylation sites, in complex proteome samples. Scoring algorithms are presented for tandem mass spectra of glycopeptides resulting from collision-induced dissociation (CID), higher-energy C-trap dissociation (HCD), and electron transfer dissociation (ETD) fragmentation modes. An empirical false-discovery rate estimation method, based on a target-decoy search approach, is derived for assigning confidence. The power of our method is further enhanced when multiple data sets are pooled together to increase identification confidence. Using this framework, 103 highly confident N-linked glycopeptides from 53 sites across 33 glycoproteins were identified in complex human serum proteome samples using conventional proteomic platforms with standard depletion of the 7-most abundant proteins. These results indicate that our method is ready to be used for characterizing site-specific protein glycosylation in complex samples.

LuciPHOr: Algorithm for Phosphorylation Site Localization with False Localization Rate Estimation Using Modified Target-Decoy Approach

The localization of phosphorylation sites in peptide sequences is a challenging problem in large-scale phosphoproteomics analysis. The intense neutral loss peaks and the coexistence of multiple serine/threonine and/or tyrosine residues are limiting factors for objectively scoring site patterns across thousands of peptides. Various computational approaches for phosphorylation site localization have been proposed, including Ascore, Mascot Delta score, and ProteinProspector, yet few address direct estimation of the false localization rate (FLR) in each experiment. Here we propose LuciPHOr, a modified target-decoy-based approach that uses mass accuracy and peak intensities for site localization scoring and FLR estimation. Accurate estimation of the FLR is a difficult task at the individual-site level because the degree of uncertainty in localization varies significantly across different peptides. LuciPHOr carries out simultaneous localization on all candidate sites in each peptide and estimates the FLR based on the target-decoy framework, where decoy phosphopeptides generated by placing artificial phosphorylation(s) on non-candidate residues compete with the non-decoy phosphopeptides. LuciPHOr also reports approximate site-level confidence scores for all candidate sites as a means to localize additional sites from multiphosphorylated peptides in which localization can be partially achieved. Unlike the existing tools, LuciPHOr is compatible with any search engine output processed through the Trans-Proteomic Pipeline. We evaluated the performance of LuciPHOr in terms of the sensitivity and accuracy of FLR estimates using two synthetic phosphopeptide libraries and a phosphoproteomic dataset generated from complex mouse brain samples.

Automated Assignments of N- and O-Site Specific Glycosylation with Extensive Glycan Heterogeneity of Glycoprotein Mixtures

Site-specific glycosylation (SSG) of glycoproteins remains a considerable challenge and limits further progress in the areas of proteomics and glycomics. Effective methods require new approaches in sample preparation, detection, and data analysis. While the field has advanced in sample preparation and detection, automated data analysis remains an important goal. A new bioinformatics approach implemented in software called GP Finder automatically distinguishes correct assignments from random matches and complements experimental techniques that are optimal for glycopeptides, including nonspecific proteolysis and high mass resolution liquid chromatography/tandem mass spectrometry (LC/MS/MS). SSG for multiple N- and O-glycosylation sites, including extensive glycan heterogeneity, was annotated for single proteins and protein mixtures with a 5% false-discovery rate, generating hundreds of nonrandom glycopeptide matches and demonstrating the proof-of-concept for a self-consistency scoring algorithm shown to be compliant with the target-decoy approach (TDA). The approach was further applied to a mixture of N-glycoproteins from unprocessed human milk and O-glycoproteins from very-low-density-lipoprotein (vLDL) particles.