Head and neck squamous cell carcinoma (HNSCC) is a heterogeneous group of tumors that retain their poor prognosis despite recent advances in their standard of care. As the involvement of the immune system against HNSCC development is well-recognized, characterization of the immune signature and the complex interplay between HNSCC and the immune system could lead to the identification of novel therapeutic targets that are required now more than ever. In this study, we investigated RNA sequencing data of 530 HNSCC patients from The Cancer Genome Atlas (TCGA) for which the immune composition (CIBERSORT) was defined by the relative fractions of 10 immune-cell types and expression data of 45 immune checkpoint ligands were quantified. This initial investigation was followed by immunohistochemical (IHC) staining for a curated selection of immune cell types and checkpoint ligands markers in tissue samples of 50 advanced stage HNSCC patients. The outcome of both analyses was correlated with clinicopathological parameters and patient overall survival. Our results indicated that HNSCC tumors are in close contact with both cytotoxic and immunosuppressive immune cells. TCGA data showed prognostic relevance of dendritic cells, M2 macrophages and neutrophils, while IHC analysis associated T cells and natural killer cells with better/worse prognostic outcome. HNSCC tumors in our TCGA cohort showed differential RNA over- and underexpression of 28 immune inhibitory and activating checkpoint ligands compared to healthy tissue. Of these, CD73, CD276 and CD155 gene expression were negative prognostic factors, while CD40L, CEACAM1 and Gal-9 expression were associated with significantly better outcomes. Our IHC analyses confirmed the relevance of CD155 and CD276 protein expression, and in addition PD-L1 expression, as independent negative prognostic factors, while HLA-E overexpression was associated with better outcomes. Lastly, the co-presence of both (i) CD155 positive cells with intratumoral NK cells; and (ii) PD-L1 expression with regulatory T cell infiltration may hold prognostic value for these cohorts. Based on our data, we propose that CD155 and CD276 are promising novel targets for HNSCC, possibly in combination with the current standard of care or novel immunotherapies to come.