SARS-CoV-2 plasma viremia has been associated with severe disease and death in COVID-19. However, the effects of viremia on immune responses in blood cells remain unclear. The current study comprehensively examined transcriptional signatures of PBMCs involving T cells, B cells, NK cells, monocytes, myeloid dendritic cells (mDCs), and plasmacytoid dendritic cells (pDCs) respectively, from three different groups including individuals with moderate (nM), or severe disease with (vS) or without (nS) detectable plasma viral load. Whole transcriptome analysis demonstrated that all seven immune cell subsets were associated with disease severity regardless of cell type. Supervised clustering analysis demonstrated that mDCs and pDCs gene signatures could distinguish disease severity. Notably, transcriptional signatures of the vS group were enriched in pathways related to DNA repair, E2F targets, and G2M checkpoints; in contrast, transcriptional signatures of the nM group were enriched in interferon responses. Moreover, we observed an impaired induction of interferon responses accompanied by imbalanced cell-intrinsic immune sensing and an excessive inflammatory response in patients with severe disease (nS and vS). In sum, our study provides detailed insights into the systemic immune response to SARS-CoV-2 infection and reveals profound alterations in seven major immune cells in COVID-19 patients.