During the coronavirus pandemic, evidence is growing that the severity, susceptibility and host immune response to SARS-CoV-2 infection can be highly variable. Several influencing factors have been discussed. Here, we investigated the humoral immune response against SARS-CoV-2 spike, S1, S2, the RBD, nucleocapsid moieties and S1 of seasonal coronaviruses: hCoV-229E, hCoV-HKU1, hCoV-NL63 and hCoV-OC43, as well as MERS-CoV and SARS-CoV, in a cohort of 512 individuals. A bead-based multiplex assay allowed simultaneous testing for all the above antigens and the identification of different antibody patterns. Then, we correlated these patterns with 11 HLA loci. Regarding the seasonal coronaviruses, we found a moderate negative correlation between antibody levels against hCoV-229E, hCoV-HKU1 and hCoV-NL63 and the SARS-CoV-2 antigens. This could be an indication of the original immunological imprinting. High and low antibody response patterns were distinguishable, demonstrating the individuality of the humoral response towards the virus. An immunogenetical factor associated with a high antibody response (formation of ≥4 different antibodies) was the presence of HLA A*26:01, C*02:02 and DPB1*04:01 alleles, whereas the HLA alleles DRB3*01:01, DPB1*03:01 and DB1*10:01 were enriched in low responders. A better understanding of this variable immune response could enable more individualized protective measures.