Data on immune responses following COVID-19 booster vaccinations and subsequent infections in the immunocompromised are limited. We studied antibody responses after the fourth dose and subsequent infections to define patient groups benefiting most from boosters. Fourth vaccine (booster) doses were, in Finland, first recommended for severely immunocompromised individuals, whom we invited to participate in our study in 2022. We assessed spike protein-specific IgG and neutralizing antibodies (NAb) against the ancestral and Omicron BA.1 strains one month after the fourth dose from 488 adult participants and compared them to the levels of 35 healthy controls after three doses. We used Bayesian generalized linear modeling to assess factors explaining antibody levels and assessed vaccine-induced and hybrid immunity six months after the last vaccine dose. Chronic kidney disease (CKD) and immunosuppressive therapy (IT) were identified as factors explaining sub-optimal antibody responses. The proportion of participants with a normal antibody response and NAbs was significantly lower regarding CKD patients compared to the controls. By the 6-month sampling point, one-third of the participants became infected (documented by serology and/or molecular tests), which notably enhanced antibody levels in most immunocompromised participants. Impaired antibody responses, especially NAbs against the Omicron lineage, suggest limited protection in individuals with CKD and highlight the need for alternative pharmaceutical preventive strategies. Vaccination strategies should take into account the development of robust hybrid immunity responses also among the immunocompromised.