Respiratory tract infections (RTIs) in infants are often caused by viruses. Although respiratory syncytial virus (RSV), influenza virus and human metapneumovirus (hMPV) can be considered the most pathogenic viruses in children, rhinovirus (RV) is often found in asymptomatic infants as well. Little is known about the health consequences of viral presence, especially early in life. We aimed to examine the dynamics of (a)symptomatic viral presence and relate early viral detection to susceptibility to RTIs in infants. In a prospective birth cohort of 117 infants, we tested 1304 nasopharyngeal samples obtained from 11 consecutive regular sampling moments, and during acute RTIs across the first year of life for 17 respiratory viruses by quantitative PCR. Associations between viral presence, viral (sub)type, viral load, viral co-detection and symptoms were tested by generalized estimating equation (GEE) models. RV was the most detected virus. RV was negatively associated [GEE: adjusted odds ratio (aOR) 0.41 (95% CI 0.18-0.92)], and hMPV, RSV, parainfluenza 2 and 4 and human coronavirus HKU1 were positively associated with an acute RTI. Asymptomatic RV in early life was, however, associated with increased susceptibility to and recurrence of RTIs later in the first year of life (Kaplan-Meier survival analysis: P = 0.022). Respiratory viruses, including the seasonal human coronaviruses, are often detected in infants, and are often asymptomatic. Early life RV presence is, though negatively associated with an acute RTI, associated with future susceptibility to and recurrence of RTIs. Further studies on potential ecologic or immunologic mechanisms are needed to understand these observations.