Background The effect of maternal vitamin D levels on the birth weight of the offspring remains controversial, as the results are inconsistent between different populations. This large retrospective cohort study aimed to assess the relationship between maternal vitamin D levels and birth weight of neonates in southern China. Methods Serum samples were collected from 10,586 Chinese women at 13–27 weeks of pregnancy, and the 25-hydroxyvitamin D (25(OH)D) level of the participants was assessed. Using the INTERGROWTH-21st standards, the offspring were classified into three groups based on their gestational age and birth weight, which were small for gestational age (SGA), appropriate for gestational age (AGA), and large for gestational age (LGA). The differences in vitamin D levels among the different groups were compared, and their correlation with newborn birth weight was analyzed. Results The average maternal vitamin D concentration was 61.1 nmol/L. The 25(OH)D concentrations were 50–75 nmol/L, 25–50 nmol/L and below 25 nmol/L in 45.5%, 29.5%, and 1.6% of the participants, respectively. No significant differences were observed in the vitamin D levels between the three groups. With the increase in 25(OH)D levels, the risk of SGA and LGA tended to increase and decrease, respectively. AGA was not affected by the 25(OH)D levels. The results of the curve fitting and threshold effect analyses did not support the correlation between vitamin D levels and SGA or LGA. Based on the univariate prediction model and the model adjusted for risk factors, the area under the curve was extremely small. Thus, 25(OH)D levels are not an effective predictor of SGA and LGA. Conclusions Low maternal vitamin D levels were not associated with SGA or LGA.