We aimed to investigate the optimal range of gestational weight gain (GWG) for Japanese underweight (body mass index <18.5 kg/m2) women using the Japanese Birth Registry System. The study subjects included underweight women who were divided into groups according to the GWG recommendations of the Ministry of Health, Labour and Welfare (MHLW) (9–12 kg): <9.0 kg, group A; 9–12 kg, group B; and >12 kg, group C. The subjects were then classified according to the recommendations of the Institute of Medicine (IOM) (12.7–18.1 kg): <12.7 kg, group D; 12.7–18.1 kg, group E; and >18.1 kg, group F. In total, 148,135 cases were analysed. The frequencies of small for gestational age, preterm delivery, and caesarean delivery were as follows: 19.3%, 22.7%, and 28.5% for group A; 11.7%, 8.7%, and 22.8% for group B; 8.0%, 4.9%, and 21.5% for group C; 15.0%, 14.7%, and 25.2% for group D; 8.0%, 5.3%, and 21.5% for group E; and 7.0%, 5.5%, and 25.0% for group F, respectively. These results indicated that groups C and E had the best outcomes. Therefore, the IOM guidelines seem more appropriate than the MHLW guidelines. Therefore, the MHLW recommended GWG guidelines require revision.