The introduction of new type of nanomaterials has provided challenges in a deeper level understanding of mechanical behavior and failure mechanisms of fiber-reinforced composites. In this study, a comparison of low-velocity impact behavior of E-Glass epoxy composites modified with 10 wt% nanosilica and 2.5 wt% Nafen™ alumina nanofibers manufactured using vacuum-assisted resin transfer molding is reported. Low-velocity impact tests at three impact energies of 29 J, 39 J, and 50 J are conducted and impact responses, such as impact strength, absorbed energy, and damage area are determined and compared for the two nanoparticles. The damage sustained by composite samples is evaluated by optical microscopy and infrared thermography. Nanosilica-incorporated composites showed rigid behavior, whereas alumina nanofiber-modified composites showed increased stiffness at increased energy of impact as observed from the initial stiffness and deflection of samples. The degree of damage in case of 10 wt% nanosilica-modified composites is reduced by 7.04%, 3.96%, and 7.92% for energy levels of 29 J, 39 J, and 50 J respectively when compared to nonmodified composites, whereas 2.5 wt% alumina nanofiber-modified composites showed 1.66%, −7.35%, and 26.39% for energy levels of 29 J, 39 J, and 50 J, respectively.