A finite element model was developed using both continuum and discrete damage modeling techniques to provide detailed predictions for ply-by-ply damage progression in composite laminates during low-velocity impact (LVI) events. A new fiber failure model was incorporated into the LaRC05 failure criteria to predict fiber pull-out and fiber crushing during the fiber damage evolution. In addition, the selective range golden section search (SRGSS) algorithm was implemented to efficiently predict fiber breakage, pull-out, splitting, kinking and crushing, and matrix cracking. The delamination was captured by cohesive element layers embedded between every adjacent composite ply. The interactions of intralaminar matrix cracking and delamination were modeled by deploying cohesive elements within each composite ply. The prediction results were validated by 30 J and 75 J drop-weight tests with different-sized impactors, as well as X-Ray CT inspections on 254 mm by 304.8 mm [0/45/90/-45]4s IM7/977–3 laminates. The model predicted the maximum deflection and contact duration with <2 % error, and the peak load, damaged areas, and absorbed energy with <8 % error. The matrix fracture plane and the fiber kink band angle were found with 1° precision 48 % faster via the SRGSS algorithm. The detailed sequences of damage occurrence were predicted by analyzing the energy dissipation histories through various damage modes. Although this modeling methodology was developed for LVI scenarios, it has broad applications for predicting failures in composites.