This study compares fracture energy of an epoxy polymer from the addition of different wt% of nanoparticles, for both experimental and FEA modelling studies. Silica and core–shell rubber (CSR) particles, and the hybrid of both (from 0.5 wt% to the maximum concentration of 25.4 wt%) are used. An increase in fracture energy was found in the CSR and hybrid specimens, but clustering of particles caused a reduction in the mechanical properties when the concentration of particles was high. As there was interfacial failure found with some tapered double cantilever beam (TDCB) specimens. Therefore, the fracture energies measured with TDCB specimens are also compared with simulation results using the finite element analysis software ‘Abaqus’. These results provided further information for the next stage of investigations in fracture properties of particles modified epoxy.