A computational framework for the simulation of progressive failure in composite laminates is presented. The phantom-node method (a variation to the XFEM) is used for a mesh-independent representation of matrix cracks as straight discontinuities in the displacement field. Furthermore, interface elements are used for delamination and a continuum damage model for fiber failure. The framework is validated against experimental observations for open-hole tests and compact tension tests. It is shown that different failure mechanisms are captured well, which allows for the prediction of size effects.