To capture the uniaxial compression fracture of concrete composite is still a great challenging problem. To this end, the newly proposed nonlocal macro–meso-scale consistent damage (NMMD) model is extended to simulate uniaxial compression fracture of concrete composites. In the NMMD model, a mesoscopic structure composed of material point pairs is attached to each material point. A decomposition scheme suitable for masonry-like materials is adopted to decompose the elongation quantity of point pairs. The topologic damage is defined as the weighted summation of mesoscopic damage in neighboring material point pairs driven by the decomposed elongation quantity. The physically-based energetic degradation function is employed to bridge the geometric discontinuity in solids and the energy dissipation, and thus the topologic damage is integrated into the framework of continuum damage mechanics. The Monte-Carlo method and two-phase random field model are employed to generate stochastic circular and irregular aggregates representing the meso structure of concrete, respectively. The interface transition zone is prescribed by reducing the critical value of interface point pairs. Numerical results indicate that both the crack patterns and stress–strain curves of the uniaxial compression experiments on concrete panels can be well captured by the proposed NMMD model without mesh size sensitivity. The influence of horizontal constraints on the top and bottom surfaces is investigated and shown to have an effect on the crack patterns, strength and deformation capability of the specimen. The necessity of decomposition is also illustrated.