In this paper, the ultimate bending strength and the failure mechanism of the marine composite deck grillage structure are experimentally and numerically investigated, before the optimization design is conducted to enhance the ultimate bearing capacity. The ultimate strength experiment of the composite deck grillage structure is first carried out. Based on the improved progressive failure method and the cohesive damage theory, the numerical simulation considering fiber failure, matrix failure, shear failure and adhesive layer failure is conducted and the predicted strains, load–displacement curves, and failure modes of the specimen are compared with the experimental ones to verify the accuracy of the present method. Both experimental and predicted results show that the stiffeners and the laminated deck near the opening are the stress concentration areas, and the matrix failure is main failure mode. The optimization results show that the suitable panel thickness can reduce the stress concentration effect and avoid premature fracture in localized areas due to stress concentration. The increase of the stiffener heights can significantly increase the ultimate strength and the bending stiffness. These findings can provide support for the design of composite deck grillage structures in ships.