Understanding the yielding and necking mechanisms of double network (DN) materials is crucial for establishing structure-property correlations. While previous studies have primarily focused on how macro-yielding behavior changes with network structure and swelling, in this work, we study the local internal damage in the pre-yielding process to unveil the yielding and necking mechanisms for typical DN gels. Through birefringence retardation imaging during tensile deformation on DN gels of various sample geometries, our findings reveal the following key points: 1) Initiation and Growth of Damage Zones: Prior to macroscopic yielding, damage zones initiate from the sample edges and gradually grow towards the sample center with elongation. 2) Rapid Propagation and Yielding: Beyond a certain stress threshold, damage zones rapidly propagate under constant loading. Two damage zones eventually merge at the sample center, resulting in yielding. 3) Intrinsic Stress Determination: The stress at this point is intrinsic and determined by the structure of the two networks. 4) Pseudo Size-Dependency: Samples with insufficient width exhibit a pseudo size-dependency of yielding stress, as yielding occurs before reaching the critical stress. To explain the origin of intrinsic yielding stress, we introduce an intrinsic effective crack length (cI) as a measure of stress concentration around the internal crack tip of the damaged zone in the first network. Beyond this length, the influence on internal stress concentration around the damage zone is effectively screened by the load-bearing effect of the stretchable second network. The estimated cI, dependent on the microstructure of the two networks, was approximately 10 times the mesh size of the first network for typical DN gels.