Contractions of gauge models with orthogonal Cayley-Klein groups SO(2; ϵ), SO(3; ϵ), unitary groups SU(2; ϵ) as gauge groups are studied. In the limit of zero contraction parameters, orthogonal groups are isomorphic to the nonsemisimple Euclidean and Newton groups of the corresponding dimension, and the spaces of matter fields become fibered spaces with a degenerate metric. Particular attention is paid to the coordination of spontaneous symmetry breaking with the group contraction procedure. It is shown that contracted gauge theories describe the same set of fields with the same masses as theories with the original simple groups, if the chosen vacuum in the corresponding limit belonged to the base of the fibered space of matter fields. Lagrangians of the models depending on the contraction parameters are obtained, which makes it possible to trace the order of zeroing of terms in the Lagrangians as the contraction parameters tend to zero.