Each accompanying coordinate expansion (ACE) formula is derived for each of the orbit-orbit interaction, the spin-orbit coupling, the spin-spin coupling, and the contact interaction integrals over the gauge-including atomic orbitals (GIAOs) by the use of the solid harmonic gradient (SHG) operator. Each ACE formula is the general formula derived at the first time for each of the above molecular integrals over GIAOs. These molecular integrals are arising in the Breit-Pauli two-electron interaction for a relativistic calculation. We may conclude that we can derive a certain ACE formula for any kind of molecular integral over solid harmonic Gaussian-type orbitals by using the SHG operator. The present ACE formulas will be useful, for example, for a calculation of a molecule in a uniform magnetic field, for a relativistic calculation, and so on, with the GIAO as a basis function.