We study the behavior of the first and second solution moments for linear stochastic differential delay equations in the presence of additive or multiplicative white and colored noise. In the presence of additive noise (white or colored), the stability domain of both moments is identical to that of the unperturbed system. When these moments lose stability, there is a Hopf bifurcation and the first moment oscillates with a period identical to the solution of the unperturbed equation, while the oscillation period of the second moment is exactly one half the period of the unperturbed solution and the first moment. When perturbations are of the parametric (or multiplicative) type and white noise is assumed, under the It\^o interpretation the first moment of the solution preserves properties of the solution of the deterministic equation, while the behavior of the second moment depends on the amplitude of the stochastic perturbation. The critical delay value at which the second moment loses stability and becomes oscillating is derived, and it is less than the critical delay for the first moment. Under the Stratonovich interpretation, quite different properties were observed for the moment equations, namely, various critical values of the delay and period of oscillations. For the case of parametric colored noise perturbations, sufficient (p-stability) conditions are derived which are independent of the value of delay, and it is shown that colored noise has a stabilizing effect with respect to white noise.