In recent years, the response-controlled stepped-sine testing (RCT) method has made important contributions to the evolution of the single nonlinear mode (SNM) method from a postulate to a well-established theory with the accurate modal identification of various nonlinear mechanical systems ranging from simple benchmark beams to real missiles. Since the RCT method resides on the SNM theory which is based on Rosenberg’s periodic motion definition of nonlinear modes, it has been regarded as limited to weakly damped mechanical systems that mainly exhibit strong conservative nonlinearities. An important contribution of this current paper is extending the RCT method to non-conservative mechanical systems with complex nonlinear modes. The extension is first numerically validated on a strongly friction-damped cantilever beam and then experimentally validated on the actuation mechanism of a real control fin that exhibits strong softening-stiffening nonlinearity (up to 50% shift of natural frequency) due to friction/backlash and very high and nonlinear damping (up to 30% modal damping ratio) due to friction. Another important contribution of this paper is to demonstrate the applicability of the superposition principle in nonlinear dissipative systems with closely spaced modes at an acceptable accuracy if the nonlinear modes are similar in shape to their corresponding linear modes and the modal coupling terms in the equation of motion can be ignored. The assumption of similar nonlinear modes is reasonable for most practical applications that exhibit dissipative nonlinearities due to mechanical joints. Although the assumption of ignorable coupling terms does not reside on a solid theoretical framework, numerical studies on a friction-damped lumped system with closely spaced modes give promising results, pointing to the significant potential of the modal superposition in nonlinear systems.