Electrocardiogram (ECG) is a measure of the electrical movement of the heart, and is obtained by surface electrodes at standardized locations on the patient’s chest. During acquisition, various artifacts/noises such as power-line interference (PLI), baseline wander (BW), muscle artifacts (MA) and motion artifacts (EM) obscure the ECG. It is important that these artifacts are minimized for the clinicians to make better diagnosis on heart problems. This paper researches the creative idea of adaptive noise cancellation (ANC) using two stage form of adaptive filters. The concept of cascading and its algorithm for real-time application is simulated on MATLAB. The proposed algorithm utilizes two adaptive filters to estimate gradients accurately which results in good adaptation and performance. The objective of the present investigation is to provide solution in order to improve the performance of noise canceller in terms of filter parameters which are obtained with the help of adaptive algorithms. Different kinds of two stage ANC algorithms are used to eliminate artifacts in ECG by considering the noises such as power line interference and baseline wander. The simulation results show that the performance of the two stage ANC is superior to the conventional single stage ANC system in terms of higher signal-to-noise ratio. Two stage adaptive algorithms are applied on real time ECG signals and compared their performance with the conventional single stage adaptive algorithms in terms of parameters Signal-to-Noise Ratio (SNR), Mean Square Error (MSE), Root Mean Square Error (RMSE) and Distortion.