In this letter, we proposed a Multi-Stage phase-shifting network (MSPS-Net) based on Multi-Stage Progressive Image Restoration for one-shot phase retrieval interferometry. This network generates three interferograms with specific phase shifts from interferograms recorded in a single frame excellently, metrics such as <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">PSNR</i> and <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">SSIM</i> indicate that the generated phase shift interferograms have high similarity to the real one. Further, By analyzing different types of aberrations, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">RMS</i> value of error map retrieved by the proposed method is less than 1/200λ, which shows higher accuracy than latest phase-shifting network method built by Encoder and Decoder. All the experiment results show that our solution is available for the problem of high-accuracy dynamic phase measurement and has excellent generalization ability.