The conventional approach to phase reconstruction in Reflective Ghost Imaging (RGI) typically involves the introduction of three reference screens into the reference path, deeming the Fourier transform step indispensable. However, this method introduces complexity to the system and raises concerns regarding potential errors in phase retrieval. In response to these challenges, we advocate for adopting the Five-Step Phase-Shifting (FSPS) method in the RGI system. This method presents two key advantages over traditional approaches: (1) It streamlines the phase reconstruction process by eliminating the requirement for a Fourier inverse transform. (2) It avoids the need to insert objects into the reference optical path, simplifying the computation of reference optical path intensity and enabling seamless application to Computational Ghost Imaging (CGI), overcoming the constraints of Dual-Arm Ghost Imaging (DAGI). We substantiate the theoretical proposition through numerical simulations involving two intricate objects. Furthermore, our discussion delves into exploring the influence of varying reflective angles on the phase reconstruction performance.