Few-layer black phosphorus (FLBP) is a highly promising material for high sensitivity label-free surface plasmon resonance (SPR) sensors due to its exceptional electrical, optical, and mechanical properties. FLBP exhibits inherent anisotropy with different refractive indices along its two main crystal orientations, the zigzag and armchair axes. However, this anisotropic property is often overlooked in FLBP-based sensors. In this study, we conducted a comprehensive investigation of the SPR reflectivity and phase in a BK7-Ag-FLBP structure to understand the influence of the stacking sequence and the number of FLBP layers on the sensing performance. Clear resonant angle shifts caused by different stacking sequences of FLBP could be observed both theoretically and experimentally. In the theoretical study, the highest reflective and phase sensitivities were achieved with a 12-layer black phosphorus (BP) structure. The reflectivity sensitivity reached 287.9°/refractive index units (RIU) with the zz stacking 12-layer BP film exhibiting a sensitivity 76°/RIU higher than the ac stacking structure. Similarly, the phase sensitivity reached 1162°/RIU with the zz stacking 12-layer BP structure showing a sensitivity 276.9°/RIU higher than the ac stacking structure. The electric field distribution of the 12-layer BP structure with four different stacking sequences has also been analyzed. In the experiment study, the well-known Attenuated Total Reflection (ATR) θ-2θ SPR setup is utilized to detect the reflectivity and phase of BK7-Ag-FLBP structures. The FLBP samples with the same thickness but different stacking sequences show significant resonant angle shift (0.275°) and maximum phase difference variation (34.6°). The FLBP sample thickness and crystal orientations have been demonstrated using the angular-resolved polarized Raman spectroscopy (ARPRS). These theoretical and experimental results provide strong evidence that the stacking sequences of FLBP have a significant impact on the sensing performance of SPR sensors. By harnessing the anisotropic properties of materials like FLBP, novel structures of anisotropic-2D material-based SPR sensors could open up exciting possibilities for innovative applications.