Solid-state electrolytes are widely anticipated to revitalize high-energy-density and high-safety lithium-ion batteries. However, low ionic conductivity and high interfacial resistance at room temperature pose challenges for their practical application. In this work, the dual-matrix concept is applied to the design of a bilayer heterogeneous structure. The electrolyte in contact with the cathode blends PVDF-HFP and oxidation-resistant PAN. In contrast, the electrolyte in contact with the anode blends PVDF-HFP and reduction-resistant PEO. A UV-curing process was used to fabricate the bilayer heterostructure electrolyte. The heterostructure electrolyte exhibits an ionic conductivity of 4.27 × 10−4 S/cm and a Li+ transference number of 0.68 at room temperature. Additionally, when assembled into LiFePO4/CPEs/Li batteries, it shows a high initial discharge capacity at room temperature (168 mAh g−1 at 0.1 C and 60 mAh g−1 at 2 C), with a capacity retention of 93.3% after 100 cycles at a current density of 0.2 C. Notably, at 60 °C, the battery maintains a discharge capacity of 90 mAh g−1 at 2 C, with a capacity retention of 97.4% after 100 cycles at 0.2 C. Therefore, solid-state batteries using this bilayer heterogeneous structure electrolyte demonstrate promising performance, including effective capacity output and cycling stability.