As for the deep tissue infections of chronic osteomyelitis, antibiotics are hard to deliver into the infected bone tissue, which makes it difficult to be cured completely in clinic. Microwave has strong penetration, and the medium can produce a good bactericidal effect through the microwave thermal effect (MTE). Here, a new microwave sensitizer (Fe3O4@APNs) was prepared and evaluated. Black phosphorus nanosheets modified with phytic acid dodecasodium (APNs) were fabricated by a liquid-phase exfoliation method that exhibited good water oxygen stability. A complex with Fe3O4 compound and APNs (Fe3O4@APNs) was formed by an ultrasonic mixing process, which showed excellent MTE (quickly increased to 53.5 °C in 5 min at 2.45 GHz, 10 W/cm2) via dielectric versus magnetic loss (reflect loss value of -5.94 dB at 2.45 GHz). The Fe3O4@APNs microwave sensitizer developed in this study has an outstanding in vitro antibacterial effect and might show promise for the treatment of chronic osteomyelitis enabled by local tissue heating via the MTE.