The microfluidic chip-based nucleic acid detection method significantly improves the sensitivity since it precisely controls the microfluidic flow in microchannels. Nonetheless, significant challenges still exist in improving the detection efficiency to meet the demand for rapid detection of trace substances. This work provides a novel magnetic herringbone (M-HB) structure in a microfluidic chip, and its advantage in rapid and sensitive detection is verified by taking complementary DNA (cDNA) sequences of human immunodeficiency virus (HIV) detection as an example. The M-HB structure is designed based on controlling the magnetic field distribution in the micrometer scale and is formed by accumulation of magnetic microbeads (MMBs). Hence, M-HB is similar to a nanopore microstructure, which has a higher contact area and probe density. All of the above is conducive to improving sensitivity in microfluidic chips. The M-HB chip is stable and easy to form, which can linearly detect cDNA sequences of HIV quantitatively ranging from 1 to 20 nM with a detection limit of 0.073 nM. Compared to the traditional herringbone structure, this structure is easier to form and release by controlling the magnetic field, which is flexible and helps in further study. Results show that this chip can sensitively detect the cDNA sequences of HIV in blood samples, demonstrating that it is a powerful platform to rapidly and sensitively detect multiple nucleic acid-related viruses of infectious diseases.