Acrylonitrile–butadiene rubber (NBR), a synthetic rubber having C≡N dipoles, was chosen as a polymer matrix with a higher dielectric constant than other non-polar rubber like silicone rubber or ethylene–propylene–diene monomer. Barium titanate (BaTiO3), as a ferroelectric material, with a high dielectric constant and low dielectric loss was selected as a main filler to further enhance the dielectric constant of NBR. An effective silane coupling agent (KH845-4), selected from five types of silane coupling agents with different characteristic functional groups, was used to modify the surface of BaTiO3 particles to enhance its interfacial adhesion to the matrix. Fourier transform infrared spectroscopy (FTIR) was used to verify the successful modification. The addition of BaTiO3 obviously enhanced the dielectric constants. In particular, an uncommon pattern of dielectric loss has been displayed and analyzed in this paper. Nevertheless, the reinforcing effect of mechanical strength of the NBR/treated BaTiO3 composites is limited. On this basis, the addition of nanosilica (SiO2), replacing part of NBR, improved the mechanical strength. Confirmed by scanning electron microscopy (SEM), the SiO2 and treated BaTiO3 particles were dispersed well in the NBR matrix. The tensile strength was increased from 4.33 to 6.12 MPa when SiO2 accounted for 4%. Moreover, the curing characterizations, crosslinking density, resistivity, and oil resistance were evaluated. This composite material can be used in manufacturing electronic devices, which are subjected to oily environments for a long time.