In this paper we report results of improving Co60Fe20B20 interface perpendicular magnetic anisotropy (PMA) by replacing neighbor oxide layer with fluoride one. We expected that fluorine as element with higher than oxide electronegativity could more effectively attract electrons from out-of-plane d orbitals of ferromagnetic, increasing role of in-plane orbitals. By this we wanted to increase PMA and its response to applied voltage bias. Polar magneto-optic Kerr effect measurement show decreasing of out-of-plane magnetic field needed to change magnetization to perpendicular in stacks with oxygen replaced by fluorine as well as increasing of coefficient of response to applied voltage α from < 10 fJ/Vm for CoFeB/Al2O3 interface to 20 fJ/Vm for CoFeB/AlF3/Al2O3 and 22 fJ/Vm for CoFeB/MgF2 stacks. Direct chemical interaction of Co with F was confirmed by x-ray photoelectron spectroscopy (XPS) measurement of Co2p core level region. Moreover angular-resolved XPS showed that F tends to stay at CoFeB interface rather than diffuse out of it.