This paper reported the Pt/AlOxNy/Ta structure with oxygen scavenging metal Ta as a top electrode in order to achieve excellent data storage and the artificial synaptic function. As a series resistance layer and a thermal enhanced layer, the TaOx interface layer between the resistance switching (RS) layer and the top electrode (TE) can greatly affect the RS characteristics. These effects can be attributed to properties of the interface layer such as thermal and electrical conductivities, suggesting that properties of the interface layer should be carefully and systematically considered if excellent RS characteristics are desirable. Based on the electrical testing and current conduction mechanism analyses, the major factors affecting the bipolar gradual RS behavior can be concluded as the property of the interface layer between the RS layer and TE, the Joule heating caused by current, and the distribution of the electric field on the interface layer.