In this work, we investigate the physical layer security problem of wireless cooperative network, where the communication from a source to a destination is assisted by an untrusted full-duplex amplify-and-forward (AF) relay. In order to realize a positive secrecy rate, cooperative jamming is exploited at the destination. The secrecy outage probability (SOP), connection outage probability (COP), and effective secrecy throughput (EST) are, respectively, derived in closed-form expressions for the fixed gain relaying (FGR) scheme and the variable gain relaying (VGR) scheme. Subsequently, we conduct an asymptotic analysis for both the relaying schemes in the high signal-to-noise ratio (SNR) region to offer valuable insights into practical design. Theory and simulation results demonstrate that the self-interference caused by full-duplex transmission is harmful for the reliability performance, while it is beneficial to the security performance. Moreover, the EST of the considered system increases as the self-interference level decreases, which implies that the self-interference deteriorates an overall performance in terms of the security-reliability tradeoff.