Echo cancellation commonly employs a double-talk detector (DTD), which is essential to keep the adaptive filter from diverging in the presence of near-end speech. An improved double-talk detection algorithm is proposed to promote the performance of the echo cancellation in teleconference system in the presence of speech issued from the near-end speaker (double-talk). Based on the partitioned block frequency domain adaptive filter algorithm (PBFDAF), the advanced double-talk detection method is presented in this paper constructs a joint correlation coefficient variable to judge the communication state and the variable is applied as a smoothing parameter to the error signal and then get the final output signal. Simulation results show that the improved algorithm can effectively detect the current voice state, eliminate the echo signal, and keep the near-end speaker’s voice well. The performance of the echo cancellation algorithm is improved when both echo and near end signals are simultaneously active by the proposed technique.