The hyperbolic cosine function with high-order errors can be utilized to improve the accuracy of adaptive filters. However, when initial weight errors are large, the hyperbolic cosine-based adaptive filter (HCAF) may be unstable. In this paper, a novel normalization based on the logarithmic hyperbolic cosine function is proposed to achieve the stabilization for the case of large initial weight errors, which generates a logarithmic HCAF (LHCAF). Actually, the cost function of LHCAF is the logarithmic hyperbolic cosine function that is robust to large errors and smooth to small errors. The transient and steady-state analyses of LHCAF in terms of the mean-square deviation (MSD) are performed for a stationary white input with an even probability density function in a stationary zero-mean white noise. The convergence and stability of LHCAF can be therefore guaranteed as long as the filtering parameters satisfy certain conditions. The theoretical results based on the MSD are supported by the simulations. In addition, a variable scaling factor and step-size LHCAF (VSS-LHCAF) is proposed to improve the filtering accuracy of LHCAF further. The proposed LHCAF and VSS-LHCAF are superior to HCAF and other robust adaptive filters in terms of filtering accuracy and stability.