This work investigates a three-dimensional size-dependent frictional contact problem of a rigid spherical punch sliding on an elastic half-space. The size-dependent material behaviors are governed by the couple stress theory, and the corresponding frequency response functions, which include two additional length-related elastic parameters, are obtained. Based on the conjugate gradient method and the discrete convolution-fast Fourier transform algorithm, a semi-analytical model is established to predict the frictional size-dependent contact behaviors and then the detailed parameter analysis is performed. The transverse effects of the couple stress, which are induced due to the considerations of the two additional elastic parameters in couple stress theory, are investigated in the contact problems for the first time. And the dependences of the size-dependent contact behavior on the coupling effects of the friction and the two additional elastic parameters are presented.