Some integral identities for the fundamental solutions of potential and elastostatic problems are established in this paper. With these identities it is shown that the conventional boundary integral equation (BIE), which is generally expressed in terms of singular integrals in the sense of the Cauchy principal value (CPV), and the derivative BIE, which is similarly expressed in terms of hypersingular integrals in the sense of the Hadamard finite-part (HFP), can both be written as weakly-singular integral equations in a systematic approach. Discretization of the weakly-singular BIE leads to the weakly-singular boundary element formulation equivalent to the method of using the rigid body displacement to determine the diagonal submatrices, which involve the CPV terms and the geometric matrix C, in the conventional BEM. The discretization of the weakly-singular derivative BIE possesses a similar feature, i.e. no CPV and HFP are involved. All these suggest that the practice of calculating CPV or HFP (for boundary integrals) and the geometric matrix C, either analytically or numerically, is unnecessary in the BEM. The approach developed in this paper is applicable to other problems such as plate bending, acoustics and elastodynamics.