In order to approximate the Caputo fractional derivative of order α, 0<α<1, we construct here a new class of formulae on the basis of B-spline interpolation. These new formulae called S1, S2 and S3 have 2−α, 3−α and 4−α order of convergence, respectively. The proposed formulae are as simple as the well-known L1 formula and the main advantage of them lies in the fact that their accuracy is fixed in the whole interval of integration while the previous formulae such as L1-2 have lower accuracy at the beginning of the interval. Hence in comparison with the previous formulae, new ones have better accuracy and their computational costs are comparable. We then modify S2 and S3 formulae for approximating the Caputo fractional derivative of order α, 1<α<2. Some numerical examples as well as two applications in solving fractional ordinary and partial differential equations (PDEs) are provided to demonstrate the applicability and accuracy of the new formulae.