In this paper, the sinc collocation method is used to obtain the solution of the second-order fractional boundary value problems based on the conformable fractional derivative. For this purpose a theorem is proved to represent the terms having fractional derivatives in terms of sinc basis functions. To show the efficiency and accuracy of the present method, some problems are solved and the obtained solutions are compared with the approximate solutions obtained by using the other numerical methods as well as the exact solutions of the problems.