We consider weak solutions of (hyperbolic or hyperbolic-elliptic) systems of conservation laws in one-space dimension and their approximation by finite difference schemes in conservative form. The systems under consideration are endowed with an entropy-entropy flux pair. We introduce a general approach to construct second and third order accurate, fully discrete (in both space and time) entropy conservative schemes. In general, these schemes are fully nonlinear implicit, but in some important cases can be explicit or linear implicit. Furthermore, semidiscrete entropy conservative schemes of arbitrary order are presented. The entropy conservative schemes are used to construct a numerical method for the computation of weak solutions containing nonclassical regularization-sensitive shock waves. Finally, specific examples are investigated and tested numerically. Our approach extends the results and techniques by Tadmor [in Numerical Methods for Compressible Flows---Finite Difference, Element and Volume Techniques, ASME, New York, 1986, pp. 149--158], LeFloch and Rohde [SIAM J. Numer. Anal., 37 (2000), pp. 2023--2060].