Even though the study of interfacial phenomena can be traced back to Laplace and was given a solid thermodynamic foundation by Gibbs, it appears that some concepts and relations among them are still causing some confusion and debates in the literature, particularly for interfaces involving solids. In particular, the definitions of the concepts of interfacial tension, free energy, and stress and the relationships between them sometimes lack clarity, and some authors even question their validity. So far, the debates about these relationships, in particular the Shuttleworth equation, have taken place within the framework of classical thermodynamics. In this work, we are offering to look at these concepts within the framework of statistical mechanics, which can be readily tested in Molecular Dynamics (MD) simulations. For a simple one component system of particles interacting via the Lennard-Jones potential, we calculate by the cleaving method the excess free energy of a solid-vacuum interface (solid surface) for systems in different states of tangential strain and compare the results to the calculation of surface stress via the difference of normal and tangential forces at the surface. As a result, we demonstrate consistency, within the statistical uncertainty, of the thermodynamic and statistical mechanical definitions of surface free energy and surface stress and how they are expressed via interaction-dependent quantities in MD simulations.