The accurate prediction of protein-ligand binding free energies remains a significant challenge of central importance in computational biophysics and structure-based drug design. Multiple recent advances including the development of greatly improved protein and ligand molecular mechanics force fields, more efficient enhanced sampling methods, and low-cost powerful GPU computing clusters have enabled accurate and reliable predictions of relative protein-ligand binding free energies through the free energy perturbation (FEP) methods. However, the existing FEP methods can only be used to calculate the relative binding free energies for R-group modifications or single-atom modifications and cannot be used to efficiently evaluate scaffold hopping modifications to a lead molecule. Scaffold hopping or core hopping, a very common design strategy in drug discovery projects, is critical not only in the early stages of a discovery campaign where novel active matter must be identified but also in lead optimization where the resolution of a variety of ADME/Tox problems may require identification of a novel core structure. In this paper, we introduce a method that enables theoretically rigorous, yet computationally tractable, relative protein-ligand binding free energy calculations to be pursued for scaffold hopping modifications. We apply the method to six pharmaceutically interesting cases where diverse types of scaffold hopping modifications were required to identify the drug molecules ultimately sent into the clinic. For these six diverse cases, the predicted binding affinities were in close agreement with experiment, demonstrating the wide applicability and the significant impact Core Hopping FEP may provide in drug discovery projects.