Undoped, singly Sm doped, Ce doped, and Sm/Ce co-doped lithium alumino-phosphate glasses with different alkaline earth modifiers were prepared by melt quenching. The structure of the prepared glasses was investigated by FT-IR and Raman, as well as by optical spectroscopy. The effect of the optical basicity of the host glass matrix on the added active dopants was studied, as was the effect doping had on the phosphate structural units. The optical edge shifts toward higher wavelengths with an increase in the optical basicity due to the increased polarizability of the glass matrix, but also with increasing CeO2 concentration as a result of Ce3+/Ce4+ inter valence charge transfer (IV-CT) absorption. The optical band gap for direct and indirect allowed transitions was calculated for the undoped glasses. The glass sample containing Mg2+ modifier ions is found to have the highest value (4.16 eV) for the optical band gap while Ba2+ has the lowest value (3.61 eV). The change in the optical band gap arises from the structural changes and the overall polarizability (optical basicity). Refractive index, molar refractivity Rm and molar polarizability αm values increase with increasing optical basicity of the glasses. The characteristic absorption peaks of Sm3+ were also investigated. For Sm/Ce co-doped glasses, especially at high concentration of CeO2, the absorption of Ce3+ hinders the high energy absorption of Sm3+ and this effect becomes more obvious with increasing optical basicity.