FeH is one of the most challenging diatomic molecules to study under electronic structure theory. Here, we have successfully studied 22 electronic states of FeH using ab initio multireference configuration interaction (MRCI), Davidson-corrected MRCI (MRCI+Q), and coupled cluster singles, doubles, and perturbative triples [CCSD(T)] levels of theory. We report their potential energy curves (PECs), excitation energies, dissociation energies, equilibrium electronic configurations, and a series of spectroscopic constants with the use of augmented triple-ζ, quadruple-ζ, and quintuple-ζ quality correlation consistent basis sets. The scalar relativistic effects and active space and core electron correlation contribution on the properties of FeH are also explored. The use of a large CASSCF active space that includes 4s, 4p, 3d, and 4d orbitals of Fe and the 1s of H is critical for producing accurate full PECs with proper dissociations and predicting the exact order of the electronic states. Our findings are in harmony with the experimental results available in the literature and will serve as reference values for future studies of FeH. Furthermore, with the use of PECs, the total internal partition function sum (TIPS) of FeH was calculated across a range of temperatures. Finally, we exploited the single-reference nature of the a6Δ of FeH and its ionized product FeH+ (X5Δ) to evaluate the associated density functional theory (DFT) errors on their dissociation energies and spectroscopic parameters.