Indium phosphide (InP) and zinc selenium tellurium (ZnSeTe) quantum dots (QDs) as less toxic alternatives have received substantial attention. The structure of QDs generally consists of a QD core, inner shell layer, and outer shell layer. We reckon that the inner shell layer, especially its components and thickness, have a significant influence on the optical and electronic performances of QDs. In this Perspective, we compare optical properties of these QDs with different inner shells and summarize how typical inner shell components and thickness influence their optical properties. The impact of the inner shell on the performance of QD light-emitting diodes (QLEDs) has also been discussed. The appropriate components and thickness of the inner shell both contribute to alleviate valence or lattice mismatch, thereby enhancing the performance of QDs. We expect that this Perspective could heighten awareness of the significance and impact of the inner shell layer in QDs and facilitate further development of QDs and QLEDs.