To examine the compositional and chemical effects on the glassy system, one must first understand its network structure. Alloying glassy systems cause significant conformal and configurational changes. The optical and physical parameters of As2Se3 and (As2Se3)90Ge10 glassy alloys doped with metallic impurities (X = Bi, Cd, Pb, Sb) have been evaluated. A comparison of the physical properties of glassy alloys has been made as the doping elements increase, i.e., from binary to ternary to quaternary system, and an effort has been made to correlate the optical and physical parameters. The optical density (Dop) and penetration depth (δ) have been calculated from the reported absorption coefficient (α) data. The mean coordination number (<r>) and the number of floppy modes (Mf) calculations show that the floppy regions are decreasing, and hence, the rigidity is increasing when As–Se is doped with Ge and As–Se-Ge is doped with X. The density (ρ) and packing density (PD) have also been evaluated, which are interrelated to the parameters like refractive index (n) and δ. Cohesive energy (CE), mean bond energy (<E>), and glass transition temperature (Tg) values give an insight into the stability and average crosslinking of the system with alloying. The conduction and valence band potentials have supported the optical bandgap (Egopt) values variation.