Tellurite glasses are highly anticipated for creating gradient refractive index (GRIN) lenses, which have the potential to be applied in the lightweight and miniaturization of optical imaging systems to improve their performance. However, it is still challenging to precipitate pure crystalline phases in tellurite glasses after heat treatment to control the refractive index via spatial variation of nanocrystal distribution. Here, we present a novel method for fabricating axial telluride GRIN glass via a gradient heat-treatment technique. Through the selection of glass composition and control of the heat treatment process, pure phase Bi4TeO8 nanocrystals with a high refractive index (n) can be precipitated in telluride glass with a lower refractive index. This allows the axial telluride GRIN structure of maximum refractive index difference Δn ∼ 0.1 to be obtained by modulating the spatial distribution and concentration of Bi4TeO8 nanocrystals. This work not only demonstrates the feasibility of producing GRIN lenses from tellurite glass but also lays the foundation for the future development of medium wave infrared (MWIR) imaging.