Quite large amount of heat generated in various industrial processes was wasted. Recovering the waste heat can save cost and benefit the environment protection. The device that convert heat energy to electricity is called thermoelectric generator (TEG), and therefore it can be used for waste heat recovery. Improving the efficiency is the main direction of present study. The configuration and geometry of the thermoelectric legs are proved can influence the thermoelectric performance of the thermoelectric generator. Compared with the conventional TEG which is assembled with symmetrical (rectangular) legs, asymmetrical thermoelectric generator (ATEG) has a greater temperature gradient in a leg due to the convergent geometry which can reduce overall thermal conduction of the device and Thomson effect is also harnessed. In this study, three-dimensional finite element analysis (COMSOL) is employed to investigate the numerical simulations of a segmented pyramidal thermoelectric generator (SPTEG) and a segmented cone thermoelectric generator (SCTEG) to optimize the leg length ratio of two materials, and it’s effect on the electrical and mechanical performances of SPTEG and SCTEG was also studied. Results obtained shows that the height ratio of SATEG can influence electrical and mechanical performances and the optimum height ratio provided a better electrical performance while thermal stress developed in leg was less. In addition, the open-circuit voltage of two types SATEG is similar because they have the same cross sectional area and the same volume, however, SCTEG has a dispersive thermal stress distribution while the thermal stress of SPTEG concentrates in four corners. Compared to the maximum von Mises stress in SPTEG, the maximum von Mises stress in SCTEG reduced about 10%. Results obtained from this study would provide references in producing and design of segmented asymmetrical thermoelectric generators.