The aim of this study is to reveal the influences of carbon nanotube (CNT) and polymer type as well as CNT content on electrical conductivity, Seebeck coefficient (S), and the resulting power factor (PF) and figure of merit (ZT). Different commercially available and laboratory made CNTs were used to prepare melt-mixed composites on a small scale. CNTs typically lead to p-type composites with positive S-values. This was found for the two types of multi-walled CNTs (MWCNT) whereby higher Seebeck coefficient in the corresponding buckypapers resulted in higher values also in the composites. Nitrogen doped MWCNTs resulted in negative S-values in the buckypapers as well as in the polymer composites. When using single-walled CNTs (SWCNTs) with a positive S-value in the buckypapers, positive (polypropylene (PP), polycarbonate (PC), poly (vinylidene fluoride) (PVDF), and poly(butylene terephthalate) (PBT)) or negative (polyamide 66 (PA66), polyamide 6 (PA6), partially aromatic polyamide (PARA), acrylonitrile butadiene styrene (ABS)) S-values were obtained depending on the matrix polymer and SWCNT type. The study shows that the direct production of n-type melt-mixed polymer composites from p-type commercial SWCNTs with relatively high Seebeck coefficients is possible. The highest Seebeck coefficients obtained in this study were 66.4 µV/K (PBT/7 wt % SWCNT Tuball) and −57.1 µV/K (ABS/0.5 wt % SWCNT Tuball) for p- and n-type composites, respectively. The highest power factor and ZT of 0.28 µW/m·K2 and 3.1 × 10−4, respectively, were achieved in PBT with 4 wt % SWCNT Tuball.