Individual single-walled carbon nanotubes (SWCNTs) at high temperatures have been reported to generate narrow-band thermal radiation in the near-infrared region due to thermally robust excitonic effects [1,2]. This phenomenon potentially offers a new opportunity for utilizing exciton properties in thermal engineering such as thermophotovoltaic energy harvesting requiring excellent wavelength selective near-infrared thermal emitter. However, for its realistic applications in macroscale, it is necessary to make the distinct exciton effect available under high temperature conditions in macroscopic assemblies of SWCNTs. As a first step toward this goal, we have recently determined broadband complex refractive index spectra of single-chirality SWCNT membranes in which SWCNTs are aligned two-dimensionally in a plane [3] and reported their birefringent properties [4]. In the presentation, we will discuss the change in the optical spectra of SWCNT assemblies with increasing temperature, as well as how the aggregation states affect the exciton properties. [1] T. Nishihara, A. Takakura, Y. Miyauchi, and K. Itami, Nat. Commun. 9, 3144 (2018). [2] S. Konabe, T. Nishihara, and Y. Miyauchi, Opt. Lett. 46, 3021 (2021). [3] T. Nishihara, A. Takakura, M. Shimasaki, K. Matsuda, T. Tanaka, H. Kataura, and Y. Miyauchi, Nanophotonics 11, 1011 (2022). [4] H. Wu, T. Nishihara, A. Takakura, K. Matsuda, T. Tanaka, H. Kataura, and Y. Miyauchi, Carbon, in press.