Polyimide membranes are favored in the aerospace field for their excellent comprehensive properties, but new application requirements demand higher strength, modulus and thermal expansion properties. Here, self-reinforced polyimide composite membranes (SRPICM) with varying fiber tow arrangement densities were fabricated by unidirectional reinforcement of polyimide fiber tows to enhance the thermomechanical properties of the membranes while maintaining the characteristics of low thickness and flexibility. A micro-scale representative volume element model with interface, and a macro-scale model containing cracks were developed based on the membranes' morphology to investigate the tensile and thermal expansion behavior of SRPICM. Experimental and numerical analyses demonstrated that fiber tows significantly improved the longitudinal tensile properties of SRPICM, with maximum increases in modulus and strength to 34.02 GPa and 1.26 GPa, respectively, over 13 times those of pure PI membranes. Further, the test results, combined with the two-scale finite element model revealed the evolution of longitudinal and transverse tensile deformation and thermal expansion behavior of SRPICM. The validity of the two-scale model was confirmed by experimental results, attributed to the practical consideration of interfacial bonding, prefabricated cracks and thermal residual stress effects during initial modeling. Notably, SRPICM with 10 fiber tows/20 mm arrangement density exhibited excellent longitudinal tensile properties (modulus and strength of 14.01 GPa and 470.89 MPa, respectively) and a longitudinal thermal expansion close to zero (0.03 μm/m°C), making it an ideal material for aerospace applications.