Among the physical layer baseband algorithms in macro base stations, the matrix processing has the dom-inant computing cost, large data access overhead and com-plicated addressing mode. The existing data access methods are not the best solution for memory system of ASIP (Ap-plication Specific Instruction Set Processor) in 5G/6G macro stations. We hence proposed a parallel conflict-free data access method for matrix. Moreover, we proposed a non-redundant access method for positive definite matrix that stores only trigonometric part, and the corresponding parallel addressing method with low storage overhead. Our method solves the problem of data conflict and minimizes the memory space of ASIP, and supports ASIP to approach the performance limit of architecture to the maximum ex-tent under the constraint of architecture and data parallel-ism. We implemented the proposed method as a static memory optimizer, which provides a tool for the design and optimization of memory system of ASIP in 5G/6G macro base stations with low overhead. Experimental results show that for 64W64 positive definite matrix inversion algorithm based on Cholesky decomposition, our addressing method can save 32% of the execution time, and the cost of memory space is reduced by half.