This paper proposes a low-cost access network architecture supporting flexible point-to-point communication between any optical network units (ONUs). By sharing transceivers between upstream/downstream communication and ONU communication, the number of transceivers required in ONU can be decreased. Coupled with using passive components instead of active transmitters and adopting modular design of nodes for integration, the cost of manufacturing and maintenance of network equipment can be significantly reduced. In addition, by skillfully allocating wavelengths, not only wavelength multiplexing can be realized and thereby improving the utilization of network wavelength resources, but also the Rayleigh backscattering (RB) in signal transmission can be effectively weakened. Finally, by the simulation experiment, the effectiveness of the proposed architecture is demonstrated.