As the modular industry expands, the most widely used building materials are primarily concrete, steel, and wood. However, the use of wood and steel is severely limited compared to concrete for reasons such as durability and economy. To overcome these shortcomings, we aimed to apply ultra-high-performance fiber-reinforced concrete (UHPFRC), which has excellent compressive strength and tensile strength, high durability, and minimal reinforcement with steel fibers. In this study, research was conducted on the development of unit box-type architectural modules using UHPFRC with a compressive strength of 120 MPa and a tensile strength of greater than 7 MPa. Various amounts of steel fibers (Vf = 1.0, 1.5, and 2.0%) were evaluated to determine the optimal mixing ratio of UHPFRC, in which both the durability and mechanical performance were assessed. The compressive strength and tensile strength of UHPFRC were found to be 132 MPa and 10.1 MPa, respectively, while its resistance to chloride penetration averaged 14.47 coulombs, indicating superior durability compared to conventional concrete. To reduce the weight of the unit components of the architectural modular system, both normal concrete (NC) components and UHPFRC were applied. The main variables in the flexural tests were the cross-sectional thickness, steel fiber content, and presence of an insulation material, comprising a total of three variables for evaluating the flexural performance. The application of UHPFRC with a compressive strength of 120 MPa, a cross-sectional thickness of 120 mm, and a 10 mm diameter reinforcement provided a similar performance to that of NC components while reducing concrete usage by 60% compared to NC components. Additionally, structural analysis was performed to prototype the unit box-type modular structure using UHPFRC. The modular structural system developed in this study was found to reduce construction costs by 18.7% compared to traditional steel structural systems. Further research is necessary to address issues such as floor slab vibration and noise, connections, and expansion to multistory buildings for commercialization of modular structures using UHPFRC.