Highly efficient resource utilization of construction solid waste has significant environmental and socioeconomic benefits. In this study, a fabrication method and process optimization of unburned brick from construction residue soil were investigated based on experiments. The effects of cementing the material content, the raw material treatment process, the brick moisture content, and the molding method on the compressive strength of unburned brick were studied and discussed. The experimental results show that 5–20% of ordinary cement can produce a strength grade of 5 MPa–20 MPa for unburned brick, and the utilization rate of the residue soil is greater than 80%. In the case of well-dispersed residual particles, complete drying and rolling are not necessary, and soil particle size within 5 mm is beneficial for obtaining proper sand grading and low mud content, which will improve the strength of unburned brick. The pressure for the press forming of unburned brick should be 10 MPa, and the optimal moisture content of the residue-soil mixture is about 13%. The proposed residue-soil unburned brick has remarkable environmental and economic benefits with low carbon emissions, low cost, and high profit. The methods proposed and optimized in this study can provide important technical support for realizing the large-scale production of residue-soil unburned brick.