In this paper, we propose a delayed-focusing type micro-angle measurement optical system based on the Cassegrain structure (cassette structure), analyze the basic cassette structure and the Galilean laser beam expanding system, and determine the primary and secondary mirror structure as a reflective focusless system as a determining module. This focusless system emits and receives parallel light, and the light source and detector separated by the beam splitter are designed as replaceable modules. Additionally, the imaging quality of the system can be optimized, or the effect of meeting different imaging requirements can be achieved, by changing the number and type of corrective mirrors and the parameters of the specific glass elements in the replaceable modules. After the final optimization, the radius of the imaging spot of the combined mirror group can be limited to 6.1 µm; the modulation transfer function is better than 0.6 at 100 lp/mm; the difference between the meridian and the arc-vector curves is less than 0.1; and the theoretical angular accuracy reaches 0.2″. The delayed-focusing system structure is analyzed under different temperature fields to provide guidance for the design of the subsequent structure temperature control. Comparison and analysis with commonly used angle measurement optical systems are also made. It is concluded that the structure meets the requirements for use in the on-orbit environment, completes the reuse of the established structural modules, and further saves the manufacturing cost, which provides a feasible solution to the problem of monitoring the small angular changes in the field of space.