In order to solve the problems of the traditional 3D simulation system of indoor soft decoration, such as the lack of effective enrichment, rendering means, and poor authenticity when selecting the geometric modeling method to simulate the effect of indoor soft decoration, this paper proposes a 3D simulation system of indoor soft decoration based on OpenGL and Direct3D. The system uses 3DMAX software to establish the indoor model, imports the model into the OpenGL 3D graphics standard library module, draws the indoor soft decoration scene elements using the basic geometric elements, and constrains the scene elements through the wall, overlap, and size constraint functions, so as to ensure the reasonable layout of the indoor soft decoration agent area and enrich the indoor model. After enrichment, the indoor model is transmitted to the Direct3D rendering engine module transformation unit to implement the soft decoration layout, and the lighting unit and rasterization unit are used to render the indoor after layout so as to obtain the optimal indoor soft decoration effect and output the 3D simulation image of indoor soft decoration. The experimental results show that the favorability, operation sensitivity, design portability, design satisfaction, and soft fitting effect score of the system are higher than those of the Untiy3D system and Smart3D system. The average score of this system is about 95, while the average score of the Untiy3D system is lower than 89, and the average score of the Smart3D system is lower than 85. Conclusion. The three-dimensional simulation effect of indoor soft decoration of this system is good, the design is convenient, the operation is sensitive, and the user satisfaction is high, which provides a reliable analysis basis for indoor design.