An AMD control system is usually built based on the original model of a target building. As a result, the fact leads a large calculation workload exists. Therefore, the orders of a structural model should be reduced appropriately. Among various model-reduction methods, a suitable reduced-order model is important to high-rise buildings. Meanwhile, a partial structural information is discarded directly in the model-reduction process, which leads to the accuracy reduction of its controller design. In this paper, an optimal technique is selected through comparing several common model-reduction methods. Then, considering the dynamic characteristics of a high-rise building, an improved balanced truncation (BT) method is proposed for establishing its reduced-order model. The abandoned structural information, including natural frequencies, damping ratios and modal information of the original model, is reconsidered. Based on the improved reduced-order model, a new reduced-order controller is designed by a regional pole-placement method. A high-rise building with an AMD system is regarded as an example, in which the energy distribution, the control effects and the control parameters are used as the indexes to analyze the performance of the improved reduced-order controller. To verify its effectiveness, the proposed methodology is also applied to a four-storey experimental frame. The results demonstrate that the new controller has a stable control performance and a relatively short calculation time, which provides good potential for structural vibration control of high-rise buildings.