Ki-67 is a key indicator of the proliferation activity of tumors. However, no standardized criterion has been established for Ki-67 index calculation. Scale-invariant feature transform (SIFT) algorithm can identify the robust invariant features to rotation, translation, scaling and linear intensity changes for matching and registration in computer vision. Thus, this study aimed to develop a SIFT-based computer-aided system for Ki-67 calculation in breast cancer. Hematoxylin and eosin (HE)-stained and Ki-67-stained slides were scanned and whole slide images (WSIs) were obtained. The regions of breast cancer (BC) tissues and non-BC tissues were labeled by experienced pathologists. All the labeled WSIs were randomly divided into the training set, verification set, and test set according to a fixed ratio of 7:2:1. The algorithm for identification of cancerous regions was developed by a ResNet network. The registration process between paired consecutive HE-stained WSIs and Ki-67-stained WSIs was based on a pyramid model using the feature matching method of SIFT. After registration, we counted the nuclear-stained Ki-67-positive cells in each identified invasive cancerous region using color deconvolution. To assess the accuracy, the AI-assisted result for each slice was compared with the manual diagnosis result of pathologists. If the difference of the two positive rate values is not greater than 10%, it was a consistent result; otherwise, it was an inconsistent result. The accuracy of the AI-based algorithm in identifying breast cancer tissues in HE-stained slides was 93%, with an area under the curve (AUC) of 0.98. After registration, we succeeded in identifying Ki-67-positive cells among cancerous cells across the entire WSIs and calculated the Ki-67 index, with an accuracy rate of 91.5%, compared to the gold standard pathological reports. Using this system, it took about 1 hour to complete the evaluation of all the tested 771 pairs of HE- and Ki-67-stained slides. Each Ki-67 result took less than 2 seconds. Using a pyramid model and the SIFT feature matching method, we developed an AI-based automatic cancer identification and Ki-67 index calculation system, which could improve the accuracy of Ki-67 index calculation and make the data repeatable among different hospitals and centers.