A Solution Framework for All-to-All Comparison Data Distribution Strategy Based on Tabu Search

Abstract

All-to-All Comparison (ATAC) is a key computing mode to improve computing performance and is applied in many disciplines. Through the research on the data distribution strategy of the ATAC calculation, a novel solution framework of the ATAC data distribution strategy based on tabu search is proposed for the first time. An ATAC data distribution model is constructed, and the related algorithms of the model are designed based on the tabu search, and it is implemented on MATLAB. The framework consists of three parts: 1) the driver module responsible for interacting with users; 2) the load balancing module that solves the data distribution strategy that meets the load balancing situation; 3) the storage optimization module that solves the data distribution strategy that meets the load balancing and optimized storage. Experiments prove that the framework for solving the ATAC data distribution strategy based on tabu search has the following advantages: A) The data distribution strategy obtained by the framework enables the nodes of the distributed system participating in the ATAC calculation to achieve load balancing and complete data localization. B) The data distribution scheme can reduce 40%-50% of the storage space in the distributed system. C) The framework is more advanced than the existing ATAC data distribution algorithm in calculation speed.