Desynchronization of simulation and optimization algorithms in HPC Environment

Abstract

Need for scalability of an algorithm is essential, when one wants to utilize HPC infrastructure in an efficient and reasonable way. In such infrastructures, synchronization affects the efficiency of the parallel algorithms. However, one can consider introducing certain means of desynchronization in order to increase scalability. Allowing for omitting or delaying certain messages, can be easily accepted in the case of metaheuristics. Furthermore, some simulations can also follow this pattern and handle bigger environments. The paper presents a short survey of desynchronization idea, pointing out already obtained results or sketching out the future work focused on scaling the parallel and distributed computing or simulation algorithms leveraging desynchronization.