Adaptive two-level blocking coordinated checkpointing based on recovery cost

Abstract

In this paper we introduce a new adaptive two-level blocking coordinated checkpointing for cluster computing systems. First level of checkpointing is local checkpointing and computing nodes save the checkpoints in local disk based on transient failure rates. If a transient failure occurs in the computing node, process can recover from local disk. Second level of checkpointing is global checkpointing and computing nodes send their checkpoints to high reliable global stable storage in network based on the expected recovery time in the case of permanent failure. If a permanent failure occurs in the computing node, computing node can not be used and process can recover from global storage in a new computing node. Transient failures are probable than permanent failures and the number of global checkpointingis very lower than local checkpointing. Based on this method, coordinated checkpointing overhead is reduced and it is proportional to transient and permanent failure rates of cluster systems.