Policy Based Data Placement in High Performance Scientific Computing

Abstract

The recent increased use of workflow management systems by large scientific collaborations presents the challenge of highly dynamic data placement in distributed systems. Such data placement may be constrained by the enforcement of data placement policies. We present a Policy based Data Placement Service that enforces data placement policies, interfaces with workflow managers and improves workflow efficiency by offloading data staging jobs from workflows.