Databases and High Performance Computing

Abstract

There are many data-intensive applications that require interaction with the database management systems or document management systems for processing, producing, or analyzing Big Data. Therefore, if such data-intensive applications are to be ported to High Performance Computing (HPC) platforms, the database management systems or document management systems that they require should either be directly provisioned on HPC platforms or should be made available on a storage platform that is in close proximity to the HPC platform. Otherwise, the time-to-results or time-to-insights can be significantly high. In this chapter, we present an overview of the various database management systems that can be used for the processing and analyses of Big Data on HPC platforms, and include some of the strategies to optimize the database access. We also present the steps to install and access a relational database management system on an HPC platform.