Early-stage design exploration is crucial since most of the major design decision are locked-in and only small design modifications are possible at later stages. To assess the performance of the various design candidates while performing design exploration, there are available methods and tools of various fidelities. These methods can be combined to form a multi-fidelity (MF) framework that guarantees accuracy through the high-fidelity model and achieves faster computational speeds through low-fidelity models. The present study proposes the adoption of information-theoretic entropy to improve a MF design framework based on Gaussian Processes (GPs). Entropy quantifies the uncertainty associated with the prediction of the design space. We propose using this uncertainty metric both as a criterion to determine whether further designs should be sampled to construct a reliable approximation of the design space and as a criterion to establish in which optimization step the optimization of the covariance matrix for the MF-GPs should be performed. The approach was tested to benchmark analytical functions and to a ship design problem of an AXEfrigate. The approach holds potential in practical applications, as it aids in the determination of whether additional resources should be allocated for high-fidelity analysis to support early-stage exploration.