Researchers make available computationally expensive designs for computer experiments for widespread use by cataloging them and providing online links. This paper presents an algorithm that augments space-filling designs (SFDs) by optimally permuting and stacking columns of the design matrix to minimize the maximum absolute pairwise correlation among columns in the new extended design. The algorithm enables researchers to augment an SFD sequentially with batches of additional design points, which improves column orthogonality and adds more degrees of freedom for fitting metamodels. We show this method improves the correlation and space-filling properties of the resulting designs and allows us to extend some classes of designs to higher dimensions that are not easily obtainable. Moreover, the resulting extended designs compare well with many leading software-generated SFDs created from scratch in the extended design space.