We investigate whether the natural orbitals (NOs) minimize ∥Ψ-Φ∥2, where Ψ is a wave function and Φ is a full configuration interaction (CI) approximation to Ψ in a reduced basis. We will show that the NOs rarely provide the optimal orbitals for Φ, except when (1) there are only two particles or (2) only one basis function is removed in the case of fermions. Further, we will show that the CI expansion coefficients of Ψ and Φ are identical up to a global scaling factor and demonstrate how the NOs can be used to generate the orbitals that minimize ∥Ψ-Φ∥2.