We report experimental results on upper harmonic conversion using a lithium niobate and a beta barium borate crystal to quadruple the FEL light up into the visible and near infrared. The effects of finite linewidth, birefingent walk-off, and group velocity walk-off on conversion efficiency will be discussed with reference to the experimental results.