This paper investigates the optimization of a non-traditional vibration absorber for simultaneous vibration suppression and energy harvesting. Unlike a traditional vibration absorber, the non-traditional vibration absorber has its damper connected between the absorber mass and the base. An electromagnetic energy harvester is used as a tunable absorber damper. This non-traditional vibration absorber is attached to a primary system that is subjected to random base excitation. An analytical study is conducted by assuming that the base excitation is white noise. In terms of vibration suppression, the objective of the optimization is to minimize the power dissipated by the primary damper and maximize the power dissipated by the absorber damper. It is found that when the primary system is undamped, the power dissipated by the absorber damper remains a constant that is related to the mass ratio. The higher the mass ratio, the higher the power dissipated. When the primary system is damped, the minimization of the power dissipated by the primary damping is equivalent to the maximization of the power dissipated by the absorber damper. The existence of the optimum solutions depends on both the mass ratio and the primary damping ratio. In terms of energy harvesting, the objective of optimization is to maximize the power harvested by the load resistor. It is found that for a given mass ratio and primary damping ratio, the optimum frequency tuning ratio required to maximize vibration suppression is slightly higher than that required to maximize the harvested power. The trade-off issue between vibration suppression and energy harvesting is investigated. An apparatus is developed to allow frequency tuning and damping tuning. Both the numerical simulation and experimental study with band-limited white noise validate the general trends revealed in the analytical study.