Conventional hardware based per-component and system-wide power management methods can save more power consumptions if they are in assistance with software-level adaptation. Since the conventional coarse-grained methods are not adaptive to various fluctuating workload in real scenarios, the system performance can be deteriorated greatly if the objective is only to minimize the total power consumptions separately, despite of the violations of Service Level Agreements (SLAs). In this paper a fine-grained job-level power aware scheduling algorithm is proposed to minimize power consumption in multi-processor system with SLA constraints. Simulation results show that the proposed algorithm can save significant power consumptions while still providing SLAs guarantees and the performance degradation is acceptable. The results also show that fine-grained job-level power aware scheduling can achieve better power/performance balancing between multiple processors than coarse grained methods.