This paper considers the bipartite consensus problem for multi-agent systems, in which both bipartite leaderless consensus and bipartite tracking problems are investigated under signed digraph. Two distributed output feedback control laws are proposed based on reduced-order observer design, respectively, for solving the bipartite leaderless consensus and bipartite tracking consensus problems. Some sufficient conditions are obtained for achieving the bipartite consensus of the multi-agent systems, by using the algebraic Riccati equation design and Jordan decomposition technique. Finally, two simulation examples are presented to illustrate the effectiveness of the obtained theoretical results.