This paper studies the consensus of nonlinear multi-agent system based on distributed estimation and adaptive sliding mode control schemes. A strategy for distributed estimation is proposed to ensure that every follower is able to estimate the state of the leader within a finite time. Then a structurally simpler integral sliding manifold is designed to eliminate the reaching phase. Furthermore, two control protocols are formulated to ensure the reachability of sliding surface according to the estimated state of the leader. The first protocol is a discontinuous one that ensures exponential convergence of the consensus tracking error to zero, but its switching gain is difficult to be adjusted. Then an adaptive protocol is developed to adjust the switching gain automatically, which is the second control protocol. This protocol not only avoids chattering but also relaxes the dependence on certain boundaries. Finally, simulations are conducted to validate the efficacy of the employed strategy.