The present paper is concerned with the robust and smooth attitude-position tracking control of fully actuated multirotor aerial vehicles equipped with fixed rotors and subject to matched model uncertainties and disturbances. The vehicle coupled dynamic equations representing the translational and rotational motions are thoroughly derived using the multibody approach, considering the external torque and force disturbances as well as the uncertainties in the inertia parameters of the airframe and the rotors. From this model, it is shown that the overall disturbances and uncertainties can be lumped into an additive-matched plant-model discrepancy. Then, based on a geometrically consistent description of the control error in SE(3), a novel joint geometric attitude-position control law is designed using a multi-input smooth second-order sliding mode strategy. The latter uses a high-order sliding mode disturbance observer to guarantee the overall system robustness. The second-order sliding mode is proved to exist using vector-field homogeneity, and the tracking error is shown to exponentially converge to the origin. The method is extensively evaluated via numerical simulations using a fully actuated hexacopter with tilted rotors, showing advantages with respect to state-of-the-art alternatives.