The complex structure of skin ensures a broad range of biological functions. The loss of a large skin area due to trauma or disease usually requires reconstructive surgery that often involves grafting or flapping. The clinical need for non-contact objective measurements of skin elasticity is necessary to guide grafting procedures to minimize complications such as secondary contracture or hypertrophic scars. Here, we report a non-contact and non-invasive method combining acoustic micro-tapping optical coherence elastography (AμT-OCE) with polarization-sensitive (PS-) optical coherence tomography (OCT) to quantify anisotropic elastic properties of skin. We show that all three elastic constants that define skin’s anisotropic elastic deformation and the orientation of collagen fibers in the dermis can be determined from propagating elastic waves over the skin surface. Measurements were performed on healthy volunteers in vivo. A nearly incompressible transverse isotropic model of skin elasticity was used to reconstruct the moduli from experimental data after being validated in extensive numerical simulations. Finally, we demonstrate that combining several OCT modalities (structural OCT, OCT angiography, PS-OCT, and AμT-OCE) may provide rich information about skin and demonstrate the potential for complex characterization of scar.