The nanoscratch test, as an established technique for assessing material tribological properties has received significant attention. However, the symmetry and anisotropy in scratching performances as well as the quantitative correlation between the orientation-dependent deformation and inherent microscopic deformation mechanism remain unexplored. Herein, crystal plasticity simulations can quantitatively capture scratching forces, elastic recovery, and surface pile-ups, as well as accurately describe inner deformation fields and lattice rotation patterns, as confirmed by experimental results. The simulation results reveal that surface pile-up and elastic recovery mappings on (001)-, (011)-, and (111)-oriented samples exhibit eight-fold, four-fold, and six-fold symmetries, respectively. The orientation-dependent location and intension of both slip activities and lattice rotation, determine the features of macroscopic elastoplastic deformation under scratching.