The investigation of new composite materials possessing low weight but not at the expense of their mechanical performance is of great interest in terms of reducing energy consumption in many industrial applications. This study is focused on the nanomechanical characterization of high-density polyethylene (HDPE)-based composite specimens modified with equal loadings of graphene nanoplatelets (GNPs) and/or multiwall carbon nanotubes (MWCNTs). Quasi-static nanoindentation analysis revealed the impact of the carbon nanofillers on the receiving of nanocomposites with higher nanohardness and reduced modulus of elasticity, reaching values of 0.146 GPa and 3.57 GPa, respectively. The role of the indentation size effect in elastic polymer matrix was assessed by applying three distinct peak forces. Nanoscratch experiments depicted the tribological behavior of the composite samples and inferred the influence of the carbon nanofillers on the values of the coefficient of friction (COF). It seems that the incorporation of 4 wt% GNPs in the polymer structure improves the scratch resistance of the material, resulting in a higher value of the exerted lateral force and therefore leading to the detection of a higher coefficient of friction at scratch of 0.401. A considerable pile-up response of the scratched polymer specimens was observed by means of in-situ SPM imaging of the tested surface sample area. The sway of the carbon nanoparticles on the composite pile-up behavior and the effect of the pile-up on the measured friction coefficients have been explored.