Face recognition (FR) is one of the most effervescent fields of research with extensive applications that span numerous domains, and it stands resolutely as one of the most challenging problems in computer vision. The accuracy of FR systems is severely affected when two images under consideration for a match, vary in their scale and/or affine angles. The prevalent affine and scale invariant recognition systems have been predominantly developed only for objects, and hence in this study, the authors propose a novel approach for faces based on the affine‐SIFT (ASIFT) and two‐dimensional principal component analysis (2DPCA) techniques, to accomplish the formidable task of facial image recognition, invariant of scale and affine angles, i.e. the ability to simulate with enough accuracy, all the distortions caused by the differences in resolution and the variation of the camera optical axis direction. In the formulation of ASIFT‐2DPCA, they investigate three different variants of 2DPCA: classical 2DPCA, quaternion 2DPCA and sparse 2DPCA to gauge as to which is more effective. The authors'experimentations will demonstrate that the proposed approach can robustly handle affine and scale variations, and hence provide better accuracy and matching performance than the state‐of‐the‐art methodologies.