This paper presents a procedure for the analysis of left-right (bilateral) asymmetry in mammograms. The procedure is based upon the detection of linear directional components by using a multiresolution representation based upon Gabor wavelets. A particular wavelet scheme with two-dimensional Gabor filters as elementary functions with varying tuning frequency and orientation, specifically designed in order to reduce the redundancy in the wavelet-based representation, is applied to the given image. The filter responses for different scales and orientation are analyzed by using the Karhunen-Loève (KL) transform and Otsu's method of thresholding. The KL transform is applied to select the principal components of the filter responses, preserving only the most relevant directional elements appearing at all scales. The selected principal components, thresholded by using Otsu's method, are used to obtain the magnitude and phase of the directional components of the image. Rose diagrams computed from the phase images and statistical measures computed thereof are used for quantitative and qualitative analysis of the oriented patterns. A total of 80 images from 20 normal cases, 14 asymmetric cases, and six architectural distortion cases from the Mini-MIAS (Mammographic Image Analysis Society, London, U.K.) database were used to evaluate the scheme using the leave-one-out methodology. Average classification accuracy rates of up to 74.4% were achieved.