Disposable face masks are a primary protective measure against the adverse health effects of exposure to infectious and toxic aerosols such as airborne viruses and particulate air pollutants. While the fit of high efficiency respirators is regulated in occupational settings, relatively little is known about the fitted filtration efficiencies of ear loop style face masks worn by the public. We measured the variation in fitted filtration efficiency (FFE) of four commonly worn disposable face masks, in a cohort of healthy adult participants (N = 100, 50% female, 50% male, average age = 32.3 ± 9.2 years, average BMI = 25.5 ± 3.4) using the U.S. Occupational Safety and Health Administration Quantitative Fit Test, for an N95 (respirator), KN95, surgical, and KF94 masks. The latter three ear loop style masks were additionally tested in a clip-modified condition, tightened using a plastic clip to centrally fasten loops in the back of the head. The findings show that sex is a major determinant of the FFE of KN95, surgical, and KF94 masks. On average, males had an 11% higher FFE relative to females, at baseline testing. We show that a simple modification using an ear loop clip, results in improvements in the average FFE for females but provides comparatively minor changes for males. On average, females had a 20% increased FFE when a clip was worn behind the head, relative to a 6% increase for males. The efficacy of a disposable face mask as protection against air contaminants depends on the efficiency of the mask materials and how well it fits the wearer. We report that the sex of the wearer is a major determinant of the baseline fitted filtration efficiency (FFE) of commonly available ear loop style face masks. In addition, we show that a simple fit modifier, an ear loop clip fastened behind the head, substantially improves baseline FFE for females but produces only minor changes for males. These findings have significant public health implications for the use of face masks as a protective intervention against inhalational exposure to airborne contaminants.