Coffee silverskin, the major coffee-roasting by-product, is currently used as fuel and for soil fertilization. However, there are several studies reporting silverskin as a good source of bioactive compounds that can be extracted and further used by cosmetic industry. Its high antioxidant potential may be due to the synergistic interaction of chlorogenic acids (1–6%), caffeine (0.8–1.25%), and melanoidins (17–23%), among other antioxidant compounds. The bioactive compounds of silverskin can answer to the new fields of cosmetic industry on natural active ingredient resources that improve health skin appearance, counteract skin aging and related diseases, in an environmentally friendly approach. Skin aging is a complex process associated with oxidative metabolism and reactive oxygen species (ROS) generation. ROS production increase matrix metalloproteinases (MMPs), as well as pro-inflammatory mediators, resulting in consequent skin damage and aging. To counteract this process, cosmetic industry is looking for compounds able to increase MMP inhibitory activities, hyaluronidase inhibitory activity, expression of collagen and elastase inhibitory activity, as potential bioactive ingredients with anti-aging purposes. This review focuses on skin aging factors and the potential anti-aging, anti-inflammatory, antimicrobial, anti-cellulite and anti-hair loss activity, as well as protection against UV damage, of coffee silverskin and their bioactive compounds.