Sarcopenia and frailty result in loss of function and independence. Sarcopenia may be a risk factor for frailty; however, risk factors for sarcopenia with frailty, and associated incidence of falls and poor quality of life remain unclear. We investigated the clinical characteristics and relevant factors for sarcopenia with frailty in older community-dwelling Japanese. This cross-sectional study included 331 Japanese community-dwelling adults aged ≥60 years. We assessed falls history in the past year, health-related quality of life (HRQOL), including physical component summary (PCS) and mental component summary (MCS), age, total energy intake per ideal body weight (TEI/kg IBW), total protein intake/kg IBW, vitamin D intake, and exercise habits. Sarcopenia was determined using low hand grip strength or slow gait speed and low skeletal muscle mass index. Frailty was determined if ≥3 components, such as unintended weight loss, exhaustion, low muscle strength, slow gait speed, and low physical activity were present. The prevalence of sarcopenia with frailty was 3.6%; such participants had a higher risk of recurrent falls and lower PCS and MCS scores than robust participants. Age, TEI/kg IBW, total protein intake/kg IBW, and vitamin D intake were significantly associated with risk of sarcopenia with frailty by multivariate logistic regression analysis. This study showed that sarcopenia with frailty was had higher incidences of recurrent fall and poor HRQOL than robust older adults. Aging and poor energy, protein, and vitamin D intake, may be relevant factors for sarcopenia with frailty.