The efficacy of second-line treatment for advanced non-small cell lung carcinoma (NSCLC) without a sensitizing driver gene mutation is still unsatisfactory. The combination of apatinib and chemotherapy improved progression-free survival in the second-line therapy of advanced NSCLC without a sensitizing mutation. This study offers a new treatment strategy for second-line treatment of such patients but requires confirmation in a larger multi-institutional trial. This study explored the efficacy and safety of apatinib combined with single-agent chemotherapy versus single-agent chemotherapy in the second-line treatment of advanced non-small-cell lung carcinoma (NSCLC) without driver mutations. In this double-arm, open label, exploratory clinical study, we enrolled patients with unresectable locally advanced or advanced NSCLC without driver mutations that had progressed following first-line chemotherapy. The subjects were allocated into an experimental group and a control group by 2:1. The experimental group received apatinib combined with four cycles of docetaxel or pemetrexed until disease progression, intolerable toxicity, or discontinuation at the patient' request. The control group only received four cycles of docetaxel or pemetrexed. The primary endpoints were progression-free survival (PFS), and the secondary endpoints were overall survival (OS), disease control rate (DCR), and safety. Thirty-seven patients were enrolled. The efficacy of 33 patients was evaluated. The median PFS was 5.47 versus 2.97 months, the DCR was 95% versus 73%, and the objective response rate (ORR) was 27% versus 9% in the experimental versus control group. The OS was still under follow-up. The most common adverse effects included hypertension, hand-foot skin reaction (HFSR), and fatigue. Apatinib combined with single-agent chemotherapy may be a novel option for second-line treatment of advanced NSCLC.