Common bean (Phaseolus vulgaris L.) is the most important legume crop in Kenya. It is cultivated across a wide range of agro-ecologies which include high potential and marginal areas. Eastern Kenya alone, largely semi-arid, accounts for 35% of the country’s total bean production. Bean farmers mainly small-scale have limited access to quality seed, chemical pesticides and fertilizer. Therefore, bean yield under on-farm conditions still remains below 500 kg ha−1 while the potential is about 1,200 kg ha−1 under semi-arid conditions. To asses the farmers’ views on bean varieties and a key insect pest and associated constraints contributing to yield loss, research was undertaken. The research included survey to quantify the yield loss and Participatory Rural Appraisal to determine the level of adoption and criteria for variety choice in semi-arid eastern Kenya (SAEK). The results show that farmers consider drought and insect pest problems as main causes for low yields. The adoption rate for improved varieties is high but self sufficiency in beans stands at 23% in the dry transitional (DT) agro-ecology and at 18% in the dry mid-altitude (DM) agro-ecology, respectively. This could be attributed to low adaptability since most of the improved varieties grown were selected for high potential areas but now found in marginal areas. Drought, earliness, yield stability, and insect pest resistance are the main reasons for choice of varieties by farmers. Bean fly (Ophiomyia sp.) was identified as one of the key crop pests of beans limiting yield. Besides, African bollworm (Helicoverpa armigera) and bean aphid (Aphis fabae) were ranked higher. Due to limitations of the conventional breeding approach, a participatory plant breeding approach is suggested so as to provide an opportunity to develop insect pest resistant varieties adapted to the SAEK region.