The advent of technology has acted as a catalyst to the propensity and intensity of acts of terrorism across the globe owing to the production of Small and Light Weapons (SALW), which are easy to handle and deploy in conflict situations. This paper aims at examining the influence of the proliferation of SALW on terrorism in Northern Nigeria, which is largely perpetrated by the Boko Haram terrorist group and the Islamic State of West Africa Province (ISWAP). The paper revealed that the proliferation of SALWs have significantly contributed to the recurrence and ferociousness of terrorism in Northern Nigeria. The paper also revealed that despite the copious legal framework regulating the use of arms and light weapons, arms have become a free-for-all particularly, in the hands of non-state actors in Nigeria. The resultant effects of this proliferation are loss of lives; wanton damage and destruction of properties and means of livelihood; displacements; economic downturn etc. The paper concludes that the ECOWAS Convention on Small Arms and Light Weapons (Convention) should be operational in Nigeria. However, reliance cannot be placed on legislation alone as a means of controlling the proliferation of arms but it is imperative for other measures to be in place such as an institutional framework involving the re-jig of the Nigerian security apparatus and community involvement in the control of SALW.