In an article published in 2015, Hussain et al. introduced a notion of a fuzzy b-metric space and obtained some fixed point theorems for this kind of space. Shortly thereafter, Nădăban presented a notion of a fuzzy b-metric space that is slightly different from the one given by Hussain et al., and explored some of its topological properties. Related to Nădăban’s study, Sedghi and Shobe, Saadati, and Šostak independently conducted investigations in articles published in 2012, 2015, and 2018, respectively, about another class of spaces that Sedgi and Shobe called b-fuzzy metric spaces, Saadati, fuzzy metric type spaces, and Šostak, fuzzy k-metric spaces. The main contributions of our paper are the following: First, we propose a notion of fuzzy b-metric space that encompasses and unifies the aforementioned types of spaces. Our approach, which is based on Gabriec’s notion of a fuzzy metric space, allows us to simultaneously cover two interesting classes of spaces, namely, the 01-fuzzy b-metric spaces and the K-stationary fuzzy b-metric spaces. Second, we show that each fuzzy b-metric space, in our sense, admits uniformity with a countable base. From this fact, we derive, among other consequences, that the topology induced by means of its “open” balls is metrizable. Finally, we obtain a characterization of complete fuzzy b-metric spaces with the help of a fixed point result which is also proved here. In support of our approach, several examples, including an application to a type of difference equations, are discussed.