Wireless Capsule Endoscopy (WCE) is a medical diagnostic technique recognized for its minimally invasive and painless nature for the patients. It uses remote imaging techniques to explore various segments of the gastrointestinal (GI) tract, particularly the hard-to-reach small intestine, making it an effective alternative to traditional endoscopic techniques. However, physicians face a significant challenge when it comes to analyzing a large number of endoscopic images due to the effort and time required. It is therefore imperative to implement aided-diagnostic systems capable of automatically detecting suspicious areas for subsequent medical assessment. In this paper, we present a novel approach to identify gastrointestinal tract abnormalities from WCE images, with a particular focus on ulcerated areas. Our approach involves the use of the Median Robust Extended Local Binary Pattern (MRELBP) descriptor, which effectively overcomes the challenges faced when WCE image acquisition, such as variations in illumination and contrast, rotation, and noise. Using machine learning algorithms, we conducted experiments on the extensive Kvasir-Capsule dataset, and subsequently compared our results with recent relevant studies. Noteworthy is the fact that our approach achieved an accuracy of 97.04% with the SVM (RBF) classifier and 96.77% with the RF classifier.