ABSTRACT Water Body Extraction (WBE) is a challenging task in remote sensing, owing to the complexity of recognizing surface body objects with rich texture, spatial, spectral, temporal, and radiometric features. The use of spectral indices has shown to be successful in separating surface water from its surroundings at the cost of knowledge of appropriate threshold values. In the absence of knowledge on threshold values, extracting the water from remote sensing data is challenging, which is addressed by several Machine Learning (ML) and Deep Learning (DL) algorithms. However, the effectiveness of both ML and DL classifications is witnessed from visual features to semantic categories at the cost of distinct recognition between the water body and non-water body features. In this paper, a novel Multi Scale Feature Extraction Network (MSFEN) for extracting the pixel-level features from medium resolution remote sensing images is proposed and used traditional ML classifiers to extract the surface water bodies using pixel-level features extracted by MSFEN. The proposed framework is trained and tested on Linear Imaging Self Scanning Sensor – III (LISS-III) multispectral satellite images over major water reservoirs in Tamilnadu, Karnataka, Madhya Pradesh, and Odisha. Experimental results indicate that the proposed model MSFEN+SVM provides accurate extraction results by outperforming the existing state-of-the-art models (Fully Convolutional Network (FCN), Unet, SegNet, Multi Scale Convolutional Neural Network (MSCNN), Deepwater Map, Pyramid Scene Parsing Network (PSPNet), Improved PSPNet, Multi-scale Water Extraction Convolutional Neural Network (MWEN) and Multi-Scale Lake Water Extraction Network (MSLWENet) in terms of performance metrics considered.