Automatic fabric defect detection and classification is the most important process in the textile industry to ensure the fabric quality. In the existing systems, a learning based method is used for detecting defects in plain weave fabrics. In this paper, a novel MobileNet based Multipath Convolutional Neural Network (MMPCNN) architecture is proposed for detection and classification of simple and complex patterned fabric defects. In the proposed MMPCNN architecture, MobileNet model is used in the first path. In this, Gabor filter bank is used instead of conventional filters in the first convolution layer. A simple convolutional neural network architecture with Gray Level Co-occurrence Matrix (GLCM) features as an input is used in the second path of the MMPCNN architecture. Gabor filters are more useful for analyzing the texture with different orientations and scales. Each Gabor filter parameter has its own impact on analyzing the texture and extracting the information from the texture. Therefore, in this paper, the use of Gabor filter parameters in MMPCNN architecture is analyzed. The proposed model is experimented on the TILDA textile image database and it is able to achieve 100% accuracy with reduced trainable parameters for fabric defect detection and classification.