Efficient estimation of the uncertainty associated with wind speed forecast is crucial for evaluating wind farms' power quality and operation. Typically, the performance of prediction interval (PI) generating models; is restricted in terms of computational efficiency inheritably from the sequential data processing; whereas restrictions in forecast quality are derived from the PI generation techniques. This paper presents an efficient Gated Multi-Scale Convolutional Sequence Model (GMSCSM) to forecast wind speed PIs. GMSCSM while conserving the ‘recurrence’ of LSTMs also offers ‘parallel input’ advantage of CNNs for better computational efficiency which is highly desirable for short-term forecasting models. In addition, capturing features at various scales in the sequence, GMSCSM learns both local details and global context which is vital for multi-horizon forecasts. The model generates quality PIs utilizing an improved quality-driven loss which we proposed by invoking calibration assessment in its existing definition. Forecasts generated for eight different datasets obtained from two different wind farms show an improvement of 30 % and 6 % in the average coverage width criterion index while reducing the model training time to nearly half and one third of the respective values obtained from traditional and LSTM based models which showcases the proposed model's excellent prediction capability and efficiency.