Super-resolution reconstruction is an essential task of seismic inversion due to the low resolution and strong noise of field data. Popular deep networks derived from U-Net lack the ability to recover detailed edge features and weak signals. In this paper, we propose a dual decoder U-Net (D <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> UNet) to explore both detail and edge information of the data. The encoder inputs the low resolution image and the edge image obtained through the Canny algorithm. Edge image can provide rich shape and boundary information, which is helpful to generate more accurate and high-quality data. The dual decoder consists of a main decoder for high-resolution recovery and an edge decoder for edge contour detection. These two decoders interact with a texture warping module (TWM) with deformable convolution. TWM aims to distort realistic edge details to match the fidelity of low resolution inputs, especially the location of edges and weak signals. The loss function is a combination of <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">L</i> <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sub> loss and multi-scale structural similarity loss (MS-SSIM) to ensure perception quality. Results on synthetic and field seismic images show that D <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> UNet not only improves the resolution of noisy seismic images, but also maintains the image fidelity.