This paper presents a technique to monitor the weld penetration in real time by the front-side image sensing of the keyhole welding pool in variable polarity plasma arc welding (VPPAW) of a 6061 aluminium alloy. A novel optical system is developed to acquire the keyhole welding pool images from two sides of the plasma arc welding torch. The geometric sizes of the visible keyhole can be accurately obtained by using the developed image-processing algorithm. The variation in sizes of the visible keyhole has a close relationship with the real diameter of the keyhole. An artificial neural network (ANN) model is established to describe the relationship between the keyhole diameter and the geometrical sizes of the keyhole welding pool obtained from the image.