Working conditions identification of oil well relies on high-cost and slow-speed artificial inspection in past decades. Working conditions diagnosis through dynamometer cards identification based on machine learning has significant economic value and environmental meaning for oil production. In this paper, we collect dynamometer cards from the famous Chinese Shengli Oil Field as research data. We firstly investigate properties of dynamometers under different working conditions and create a dynamometer card dataset. Further we introduce calibration/visualization preprocess methods, and propose the Oil-Net 1D/2D identification models from the time-series and computer vision views respectively. Experiment results indicate that comparing with other machine learning and time series classification methods, Oil-Net 1D/2D improve identification accuracy significantly. This study provides guidance for the design and implementation of learning-based oil well working conditions intelligent diagnosis system.