Objective Work zone speed is one of the most important factors in road construction safety management. This work presents a computer vision based technique designed to measure lane-specific individual vehicle speed using existing traffic monitoring cameras and computers. The resulted speeds support the influence analysis of factors including traffic control, lane positions, and construction activity. Methods Object detection (YOLOv5) and tracking (Deep-SORT) algorithms are combined to track the vehicles. In particular, 21 days’ worth of road construction videos are collected from a pole-mounted traffic monitoring camera operated by the Texas A&M University Transportation Services. Based on the object detection results, a novel construction activity inference technique is developed to approximate the times when construction workers are present. Based on this time separation, the vehicle speeds with and without the presence of construction activity are compared. Results The proposed framework is able to measure speeds with an error ranging from 0 to 6.4 kilometers per hour (KPH). Detailed analysis of this video data suggests that traffic control with barrels in the median work zone lowers the average speed (for all vehicles) by 15 KPH. The lane adjacent to the work zone also has higher speed variation than the other lanes. The construction activity speed comparisons show when the traffic is slow (possibly traffic after a red light), the difference is statistically significant with a p-value ranging from 0.01 to 0.03. When the traffic is fast (possibly traffic encountering a green signal as they approached the nearby intersection) construction activity has no significant effect on the work zone speeds. Conclusions The proposed CV technique is a reliable and cheap method to measure lane-specific work zone speeds. The derived measurements support detailed safety analysis. Other than work zone speeds, the proposed technique can also be used for regular traffic speed monitoring.