A comparative exercise for estimating the uncertainty associated with new methods for power performance measurements was coordinated by the International Energy Agency (IEA) Wind Task 32. Both IEA Task 32 and the Power Curve Working Group (PCWG) have identified the application of the new uncertainty guidelines as a problem area. One time series dataset from a wind turbine, hub height mast and vertical profiling lidar was provided to calculate the power curve using three different wind speed definitions. For each wind speed definition, participants had to estimate the wind speed measurement uncertainty based on the guidance provided by the June 2016 Final Draft International Standard (FDIS) of IEC 6140012-1 Edition 2. The comparative exercise included three iterations over the course of one year to incrementally harmonize the calculations and assumptions. The exercise showed significant variability among participants reflecting difficulty with the interpretation and application of the informative guidance. It also demonstrated that when using current technology and the available calibration techniques the use of a standalone lidar with a short met mast resulted in a significantly higher uncertainty compared to only using a hub height mast (with some measurements of wind shear and wind veer in the lower rotor).