Cryogenic power electronics is both advantageous and indispensable in many applications, like deep space probe, military electric vehicle, magnetic resonance imaging etc. Among different semiconductors, the gallium nitride (GaN) high electron mobility transistor (HEMT) is the most promising candidate for cryogenic applications with significant conduction loss and switching loss reductions. Moreover, there is no carrier freeze out effect for the GaN HEMTs, which is applicable in extreme low temperature operating conditions. In this work, the efficiency of GaN HEMTs based power converters with different power levels (from several Watts to several kiloWatts) are evaluated at cryogenic temperature. Three different commercial GaN HEMTs are used in these power converters, including the Texas Instruments LMG5200 80 V GaN half-bridge power stage with integrated gate driver, the GaN Systems 650 V bottomcooled GaN HEMT GS66516B, and the 650 V top-cooled GaN HEMT GS66516T from GaN Systems. Moreover, two different cryogenic power converter evaluation methods (cryogenic chamber and liquid nitrogen channeled through cold plate) are investigated. Three of these power converters are evaluated by using a cryogenic chamber and such that the converter operating environment temperature can be regulated. One of the power converters is evaluated by using liquid nitrogen (LN2) channeled through a cold plate, where the gate driver can be designed to operate at non-cryogenic temperatures to ensure the safe operation of the system. Due to the degraded performance of conventional magnetic components, air core magnetics are used in these power converters to improve the converter efficiency. Efficiency improvements at cryogenic temperature are observed for all the GaN HEMTs and air core magnetics based power converters, which are promising for cryogenic power electronics applications.