Conventional homojunction bipolar junction transistors (BJTs) are not suitable for cryogenic operation due to heavy doping-induced emitter band-gap narrowing and strong degradation in current gain (β) at low temperature. In this letter, we show that, on lateral version of the BJTs (LBJTs) fabricated on silicon-on-insulator (SOI) substrate, such β degradation can be mitigated by applying a substrate bias (V <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">sub</sub> ), and a β over unity is achieved in a base current (I <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">B</sub> ) range over 5 orders of magnitudes at 4.2 K, with a peak β ~ 100 demonstrated. The β improvement is explained by the enhanced electron tunneling through base region as a result of base barrier lowering and thinning by a positive Vsub, which leads to dramatic increase of collector current (IC) while IB is negligibly affected.