In this article, we study some classical complexity-theoretic questions regarding Group Isomorphism ( GpI ). We focus on p -groups (groups of prime power order) with odd p , which are believed to be a bottleneckcase for GpI , and work in the model of matrix groups over finite fields. Our main results are as follows: • Although search-to-decision and counting-to-decision reductions have been known for more than four decades for Graph Isomorphism , they had remained open for GpI , explicitly asked by Arvind and Torán ( EATCS Bull. , 2005). Extending methods from Tensor Isomorphism (TI) (Grochow and Qiao, ITCS 2021), we show moderately exponential-time such reductions within p -groups of class 2 and exponent p . • Despite the widely held belief that p -groups of class 2 and exponent p are the hardest cases of GpI , there was no reduction to these groups from any larger class of groups. Again using methods from TI (ibid.), we show the first such reduction, namely from isomorphismtesting of p -groups of “small” class and exponent p to those of class two and exponent p . For the first results, our main innovation is to develop linear-algebraic analogues of classical graph coloring gadgets, a key technique in studying the structural complexity of Graph Isomorphism . Unlike the graph coloring gadgets, which support restricting to various subgroups of the symmetric group, the problems we study require restricting to various subgroups of the general linear group, which entails significantly different and more complicated gadgets. The analysis of one of our gadgets relies on a classical result from group theory regarding random generation of classical groups (Kantor and Lubotzky, Geom. Dedicata , 1990). For the nilpotency class reduction, we combine a runtime analysis of the Lazard correspondence with TI-completeness results (Grochow and Qiao, ibid.).