Photovoltaic energy storage system (PV-ESS) prosumer aggregators are characterized by a large number but small scale in the distribution system and are not competitive enough to participate in market transactions. For this reason, a prosumer aggregator alliance is proposed to participate in the distribution market bidding strategy. Firstly, based on the framework for prosumer aggregator alliances participating in distribution market trading, a bilevel bidding model is constructed. The upper level represents the optimal decision-making model for the prosumer aggregators, while the lower level constitutes the distribution market-clearing model. Secondly, the additional benefits obtained by the alliance are distributed more fairly using the improved Shapley value based on the PV self-consumption rate. Given the problem that the traditional diagonalization algorithm (DA) has an excessive number of iterations when solving the game equilibrium problem of multiple subjects, the DA is improved by optimizing the initial value of the inputs. Finally, case studies are conducted based on the improved IEEE-33 bus distribution system to validate the feasibility and economic viability of the proposed strategy. The case study results show that forming cooperative alliances to participate in market bidding can significantly increase overall profits. The improved DA reduces the number of bids and computation time by 75% and 80%, respectively. Additionally, the improved Shapley value facilitates compensation for some of the aggregators.