Recently, vision-based unmanned aerial vehicle (UAV) swarming has emerged as a promising alternative that can overcome the adaptability and scalability limitations of distributed and communication-based UAV swarm systems. While most vision-based control algorithms are predicated on the detection of neighboring objects, they often overlook key perceptual factors such as visual occlusion and the impact of visual sensor limitations on swarm performance. To address the interaction problem of neighbor selection at the core of self-organizing UAV swarm control, a perceptually realistic finite perception visual (FPV) neighbor selection model is proposed, which is based on the lateral visual characteristics of birds, incorporates adjustable lateral visual field widths and orientations, and is able to ignore occluded agents. Based on the FPV model, a neighbor selection method based on the Acute Angle Test (AAT) is proposed,
which overcomes the limitation that the traditional neighbor selection mechanism can only interact with the nearest neighboring agents. A large number of Monte Carlo simulation comparison experiments show that the proposed FPV+AAT neighborselection mechanism can reduce the redundant communication burden between large scale self-organized UAV swarms, and outperforms the traditional neighbor selection method in terms of order, safety, union, connectivity, and noise resistance.