The dynamo action, which is of importance in the study of the geomagnetism mechanism, is considered to be caused by the convection structure formed inside a rotating spherical shell. This convection structure elongated in the rotation axis is generated by the action of both heat and rotation on the fluid inside a spherical shell. In this study, we analyzed thermal convection in such a rotating spherical shell and attempted to understand the phenomenon of this convective structure. It is known that each value of the Prandtl number, the Ekman number and the Rayleigh number and their balance are important for the generation of such convective structure. We fixed these three parameters and considered the effect of centrifugal buoyancy as the Froude number additionally. To investigate how the effects of centrifugal buoyancy affect the convective structure, we carried out both three-dimensional numerical simulations and linear stability analyses. In particular, we focused on the transition from axisymmetric flow to non-axisymmetric flow having wavenumbers in the toroidal direction and investigated both growth rate and phase velocity of the disturbance. It was found that axisymmetric flow tends to be maintained as the effect of centrifugal buoyancy increases.