Theoretical studies suggest that there is a close association between fiscal decentralization and economic growth. However, whether this linkage holds in China or not is a matter of ongoing debate in recent empirical studies. In this paper, we investigate the impact of the 1994 tax sharing system on economic growth in China. Using a panel dataset for 29 provinces in China over the 1995–2014 period in a simultaneous equations system that controls for the simultaneity of fiscal decentralization, physical capital accumulation and economic growth, the influence of decentralization on economic growth is estimated. The estimation results indicate that there is an inverted-U shaped relationship between fiscal decentralization and economic growth. Because the optimal level of fiscal decentralization that maximizes economic growth is higher than the data for most provinces, further decentralization is in general helpful to China’s economic growth.