The minimum feedback arc set problem (FASP), which seeks to remove a minimum set of arcs from a directed graph to make the remaining graph acyclic, is fundamental in graph algorithms with many applications in social network analysis, circuit testing, deadlock resolution, algorithmic games, and other fields. However, in theory, FASP is NP-Hard and cannot be approximated within any constant under the Unique-Games Conjecture. In practice, the performance of existing algorithms on large graphs is still unsatisfactory. To solve FASP on large graphs, we propose two novel methods in this paper. First, we systematically study the reduction rules for FASP that can quickly reduce the scale of input graphs without losing optimality. We integrate the reduction rules into an algorithm that can be used as a preprocessor for all existing FASP algorithms to simplify the input graphs. Second, we provide a scalable heuristic algorithm based on the divide-and-conquer method for better solution quality. Extensive experiments on a wide range of real-world graphs show that the reduction algorithm effectively reduces the size of input instances. Furthermore, for half of the circuit benchmark graphs, our final algorithm improves the quality of the existing heuristic solution by 24% to 40% within an acceptable running time.