As an extension of Pawlak’s rough sets, rough fuzzy sets is proposed to deal with the target concept which is typically fuzzy or uncertain. It is worthwhile to introduce cost-sensitive learning into granular computing, as the granularity with the optimal cost can be selected. In the terms of decision making, test cost and decision cost are the most popular cost types. In the sequential three-way decisions (S3WD) models, the granularity is sensitive to the test cost. Meanwhile, the accuracy is sensitive to the decision cost. Selecting an optimal cost-sensitive granularity for problem solving is helpful for achieving optimal results at the lowest total cost in S3WD. However, it is difficult to evaluate test cost precisely and objectively in real-life applications, and existing works only focus on searching for the total cost as the objective function. In this paper, we firstly present a sequential three-way decisions model with rough fuzzy sets (S3WDRFS). Then, for S3WDRFS and its three regions, the changing rules of their decision cost are revealed in a hierarchical granular structure. By considering user requirements, we propose an optimization mechanism to achieve the optimal cost-sensitive granularity selection based on S3WDRFS model. Finally, the experimental results demonstrate that exemplary optimal granularities can be obtained for high quality decision-making under certain constraints.