The agency–beliefs–communion (ABC) model and worldview conflict research show that people rate groups as more moral and likable if they rate their ideology as more similar to the ideology of the self. This paper refers to this effect as ideological prejudice. There is a debate whether ideology moderates the effect size of ideological prejudice. Through three observational studies ( NS1 = 700, NS2 = 974, NS3 = 633), this paper contributes to this debate in three ways. First and primarily, the paper shows that ideological prejudice is stronger in conservatives and progressives compared to people with more moderate ideological beliefs. Second, stronger ideological prejudice in ideological extremists (vs. moderates) holds when controlling for stronger ingroup favoritism in ideological extremists (vs. moderates). And third, the paper suggests that higher importance of own ideology in ideological extremists (vs. moderates) may explain why ideological prejudice is stronger in ideological extremists (vs. moderates). These findings develop a part of the ABC model of stereotypes, contribute to worldview conflict research, and help to explain why ideological polarization is divisive.