The employment rate for Black men worsened significantly relative to White men during the second half of the 20th century. We explore the role of broad sectoral shifts in labor demand over this period in explaining this trend. We first quantify changes in local employment rates and population in response to local labor demand shifts for both groups of workers. We then combine our estimates with a stylized model that incorporates frictional local labor markets and imperfect mobility across markets. Our framework enables us to aggregate local responses while accounting for geographic mobility and regional employment composition. We find that sectoral reallocation can account for at most, one-fifth of the total exacerbation in the employment rate differential between Black and White men over 1970–2010. Out-migration from harder-hit markets, while large, only slightly mitigates the impact of negative labor demand shifts. We also find that most of the predicted change in the employment rate differential is due to differential response rather than differential exposure to sectoral shifts across groups.