This article provides a genealogy of the discourses that shaped the public housing policies of the mid-twentieth century in the US island colony of Puerto Rico. In the 1950s and 1960s, a conversation arose between government officials, social science experts, and the local press about how to fix social inequalities by ‘ordering’ mostly black and mulato, economically dispossessed families residing in shantytowns and barrios. This led to the establishment of caseríos (housing projects) as places where the government would attempt to ‘modernize’ residents through architectural design, planning, and social betterment programs. Because the caseríos did not address the structural causes of inequalities of power and wealth in the island, they failed in lifting residents out of poverty. From the mid-1960s onwards, a host of writings blamed caserío dwellers for the failure of the projects, attributing it to their purportedly dysfunctional – and nearly incorrigible – ‘culture of poverty’. This perpetuated a particular characterization of Puerto Rican economically dispossessed people as incapable of political or social agency without the guidance of elite Puerto Ricans and the ‘benevolent’ American colonial metropolis. It also led to the subsequent ‘bordering’ of caseríos spaces with walls and checkpoints, which in turn reproduced the branding of public housing residents as irreparably dysfunctional and ‘criminal’.