This paper develops a simple model of corruption between a tax inspector and a taxpayer in which inspectors’ heterogeneity helps explain why it may be optimal for a revenue-maximizing government to tolerate corruption. In our model, tax inspectors could accept a bribe from a taxpayer for under-reporting his income or to avoid harassment in the form of red tape. The government’s problem is to design a tax policy and the associated monitoring probability to enforce it. Raising tax rates increases enforcement costs as it increases bribery incentives, so it is optimal not to set tax rates at a too high level. The optimal tax policy includes an optimal supervision level required to reduce corruption, which in turns depends on tax collectors’ capacity to impose red tape on taxpayers. When bureaucrats are heterogeneous in terms of their capacity to impose red tape costs, an intermediate detection probability might be appropriate efficiency-wise even if it means tolerating some level of corruption. Bureaucrats’ heterogeneity as the likely source of observation of corruption in equilibrium is generic to various environments in which agents’ delegated power is misused for private gains and various examples are discussed in the paper. We also show how a government could face lose–lose as well as win–win situations in the conduct of its revenue collection policies.