Type 2 diabetes (T2D) is a growing health concern with an estimated 462 million people having been diagnosed worldwide. T2D is characterized by chronically elevated blood glucose and insulin resistance, which culminate in a diminished function of the β-cell mass in its later stages. This can be perpetuated by and result in inflammation, excess reactive oxygen species production, obesity, and the dysregulation of multiple cellular pathways. Many naturally occurring small molecules have been investigated in terms of their roles in modulating glucose homeostasis and β-cell function. Many of these compounds can be found in commonly used sources of food and drink. Interestingly, a correlation has been observed between coffee consumption and T2D incidence. However, the specific compounds responsible for this correlation and their mechanisms are still somewhat undetermined. This paper reviews recent research findings on the effects of several polyphenols that are either found in coffee or are metabolites of compounds found in coffee (enterodiol, enterolactone, matairesinol, secoisolariciresinol, kaempferol, quercetin, and chlorogenic acid) on glucose homeostasis and health complications associated with glucose dysregulation, with a special emphasis on their potential anti-diabetic effects. The factors that affect polyphenol content in coffee are also addressed.