Warming can cause changes in the structure and functioning of microbial food webs. Experimental studies quantifying such impacts on microbial plankton have tended to consider constant temperature conditions. However, Jensen’s inequality (or the fallacy of the average) recognizes that organism performance under constant conditions is seldom equal to the mean performance under variable conditions, highlighting the need to consider in situ fluctuations over a range of time scales. Here we review some of the available evidence on how warming effects on the abundance, diversity, and metabolism of microbial plankton are altered when temperature fluctuations are considered. We found that fluctuating temperatures may accentuate warming-mediated reductions in phytoplankton evenness and gross photosynthesis while synergistically increasing phytoplankton growth. Also, fluctuating temperatures have been shown to reduce the positive warming effect on cyanobacterial biomass production and recruitment and to reverse a warming effect on cellular nutrient quotas. Other reports have shown that fluctuations in temperature did not alter plankton responses to constant warming. These investigations have mostly focused on a few phytoplankton species (i.e. diatoms and haptophytes) in temperate and marine ecosystems and considered short-term and transient responses. It remains unknown whether the same responses apply to other species and ecosystems and if evolutionary change in thermally varying environments could alter the magnitude and direction of the responses to warming observed over short-term scales. Thus, future research efforts should address the role of fluctuations in environmental drivers. We stress the need to study responses over different biological organization and trophic levels, nutritional modes, temporal scales, and ecosystem types.