Rapidly responding stimuli-responsive materials can have a benefit in a myriad of applications, for example, sensing and biosensing, actuation, and in drug delivery systems. Thermo- and pH-responsive materials have been among the most widely studied, and can be triggered at physiologically relevant temperatures and pH. Here, we have used a “homologous series” of acids based on the acrylic acid (AAc) backbone and incorporated them into N-isopropylacrylamide (NIPAm)-based microgels. Specifically, the acids used were AAc, methacrylic acid (MAAc), ethylacrylic acid (EAAc), and butylacrylic acid (BAAc), which have pKa’s in the range of 4.25–7.4. The resultant microgels were characterized by optical microscopy, and their responsivity to temperature and pH studied by dynamic light scattering. The microgels were subsequently used to generate optical devices (etalons) and their pH and temperature response was also investigated. We found that the devices composed of BAAc-modified microgels exhibit unusually fast response kinetics relative to those of the rest of the devices. We also found that the speed of the response decreased as the length of the acid pendant group decreased, with AAc-modified microgel-based devices exhibiting the slowest response kinetics. Finally, we showed that the kinetics of the device’s temperature response also decreased as the length of the acid pendant group decreased, which we hypothesize is a consequence of the hydrophobicity of the acid groups, that is, increased hydrophobicity leads to faster responses. Understanding this behavior can lead to the rational design of fast responding materials for the applications mentioned above.