Motor adaptation is attenuated when sensory feedback about the movement is uncertain. While this was initially shown for small visual errors, attenuation seems not to hold when visual errors are larger and the contributions of implicit adaptation are isolated with the error-clamp method, which makes visual feedback task-irrelevant. Here we ask if adaptation to a similarly large perturbation is attenuated when task-relevant visual feedback is uncertain. In a first experiment, we tested participants on a 30° movement-contingent visuomotor rotation under both low (cursor) and high (cloud of moving dots) visual feedback uncertainty. In line with optimal integration, we found that the early increase in adaptation and final extent of adaptation were reduced with high feedback uncertainty. In a second experiment, we included several blocks of no-feedback trials during the perturbation block to quantify the contribution of implicit adaptation. Results showed that implicit adaptation was smaller with high compared to low feedback uncertainty throughout the perturbation block. The estimated contribution of explicit adaptation was overall small, particularly for high feedback uncertainty. Our results demonstrate an influence of task-relevant feedback, and the resulting target errors, on implicit adaptation. We show that our motor system is sensitive to the feedback it receives even for larger error sizes, and accordingly adjusts its learning properties when our ability to achieve the task goal is affected.