When tracking moving objects in space humans usually attend to the objects' spatial locations and update this information over time. To what extent do surface features assist attentive tracking? In this study we asked participants to track identical or uniquely colored objects. Tracking was enhanced when objects were unique in color. The benefit was greater when the distance between distractors and targets was smaller, but was eliminated when the objects changed colors 1 to 4 times per second, even though at any instant they were always uniquely colored. In addition, tracking uniquely colored objects impaired a secondary color-memory task more than tracking identical objects, and holding several colors in working memory eliminated the advantage of tracking uniquely colored objects. Contrary to previous studies showing that feature information is poorly retained during tracking, these findings indicate that surface properties are stored in visual working memory to facilitate tracking performance.