Validity is the most important factor in good research, and it cannot be taken for granted. As the term is used here, validity is determined by (a) whether the research actually addresses the question that it is intended to address; and (b) whether the inferences drawn from it, by its authors and by subsequent reviewers, are legitimate. Validity thus depends on the goals of the research. While a variety of meaningful goals can be identified, the primary goal of WCF research is to determine if WCF is an effective way to improve learners’ ability to write accurately and should therefore be used in language instruction. Judging validity in terms of this goal, it is argued here that problems are pervasive. Goals are confused, a variety of fundamental issues in design and analysis make a study unable to address the primary question, and far too much emphasis is placed on one very narrow feature, commonly studied in ways which themselves lack validity. These problems are reflected in the meta-analyses done on this topic; as a result, this work is not presenting us with a valid picture of the effects of WCF. Altogether, this research area has major validity problems; dealing with these problems should be the top priority for researchers.