ABSTRACT This article describes the results of a two‐year national study to evaluate the contribution of information technology projects to student learning in higher education in Australia. The study reviewed the outcomes of 104 teaching development grants that made significant use of a range of communication and information technologies in projects which had received a total of 4 million dollars in funding. In approximately 90% of cases, the project leaders reported having had the intention of improving student learning outcomes, but only one third were able to report this as the actual outcome. A review of the evaluation methods used by project leaders revealed a strong focus on student reactions to projects, rather than on methods that would have uncovered student learning outcomes.