There is a great deal of excitement in higher education about the value of adaptive learning to personalize learning paths according to students' individual needs. The authors explored the impact of an Adaptive Learning Platform (ALP) on learning, by comparing learning effectiveness between dental students who used the ALP in a blended learning environment formatively and summatively compared with students who did not use the ALP (i.e., face-to-face), as measured by students' performance on the final exam in a single review preparatory course during the academic years 2013-2018. Paired t-tests showed significant improvement in post-test scores across different course instructional modalities (P < 0.01). The learning gain was greater for students who studied using the ALP summatively (t = 26.20) than those who used it formatively or studied using a face-to-face format (t = 13.10 and 14.13, respectively). Controlling for pre-test scores, analysis of covariance tests indicate that: (1) intervention groups (formative and summative ALP) scored significantly higher than the traditional group (B = 9.34 points, P < 0.01, for summative ALP group) and (B = 4.47 points, P < 0.05, for formative ALP group), and (2) summative ALP group scored significantly higher than formative ALP group (B = 4.84 points, P < 0.05). This study provides empirical evidence that an adaptive learning intervention can have a significant impact on student learning performance. The success of any adaptive learning system relies mainly on sound instructional design. Technology will continue to grow at an overwhelming pace; the cautionary note the authors highlight is that conceptions of pedagogy, complemented by technology, must guide the development of adaptive learning systems.