The use of artificial intelligence (AI) has grown dramatically in the past few years in the United States and worldwide, with more than 300 AI-enabled devices approved by the U.S. Food and Drug Administration (FDA). Most of these AI-enabled applications focus on helping radiologists with detection, triage, and prioritization of tasks by using data from a single point, but clinical practice often encompasses a dynamic scenario wherein physicians make decisions on the basis of longitudinal information. Unfortunately, benchmark data sets incorporating clinical and radiologic data from several points are scarce, and, therefore, the machine learning community has not focused on developing methods and architectures suitable for these tasks. Current AI algorithms are not suited to tackle key image interpretation tasks that require comparisons to previous examinations. Focusing on the curation of data sets and algorithm development that allow for comparisons at different points will be required to advance the range of relevant tasks covered by future AI-enabled FDA-cleared devices.