Attention deficits, a hallmark of many neuropsychiatric disorders, significantly impair quality of life and functional outcome for patients. Continuous Performance Tests (CPTs) are widely used to assess attentional function in clinical settings and have been adapted for mice as the rodent Continuous Performance Test (rCPT). In this study, we combined traditional analyses of rCPT performance with markerless pose estimation using DeepLabCut and visual field analysis (VFA) to objectively measure the orientation of mice toward stimuli during rCPT sessions. Additionally, we extended session lengths to assess performance decrements over time. Our findings show that extending rCPT sessions from 45 to 90 minutes results in a significant decline in performance in male mice, which aligns with performance decrements observed in clinical research. Importantly, physical engagement with the task remained relatively stable throughout the session, even as performance deteriorated. This suggests that the performance decline specifically reflects a time-on-task (TOT)-dependent vigilance decrement rather than physical disengagement. We also investigated the effects of amphetamine, an FDA-approved treatment for attention-deficit/hyperactivity disorder (ADHD), on rCPT performance. Amphetamine significantly improved rCPT performance in male mice by reducing false alarms without modulating orientation or physical engagement with the task stimuli. Collectively, these findings validate a behavioral tracking platform for objectively measuring physical engagement in the rCPT and a task modification that accentuates TOT-dependent performance decrements, enhancing the translational value of the rCPT for studies related to human neuropsychiatric disorders.