A driver’s license is key to independence for many young adults, including those with autism spectrum disorders (ASDs). However, individuals with ASDs may face special challenges when learning to drive. If effective driver training is to be devised for this demographic, it is important to determine the nature of these challenges. Driving inherently requires multitasking (e.g. steering, speed maintenance, navigation, hazard detection) and drivers are routinely obligated to combine driving with the demands of listening and responding to others, as occurs during driving lessons. Given that individuals who display traits associated with ASDs may have special difficulties with secondary tasks and especially those that involve socialization, we examined the effects of secondary tasks that involve listening and responding to questions while driving. We compared performance when simply driving (the control condition), driving while listening (the audiobook condition), and driving while listening and speaking (the prompt: answer condition). The autism spectrum quotient (AQ:Baron-Cohen, Wheelwright, Skinner, Martin, & Clubley, 2001), a commonly used self-report questionnaire intended to measure traits associated with ASDs in research, was used to identify young drivers with more and fewer traits related to ASDs in a community sample, (None had a clinical diagnosis of ASD.) Consistent with studies of drivers clinically diagnosed with ASDs, we found that high AQ scorers reported greater mental and physical demand, effort, and frustration when driving, and showed more moment-to-moment variability in lane position and hazard reaction compared to low AQ scorers as measured in a driving simulator. Differences between the low and high scorers were typically largest when secondary tasks were imposed, but the predicted interaction between drive condition and AQ group only emerged in terms of steering variability.