Objectives: The current study compared potential risks, complications, and the impact on clinical outcomes among elderly and younger patients undergoing endoscopic retrograde cholangiopancreatography (ERCP). Methods: Procedure-related complications, risk factors, and clinical outcomes following complications in elderly patients (aged ≥75 years) and younger who underwent biliary ERCP were evaluated. Results: Median age of 63 (48–74) of 1164 patients who underwent biliary ERCP for the first time, and 266 (22.8%) were elderly. Comorbidities were statistically significant (81 [30.5%] versus 78 [8.7%], p < 0.001), and periampullary diverticulum (PAD) was detected more commonly in the elderly group (79 [29.7%] vs. 103 [11.5%], p < 0.001). There was no statistical difference in cannulation technique, cannulation time, and cannulation success in both groups, while the total ERCP procedure time was higher in the elderly group (22 [16–29] vs. 20 [14–29], p = 0.030). Regarding the procedure-related complications, there was no statistically significant difference between the two groups (26 [9.8%] vs. 71 [7.9%], p = 0.292). In the case of complications, the length of hospitalization stay was statistically longer in the elderly group. Moreover, the elderly had a longer length of hospitalization, experiencing pancreatitis and a higher probability of developing moderate/severe pancreatitis. In multivariate and univariate analysis, prolonged cannulation time was found to be an independent risk factor in patients ≥75 years of age. Conclusions: This study showed that while ERCP-related complication rates in elderly patients are comparable to younger patients, it can be associated with worse outcomes following the complication and prolonged length of hospitalization.