Objective The paper aimed to analyze the clinical, serological, and imaging features of autoimmune pancreatitis (AIP) and the prognostic factors affecting hormone therapy. Methods A total of 106 patients with AIP enrolled in our hospital from March 2016 to August 2018 were treated with the hormone. The curative effect and recurrence were followed up. The patients were divided into relapse group (n = 42) and nonrelapse group (n = 64) according to the recurrence within 3 years after initial hormone therapy. The symptoms and signs, laboratory examination, and treatment were compared, and binary logistic regression was employed to explore the risk factors of AIP recurrence. Results Among the 106 patients included in this study, there were 78 males and 28 females, with a male-to-female ratio of 3:1. The average age of onset was 56.25 ± 8.87 years; the minimum age was 39 years; and the maximum age was 7 years. The main clinical symptoms were jaundice (67.92%), abdominal pain (48.11%), and abdominal distension (33.96%). In addition, there were symptoms of weight loss, nausea, vomiting, itching, and gray stool. Previous complications included 27.35% diabetes (29/106), 22.64% hypertension (24/106), 35.84% smoking (38/106), and 28.30% alcohol consumption (30/106). The serological characteristics were mainly the increase in serum IgG4 level; 92.45% (98/106) level was higher compared to the upper limit of normal value; the median level was 11.65 g/L; and the highest level was 35.79 g/L. A total of 88.67% (94/106) had an abnormal liver function. The results of imaging examination indicated that 58.49% (62/106) of extrapancreatic organs were involved, of which 46.22% (49/106) were the most common bile duct involvement. All the patients in the group reached a state of remission after hormone treatment. After the disease was relieved, the patients were followed up for 3 years. The recurrence rate was 39.62% (42/106), and the median time of recurrence (month) was 9 (range 2–36). The recurrence rates within 1, 2, and 3 years were 20.75%, 31.13%, and 39.62%, respectively. Among the recurrent patients, 52.38% (22/42) relapsed within 1 year, 78.57% (33/42) within 2 years, and 100.00% (42/42) within 3 years. Multivariate analysis showed that the short duration of glucocorticoid therapy and involvement of extrapancreatic organs were risk factors for relapse after glucocorticoid therapy in patients with type I AIP. Conclusion Type 1 AIP is more common in middle-aged and elderly men. The clinical symptoms of jaundice, abdominal pain, and abdominal distension are common, often accompanied by involvement of extrapancreatic organs, of which bile duct involvement is the most common. Type 1 AIP glucocorticoid treatment acceptance and disease remission are better, but the recurrence rate is higher after glucocorticoid treatment. Patients with a short time of glucocorticoid treatment and involvement of extrapancreatic organs may have a higher risk of recurrence.