The interactions between tumor immune microenvironment (TIME) and pancreatic cancer cells can affect chemotherapeutic efficacy; however, the mechanisms still remain largely unknown. Thirty items in TIME were comprehensively screened by using tissue microarray from pancreatic cancer patients. Their expressions, interconnections and predictive roles for survival were analyzed. Twenty-one of 30 items could stratify the survival of the patients; however, multivariate analysis found that only 5 independent risk factors could predict worse survival (M2-polarized tumor-associated macrophages (TAMs), IgG4 positive cells, TGF-β1, GM-CSF and lymphangiogenesis). They had a much higher expression levels in tumoral tissue, compared to peritumoral tissue. The Spearman analysis showed that M2-polarized TAM, TGF-β1 and GM-CSF were positively correlated with pancreatic cancer stem cells (PCSC), angiogenesis and lymphangiogenesis. Both human and murine pancreatic cancer cells could induce M2-polarized TAM, which showed substantial roles to decease chemotherapeutic effects. After treated by gemcitabine, both human and murine pancreatic cancer cell lines expressed higher level of immune check points, PCSC markers and varieties of immunosuppressive factors; however, TGF-β1 and GM-CSF had the highest increase. Based on the above results, TGF-β1 and GM-CSF were proposed to be the optimal potential targets to improve chemotherapeutic effects. In immunocompetent murine models, we demonstrated that combined blockade of TGF-β1 and GM-CSF improved the chemotherapeutic effects by inhibition of M2-polarized TAM and induction of CD8 positive T cells. This study presents a novel promising combined strategy to improve the chemotherapeutic effects for pancreatic cancer.