Diets containing higher-amylose-content starches were proved to have some beneficial effects on monogastric animals, such as promoting the proliferation of intestinal probiotics. However, current research on the effects of diets with different starch sources on animals at the extraintestinal level is still very limited. We hypothesized that diets with different starch sources may affect lipid-related gene expression and metabolism in the liver of pigs. This study aimed to use adult pig models to evaluate the effects of diets with different starch sources (tapioca starch, TS; pea starch, PS) on the liver gene expressions and metabolism. In total, 48 growing pigs were randomly assigned to the TS and PS diets with 8 replicate pens/group and 3 pigs per pen. On day 44 of the experiment, liver samples were collected for metabolome and transcriptome analysis. Metabolome data suggested that different starch sources affected (p < 0.05) the metabolic patterns of liver. Compared with the TS diet, the PS diet increased (p < 0.05) some unsaturated fatty acids and several amino acids or peptide levels in the liver of pigs. Moreover, transcriptome data indicated the PS diets elevated (p < 0.05) fatty acid β-oxidation-related gene expression in the liver of pigs, and reduced (p < 0.05) unsaturated fatty acid metabolism-related gene expression. The results of quantitative real-time PCR confirmed that the PS diet upregulated (p < 0.05) the expression of acyl-CoA dehydrogenase very long chain (ACADVL), carnitine palmitoyl transferase (CPT) 1A, and malonyl-CoA decarboxylase (MLYCD), and downregulated (p < 0.05) the expression level of cytochrome P450 2U1 (CYP2U1) and aldehyde dehydrogenase 1B1 (ALDH1B1) in the liver. In addition, the results of a Mantel test indicated the muscle fatty acids were significantly closely correlated (p < 0.05) with liver gene expressions and metabolites. In summary, these findings suggest that diets containing higher amylose starches improved the lipid degradation and the unsaturated fatty acid levels in pig livers, and thus can generate some potential beneficial effects (such as anti-inflammatory and antioxidant) on pig health.