Multi-attribute group decision-making (MAGDM) is widely applied to various areas for solving real-life problems, including technology selection, credit assessment, strategic planning evaluation, supplier selection, etc. To describe the complex and imprecise cognition, it is more convenient to provide the decision-making information in linguistic terms rather than concrete numerical values. Thus, several linguistic models, such as the fuzzy linguistic approach (FLA), hesitant fuzzy linguistic term sets (HFLTSs), hesitant intuitionistic fuzzy linguistic term sets (HIFLTSs), and probabilistic linguistic term sets (PLTS) have been proposed successively. Due to the flexibility and comprehensiveness of PLTS, it has aroused growing concern. However, it also has a big limitation of requiring the membership degree to be 1 by default, and it does not consider the degree of non-membership and hesitancy of a linguistic variable. Therefore, the probabilistic hesitant intuitionistic fuzzy linguistic term sets (PHIFLTSs) have been presented to extend the PLTS by combining the membership and non-membership in symmetry to depict the evaluation of the experts. To overcome the existing shortcomings and enrich the methodology framework of PHIFLTSs, some novel operational laws are defined to extend the applicability and methodology of the PHIFLTSs in MAGDM. Furthermore, the distance and correlation measures for the PHIFLTSs are improved to make up the shortage of the current distance measures. In addition, the unbalanced linguistic terms are taken into account to represent the cognitive complex information of experts. At last, a MAGDM model based on the multiplicative multi-objective optimization by ratio analysis (MULTIMOORA) approach with the use of the developed novel operational laws and correlation measures is presented, which results in more accuracy and effectiveness. A real-word application example is presented to demonstrate the working of the proposed methodology. Moreover, a thorough comparison is done with related existing works in order to show the validity of this methodology.