Probabilistic dual hesitant fuzzy set (PDHFS) is a more powerful and important tool to describe uncertain information regarded as generalization of hesitant fuzzy set (HFS) and dual HFS (DHFS), not only reflects the hesitant attitude of decision-makers (DMs), but also reflects the probability information of DMs. Score function of fuzzy number and weighting method are very important in multi-attribute group decision-making (MAGDM) issues. In many fuzzy environments, the score function and entropy measure have been proposed one after another. Firstly, based on the detailed analysis of the existed score function of PDHF element (PDHFE) and with the help of previous references, we build a novel score function for PDHFE. Secondly, a combined weighting method is built based on the minimum identification information principle by fusing PDHF entropy and Criteria Importance Through Intercriteria Correlation (CRITIC) method. Thirdly, a novel PDHF MAGDM approach (PDHF-EDAS) is built by extending evaluation based on distance from average solution (EDAS) approach to the PDHF environment to solve the issue that the decision attribute information is PDHFE. Finally, the practicability and effectiveness of the PDHF MAGDM technique is verified by suppliers selection (SS) and comparing analysis with existing methods.