This paper compares the Non-dominated sorting genetic algorithm-II, Pareto envelope-based selection algorithm-II, and Strength Pareto evolutionary algorithm-II, while optimizing a benchmark combined heat and power system with two conflicting objectives. The most effective algorithm is determined based on the statistical parameters evaluated from 30 runs of execution, considering the hypervolume indicator and the average computational time as the performance criteria. A comparative assessment shows that the Pareto envelope-based selection algorithm-II is superior to the other two algorithms. Further, in this study, a multi-criteria decision analysis is performed on the Pareto set obtained from the Pareto envelope-based selection algorithm-II, using the technique for order preference by similarity to an ideal solution, combined with the Entropy method. To show the advantages of multi-objective optimization, the optimal solutions are also compared with the base case, and previously published results of the benchmark problem corresponding to single-objective optimization. From the Pareto envelope-based selection algorithm-II derived optimal solutions, 15.82% increase in the exergy efficiency and 12.22% reduction in the system cost rate are achieved over the base case results. The present optimal exergy efficiency is 11.89% higher and the system cost rate is 1.9% lower than the single-objective based optimal results.