We propose a new portfolio optimization framework, partially egalitarian portfolio selection (PEPS). Inspired by the celebrated LASSO regression and its recent variant partially egalitarian LASSO (PELASSO) developed in [1] in the context of the forecast combinations problem in econometrics in [1], we regularize the mean-variance portfolio optimization of Markowitz by adding two regularizing terms that essentially zero out portfolio weights of some of the assets in the portfolio and select and shrink portfolio weights of the remaining assets towards equal weights to hedge against parameter estimation risk. We solve our PEPS formulations by applying Gurobi 9.0 mixed integer optimization (MIO) solver that allow us to tackle large-scale portfolio problems. We test our PEPS portfolios against an array of classical portfolio optimization strategies on a number of datasets in the US equity markets. The PEPS portfolios exhibit the highest out-of-sample Sharpe ratios in all instances considered.