The prerequisite for businesses’ success, competitiveness, and non-bankruptcy is their performance. An effective performance measurement system is a suitable tool for measuring and improving business performance. The development in performance measures moved from financial measures focused on company profitability to measurement systems combining different methods, approaches, and tools. The paper aims to identify key performance indicators for Slovak heating companies based on the developed integrated performance measurement system. The analysis sampled 292 Slovak companies within SK NACE 35 (heating industry). The performance measurement system was built on balanced scorecard principles, while the least absolute shrinkage and selection operator (Lasso regression) method was used to select financial indicators. Based on the combination of the above methods, a performance measurement system framework for the analyzed sample of businesses was created. The results show that when managing performance, the analyzed businesses should focus on the following financial performance indicators: Receivables turnover ratio, Return on equity, Return on costs, Total debt to total assets, Material intensity, Labor to revenue ratio, Netto cash flow to assets, Net working capital to total assets, and Short-term liabilities to assets. When building performance measurement system based on balanced scorecard principles, financial indicators were supplemented by non-financial ones. In addition to the original balanced scorecard principles, the performance measurement system was extended by environmental constituents. Also, the paper’s deliverable combines Lasso regression and balanced scorecard principles in order to select key performance indices. AcknowledgmentThis paper is prepared within the grant scheme VEGA No. 1/0741/20 (the application of variant methods in detecting symptoms of possible bankruptcy of Slovak businesses in order to ensure their sustainable development).