Making buildings more energy efficient is an important part of achieving the European Union’s energy and climate goals, which several directives, policies, and measures has addressed over the years. This paper aims to study changes over a 10-year period in perception on barriers to and drivers for energy efficiency in the Swedish building sector and identifying success factors. The data collection consists of surveys conducted in 2010 and 2020 among organizations that mainly build, own, and manage multi-dwelling buildings. Besides the overall result, special focus is given to changes depending on type of ownership, size of organization, and organizational hierarchy.Lack of time or other priorities and slim organizations remain the most important barriers, which is most evident among small organizations. Reducing cost remains the major driver. The uncertainty surrounding a rising energy price has diminished and cost-effective solutions are more adaptable. More capital for energy efficiency is available, particularly in the private sector. Furthermore, the result acknowledges the impact of regulatory measures. The study recognizes a connection between organizational development and the integration of energy efficiency in an organizations’ agenda. Future challenges are related to hidden costs and knowledge acquisition.