The assessment of the thermal energy performance of earth-based buildings with respect to the semi-arid Mediterranean climate of Morocco is scarce, even if the country is historically known for its earthen dwellings. According to this need, this work aims to understand and evaluate the indoor thermal comfort and energy performances of passive building in two different locations. We have used EnergyPlus modeling tool and in addition, the monitored ten-day indoor temperatures in two different thermal zones in the test prototype to justify the empirical validation of Building Energy Model. The findings demonstrate, the use of compressed earth blocks coupled with passive design strategies provides better comfort and great sustainability. Thus, the summer discomfort hours are reduced about 12% for both cities compared to conventional building. However, the combination of semi-arid climate-responsive passive design has allowed to reach a thermal energy intensity reduction difference from 20 to 65 kWh.m−2. y−1.