Measuring the performance of expert-based evaluation method (EBEM) used for listing and grading heritage buildings: the case of Panaji city

Abstract

PurposeThe identification (listing) and classification (grading) of urban heritage buildings for conservation is a challenging task for urban planners and conservation architects. Most of the world's cities depend on the expert-based evaluation method (EBEM) for listing and grading heritage buildings. The Panaji city in India provided a unique opportunity to assess the performance of the EBEM as two independent agencies carried out the heritage listing and grading process. Considering the case of Panaji, this research aims to measure the performance of EBEM used for listing and grading heritage buildings and identify the issues associated with the existing methodology.Design/methodology/approachThis research presents a comparative analysis of the building listed and graded by the two agencies. The buildings that both agencies graded were identified and analysed using a confusion matrix. The grading classification was tested for accuracy, precision, sensitivity and F-score.FindingsThe result shows a low accuracy and F-score, which reflects the level of buildings misclassified. The misclassification is the product of the lack of standardisation of methodology and the subjectivity level involved in the EBEM.Originality/valueHeritage listing and grading is a time-consuming process, and no city has the time and resource to conduct studies to check the accuracy. The cities in India and across the world, which follow a similar EBEM process, should consider this study's finding and revisit their methodology and develop a more reliable methodology for listing and grading heritage buildings.