Using image recognition to automate assessment of cultural ecosystem services from social media photographs

Abstract

Quantifying and mapping cultural ecosystem services is complex because of their intangibility. Data from social media, such as geo-tagged photographs, have been proposed for mapping cultural use or appreciation of ecosystems. However, manual content analysis and classification of large numbers of photographs is time consuming. This study develops a novel method for automating content analysis of social media photographs for ecosystem services assessment. The approach applies an online machine learning algorithm – Google Cloud Vision – to analyse over 20,000 photographs from Singapore, and uses hierarchical clustering to group these photographs. The accuracy of the classification was assessed by comparison with manual classification. Over 20% of photographs were taken of nature, being of animals or plants. The distribution of nature photographs was concentrated around particular natural attractions, and nature photographs were more likely to occur in parks and areas of high vegetation cover. The approach developed for clustering photographs was accurate and saved approximately 170h of manual work. The method provides an indicator of cultural ecosystem services that can be applied rapidly over large areas. Automated assessment and mapping of cultural ecosystem services could be used to inform urban planning.