Abstract
The Smart Culture Lens developed in this study is an application developed by utilizing the visual element classification system of ceramic and AI technology. The user can analyze the visual elements of the ceramic photo taken with a smartphone and search for similar ceramics related to each visual element. For this development, as a first step, visual elements such as color, form, material, and pattern were defined as criteria for classifying ceramic appearance, and the visual element classification system of ceramics was organized. In the second step, 19,610 images of 7,346 ceramics were collected through museum visit photography and web, and a database was built by annotating these images with a visual element classification system. In the third step, representative object detection models, Faster R-CNN and Mask R-CNN were trained based on a ceramic classification system. Through those trained object detection models, visual elements and masks of the input image were recognized, and representative colors of the area were extracted using the k-means algorithm through the recognized masks. The performance of the trained object detection models (Average precision of Form / Material / Pattern 1st-level category = 0.87 / 0.89 / 0.72) shows that the amount of collected data and the established classification system are useful. Finally, by applying the above development results, a mobile application called 'Smart Culture Lens' was developed, and the usefulness of this application was confirmed through a user experience test. This study combines AI technology into cultural heritage so that people can intuitively explore artifacts from a new perspective, which differs from traditional artifact exploring methods. All the detailed processes of this development will be a guide to how to apply AI technology to the cultural heritage.
Highlights
The appearance analysis of artifacts refers to the information from the perspective of purposeful thinking of design
The model was coupled with the Smart Culture Lens mobile app so that the visual elements can be searched through simple photo-taking
With regard to the factors focused on experience, relatively higher scores were obtained from the meaningful factor, including the survey items such as “These products, which combine culture and AI technology, must continue to be developed (4.49, SD=0.54),” “The smart culture lens app should be extended to analyze other cultural artifacts as well as ceramics analysis (4.44, SD=0.57).”
Summary
The appearance analysis of artifacts refers to the information from the perspective of purposeful thinking of design. In the field of cultural heritage, the information on artifacts is generally based on archeological studies about the periods and geographical features or other scientific studies that analyze the materials or the manufacturing methods of the artifacts. These details can be obtained from the internet search and online museum by using search keywords, even without viewing the real objects. The purpose of the analysis of the artifacts in this study is not to provide information for archaeological and historical judgment but to intuitively analyze the appearance information of the artifact from the user’s point of view and provide systematic and fundamental information about the appearance. The data may be used for further studies on the details of artistic expression and provide a basis for the materials that can be employed by the present artists and designers for their creative works
Sign-in/Register to view highlights & summary Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
