Towards Cross-Lingual Multi-Modal Misinformation Detection for E-Commerce Management

Abstract

The misinformation detection systems are increasingly important in E-commerce management, which detect misinformation on the commodity display page. Misinformation in E-commerce is usually presented as a mismatch between multi-modal information, the detection systems need to find the misinformation across the multi-model information. Furthermore, with the development of E-commerce globalization, we hope to deploy the system in the international E-commerce platform, which may face the difficulty caused by multi-lingual data. To this end, we propose a Cross-lingual Multi-modal Misinformation Detection (CMMD) framework for E-commerce management. The CMMD framework includes a word alignment network that embeds information from different languages into the same feature space and a multimodal fusion structure that fuses text representations and image representations through two self-supervised tasks. With the cooperation of these two modules, the CMMD model could extract rich cross-lingual multi-modal features to achieve accurate misinformation detection. We conduct experiments on the public multi-modal dataset and further apply the proposed CMMD to the real-world E-commerce international platform. The experimental results show that the proposed framework CMMD achieves better performance on the public dataset than some benchmarks and gets satisfactory results in real-world E-commerce management.