Abstract

This research aims to build a Mandarin named entity recognition (NER) module using transfer learning to facilitate damage information gathering and analysis in disaster management. The hybrid NER approach proposed in this research includes three modules: (1) data augmentation, which constructs a concise data set for disaster management; (2) reference model, which utilizes the bidirectional long short-term memory–conditional random field framework to implement NER; and (3) the augmented model built by integrating the first two modules via cross-domain transfer with disparate label sets. Through the combination of established rules and learned sentence patterns, the hybrid approach performs well in NER tasks for disaster management and recognizes unfamiliar words successfully. This research applied the proposed NER module to disaster management. In the application, we favorably handled the NER tasks of our related work and achieved our desired outcomes. Through proper transfer, the results of this work can be extended to other fields and consequently bring valuable advantages in diverse applications.

Highlights

  • We developed a conversation-based system for school building safety inspections [1]

  • Based on the existing model of named entity recognition (NER), transfer learning is applied in three different levels [17]

  • This work provides an augmented NER model designed for disaster management

Read more

Summary

Introduction

The system is a chatbot developed for supporting school building inspection tasks, and the main contribution is the process improvement of questions analysis and information retrieval. Supervised learning involves building statistical models from labeled training data. As the official dictionary for formal terms and the existing reviews of school building safety inspection for the current research are inadequate to build a brand-new NER model, we attempt to introduce transfer learning, which is one of the most popular frontiers of machine learning, to solve the issue of data shortage. Under the current definition, transfer learning aims to learn from one or more original tasks and apply the result to the target tasks. Based on the existing model of NER, transfer learning is applied in three different levels [17]

Objectives
Results
Discussion
Conclusion
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.