Abstract

Natural language constitutes a predominant medium for much of human learning and pedagogy. We consider the problem of concept learning from natural language explanations, and a small number of labeled examples of the concept. For example, in learning the concept of a phishing email, one might say ‘this is a phishing email because it asks for your bank account number’. Solving this problem involves both learning to interpret open ended natural language statements, and learning the concept itself. We present a joint model for (1) language interpretation (semantic parsing) and (2) concept learning (classification) that does not require labeling statements with logical forms. Instead, the model prefers discriminative interpretations of statements in context of observable features of the data as a weak signal for parsing. On a dataset of email-related concepts, our approach yields across-the-board improvements in classification performance, with a 30% relative improvement in F1 score over competitive methods in the low data regime.

Highlights

  • The ability to automatically learn concepts1 from examples is a core cognitive ability, with applications across diverse domains

  • We introduce the problem of concept learning from natural language

  • We observe that Learning from Natural Language (LNL) models perform significantly better than Keyword filtering (p < 0.05), indicating that the model leverages the expressiveness of our logical language

Read more

Summary

Introduction

The ability to automatically learn concepts from examples is a core cognitive ability, with applications across diverse domains. Examples of such concepts include the concept of a ‘negative review’ in product reviews, the concept of ‘check’ over the domain of game states in chess, the concept of ‘fraud’ in credit history analysis, etc. Methods that can automatically leverage regularities in large amounts of labeled training data. Acquiring large quantities of labeled data may be infeasible because of a long tail of concepts that are highly domain or user specific. To an email assistant in order to better manage her/his inbox These concepts might be irrelevant to a general user

Objectives
Methods
Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call