Posts

Showing posts with the label Data Science

Why is NLP Challenging?

Image
In this article, I'll talk about what makes NLP a challenging problem domain ? So let's explore: Ambiguity Ambiguity means uncertainty of meaning. Most human languages are inherently ambiguous. Consider the following sentence: “I made her duck.” This sentence has multiple meanings. The first one is: I cooked a duck for her. The second meaning is: I made her bend down to avoid an object. Here, the ambiguity comes from the use of the word “made.” Which of the two meanings applies depends on the context in which the sentence appears. If the sentence appears in a story about a mother and a child, then the first meaning will probably apply. But if the sentence appears in a book about sports, then the second meaning will likely apply. Below figure contains few examples of ambiguity in language from the Winograd schema challenge . Common Knowledge A key aspect of any human language is “common knowledge” i.e. all facts that most humans are aware of. In any conversation, it is assumed t...