Mining Text and Web

Introduction

The purpose of text mining is to process the unstructured textual data and extract meaningful required information from the available text data.

Text mining is helpful in comparing and finding the relevant text information from the available text data.

The text mining involves tasks like information retrieval, quantitative text analysis, sentimental analysis ( extracting information like  mood , emotion, opinion, sentiment etc.), machine translation etc.

Natural Language Processing (NLP)

Natural Language Processing (NLP) is the branch of  Artificial Intelligence and Computational Linguistics and helps in interaction between the computer and natural languages.
The common NLP tasks included in the software are sentence segmentation, part-of-speech tagging and parsing.

The different logical steps in NLP are:

Morphological analysis
In this step, the punctuations are separated from the sentences.

Syntax analysis (Parsing)
It basically involves the stages of lexical analysis and grammar. The linear sequence of words are transformed into structures and further specifies how words relate to each other.

Semantic analysis
In this step, the meanings are assigned to the structures which are initially created in parsing.

Pragmatic analysis
It involves re-interpretation of language , verification and generation of final output result.