Home / Blog / Data Science Digital Book / Text Mining
Text Mining
Meet the Author : Mr. Bharani Kumar
Bharani Kumar Depuru is a well known IT personality from Hyderabad. He is the Founder and Director of AiSPRY and 360DigiTMG. Bharani Kumar is an IIT and ISB alumni with more than 18+ years of experience, he held prominent positions in the IT elites like HSBC, ITC Infotech, Infosys, and Deloitte. He is a prevalent IT consultant specializing in Industrial Revolution 4.0 implementation, Data Analytics practice setup, Artificial Intelligence, Big Data Analytics, Industrial IoT, Business Intelligence and Business Management. Bharani Kumar is also the chief trainer at 360DigiTMG with more than Ten years of experience and has been making the IT transition journey easy for his students. 360DigiTMG is at the forefront of delivering quality education, thereby bridging the gap between academia and industry.
Table of Content
Analyzing unstructured Text data by generating structured data in key-value pair form. Deriving insights from the extracted keywords by arranging the extracted keywords in a plain space with font sizes varying based on their frequency is called WordCloud.
Collect the text data / Extract data from sources.
Pre-Process the Data
- Typos
- Case - uppercase / lowercase / proper case
- Punctuations & special symbols (‘%’, ‘!’, ‘&’, etc.)
- Filler words, connectors, pronouns (‘all’, ‘for’, ‘of’, ‘my’, ‘to’, etc.)
- Numbers
- Extra White spaces
- Custom words
- Stemming
- Lemmatization
- Tokenization - Tokenization refers to the process of splitting a sentence into its constituent words
Click here to learn Data Science in Hyderabad
Document Term Matrix / Term Document Matrix
Documents arranged in rows and Terms arranged in columns is called as DTM and transpose of DTM is TDM.
Word Cloud
Positive Word Cloud - words present in positive dictionary.
Negative Word Cloud - words present in negative dictionary.
Bigram - two words repeated together - gives better context of the content.
Click here to learn Data Science in Bangalore
Natural Language Processing (NLP)
Text Analytics is the method of extracting meaningful insights and answering questions from text data.
Natural Language Understanding(NLU)
A process by which an inanimate object (not alive - machines, systems, robots) with computing power is able to comprehend spoken language.
Example: Humans talk to robot
Click here to learn Data Analytics in Bangalore
Natural Language Generation (NLG)
A process by which an inanimate object (not alive - machines, systems, robots) with computing power is able to manifest its thoughts in a language that humans are able to understand.
Example: Robot responds to human queries
Click here to learn Data Analytics in Hyderabad
Topic Modeling Algorithms
LSA/LSI (Latent Semantic Analysis/Latent Semantic Indexing)
Reducing dimension for classification. LSA assumes that the words will occur in similar pieces of text if they have similar meaning.
LDA (Latent Dirichlet Allocation)
A topic modelling method that generates topics based on words/expression frequency from documents.
Click here to learn Machine Learning in Hyderabad
Text Summarization:
Process of producing concise version of text by retaining all the important information.
Click here to learn Data Science Course, Data Science Course in Hyderabad, Data Science Course in Bangalore
Data Science Training Institutes in Other Locations
Navigate to Address
360DigiTMG - Data Analytics, Data Science Course Training Hyderabad
2-56/2/19, 3rd floor, Vijaya Towers, near Meridian School, Ayyappa Society Rd, Madhapur, Hyderabad, Telangana 500081
099899 94319
