World's Best AI Learning Platform with profoundly Demanding Certification Programs
Designed by IITians, only for AI Learners.
Download our e-book of Introduction To Python
Related Blog
Top Discussion
USA(+256704300651)Top Powerful Love Spells That Really Work By Powerful Revenge Spell Caster in# Canada, #Australia #,UK,//USA Black magic IN >@>USA,/ UK,/ Kuwait,/ Germany, +256704300651 == WASHINGTON DC// TOP DEATH SPELLS @POWERFUL REVENGE DEATH SPELL CASTER IN USA,CANADA, UK, CALIFONIA, MEXICO, IRELAND, NY, CANADA, LONDON, SWEDEN, BOTSWANA How can I write Python code to change a date string from "mm/dd/yy hh: mm" format to "YYYY-MM-DD HH: mm" format? +256704300651- Psychic lost love Spell Caster // Divorce Spell // Marriage Proposal ((+256704300651}} INSTANT DEATH SPELL CASTER / REVENGE SPELL/ VOODOO A SPELL CASTER/╬ ₩௹]+256704300651₩௹]╬MAMA ZAMIE A TRADITIONAL HEALER /SANGOMA AND A SPIRITUAL HEALER in BELGIUM, Exception Type: JSONDecodeError at /update/ Exception Value: Expecting value: line 1 column 1 (char 0) +256704300651 NY ( ITALY /UK/ SWEDEN/USA )) Black Magic Instant Death Spell Caster Lubbock Join Discussion
Top Courses
Master's In Artificial Intelligence Job Guarantee Program
4.5 (1,292 Ratings)
559 Learners
Webinars
Why You Should Learn Data Science in 2023?
Jun 8th (7:00 PM) 289 Registered
Text Munging using python
Shashank Shanu
3 years ago
We
all know that how much these days social media are becoming popular. Everyone is
showing their presence on it from a small kid to an elder one. Due to these, we
are generating zettabytes and petabytes of text data on a daily. Big companies use
these text data to find the hidden insights into it and stand ahead from most
of their competitors in the market. Facebook, YouTube, Netflix are some of the companies
which use these data to provide the best customer service to their customers.
So
before moving ahead. Let’s try to first understand:
What is Text munging?
Munging
is a technique which is used to clean the messy data by using some kind of transformation
on it.
This
is one of the important techniques as nowadays most of the data which is being
generated are present in the form of unstructured data. These data need some
kind of treatment or cleaning applied on it so that we can find the correct
hidden insights from them.
To
understand it better. Let’s take an example:
In our example, we will try to see how we can apply
some kind of transformation on our text to get some useful results which give some
desirable changes to data.
In a simple language, it is only about transforming
the text we are dealing with.
Example
Here, in our example, we are first shuffling the text
and then rearranging all the letters of the given sentence. Except the first and
the last sentences to get alternate words which may get generated as a misspelt
word during writing by a human.
Let’s see the code:
# import library
import random
import re
# creating a function to perform the task
def replace(a):
word = list(a.group(2))
random.shuffle(word)
return a.group(1) + "".join(word) + a.group(3)
text = "Hello, You should reach the finish line."
print(re.sub(r"(\w)(\w+)(\w)", replace, text))
print(re.sub(r"(\w)(\w+)(\w)", replace, text))
Output:
When we execute the above program, we get the output as given below −
Hlleo, You slouhd raech the fsiinh lnie.
Hlleo, You suolhd raceh the fniish line.From the above results, we can observe how the
words are jumbled except for the first and the last letters. By taking a statistical approach helps us to find the wrong spelling of the words and then
we can decide what are the commonly misspelt words and supply the correct
spelling for them to get the desired results.
I hope after you enjoyed reading this
article and finally, you came to know about Text Munging using python.
For more such blogs/courses on data science, machine
learning, artificial intelligence and emerging new technologies do visit us at InsideAIML.
Thanks for reading…
Happy Programming…