Print( ' Preprocessed Data: ' ,preprocessed_data) # filter words present in stopwords list preprocessed_data = ' '. # tokenize the paragraph using the inbuilt tokenizer word_tokens = word_tokenize(paragraph) # load the stop_words of english stop_words = set(stopwords. Using the library matplotlib, we plot the image. The generate method in the WordCloud class returns an image of the word cloud. The filtering process copies words to preprocessed_data only if the word is not a stopword.Ĭreate_word_cloud: This function takes in the processed list of words and calls the WordCloud class object. The data is converted to lower case and tokenized. Pre-processing: We pass the input data through the tokenizer. We define a class called WordCloudGeneration and define the following methods in the class: Developed by Andreas Mueller, it’s quite extensible and flexible with respect to the features.

wordcloud: It’s a library that takes in the list of words and outputs a word cloud image.

We’ll use the tokenizer available in nltk. The tokens can be words, sub-words, or phrases.

_tokenize: Tokenization is the process of breaking down the text into smaller units called tokens.

Stopwords are redundant words that don’t add significant meaning to the data. We’ll use the list of stopwords for English. It’s a vast library with tools for pre-processing, data cleaning, data visualization, data modeling, etc.

: Natural language toolkit, known as nltk, is a library built for performing various Natural Language Processing (NLP) tasks.

matplotlib: A visualization and plotting tool used extensively in Python.

With the paragraph as input, we’ll pre-process it and send it to the wordcloud package.Īs mentioned above, we use the following libraries: The input to the program will be a paragraph copied from any website of your choice. Let’s now look at the code to generate word clouds. If you get an error related to stopwords or punkt package while running the code, run the following commands: NLTK Installation: On the basis of the installer used, you may or may not need to run the following commands. Use the command pip3 install numpy=1.19.3 For more information on the error, refer to this discussion. Note: If you get an error during installation, install the 1.19.3 version of numpy.

To install the packages, we will use the following commands: Just replace wordcloud with the name of your choice.

You may also use the name of your choice for the virtual environment. To use these packages, we must always activate the virtual environment named wordcloud before proceeding. After activating the virtual environment, we’ll be installing these packages locally in the virtual environment. We will be installing the following packages:Īctivate the virtual environment using the command, conda activate wordcloud. This will create a virtual environment with Python 3.6.

Word cloud shape generator mac