Question

In python using NLTK, write a function that finds the 50 most commonly occurring words of a text that are not stopwords.

Answer 1

CODE

import nltk

def mostCommon(text):

allWords = nltk.tokenize.word_tokenize(text)

stopwords = nltk.corpus.stopwords.words('english')

allWordExceptStopDist = nltk.FreqDist(w.lower() for w in allWords if w not in stopwords)

return allWordExceptStopDist.most_common(10).keys()