J
jeremy
32 minutes
Word Frequency Distribution in Natural Language Text
In any body of text a small handful of words occur enormously often while most words occur rarely, and the frequent ones carry little of the meaning. A learner afterwards can count word occurrences in a passage and explain why the most common words are the least informative about what it is about.