Machine Learning TV
7 minutes
Perplexity measures how well a probabilistic language model predicts a text as the exponential of the average negative log-likelihood per token; lower values indicate the text is more fluent or expected under the model, and it is widely used to score text quality.