What a Model Knows and Where Its Knowledge Ends

Model knowledge is compressed, uneven, and frozen at a training cutoff. Predict which questions it will answer confidently and wrongly.

jeremy Text

53 minutes

Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)?A.K.A. Will LLMs Replace Knowledge