Conceptual

Large Language Models in Natural Language Processing

Large language models are transformer networks pretrained on large text corpora that acquire broad linguistic and world knowledge and can be prompted to generate or annotate text. Their use for scaling up grounding annotations and for open-vocabulary understanding is assumed context for this work.