Language models rely on pretrained understanding over provided definitions
AI & Automation
Researchers tested whether large language models actually apply definitions provided in prompts or rely on their pretrained understanding by having models annotate the same texts twice with different definitions of concepts. Across six concepts and three large language models, switching between competing definitions produced greater changes in annotations than paraphrasing a single definition while keeping its requirements the same.