Locating and Editing Key Language-Model Modules for Zero-Shot Event-Relational Reasoning
Two methods for improving a language model's zero-shot reasoning about event relations by editing only the internal modules responsible for it rather than retraining. Reasoning-Oriented Locating and Editing (ROLE) locates and edits the key modules that drive event-relational reasoning, gaining interpretability and lowering computational cost; Analogy-Based Locating and Editing (ABLE) transfers knowledge across tasks by modeling their analogical similarities and differences.
2501.00803
Addresses zero-shot event-relational reasoning: identifying the causal, temporal, and sub-event relations between events described in text without task-specific labeled examples. Rather than prefix-t…