Temporal Concept Drift in Legal Judgment Prediction: Neural Baselines Across Three Epochs of Ukrainian Court Decisions
Researchers investigated temporal concept drift in legal judgment prediction by training transformer models on Ukrainian court decisions from different geopolitical eras. They found that models trained on older data performed significantly worse on newer data, indicating a severe forward degradation in predictive accuracy. While legal-domain pretraining offered some mitigation, chronological continual learning proved effective in preventing catastrophic forgetting and improving performance over time. The study highlights that legal language evolution, influenced by geopolitical events, is additive and presents a significant challenge for AI models. AI
IMPACT Highlights the challenge of temporal drift in legal AI, suggesting continual learning is crucial for maintaining accuracy as legal language evolves.