ContractNLI
PulseAugur coverage of ContractNLI — every cluster mentioning ContractNLI across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
Language models can learn during inference, research finds
A new research paper explores the concept of language models learning during inference, a process termed dynamic evaluation. The study found that standard softmax-attention models, when allowed to perform gradient steps…
-
Autotrust releases two decision-making AI models evaluated on Decision Index
Autotrust has released two new models, AutoTrust-JEV-27B-v1.1 and AutoTrust-Decider-Pro-Vision-27B-v1.1, which are designed for structured decision-making. These models assign probabilities to answer options and have be…
-
LLMs fail to consistently base legal verdicts on cited authorities, study finds
A new study published on arXiv has revealed that large language models, when used to justify legal decisions, often name the correct statutes or precedents but do not consistently base their verdicts on them. Researcher…
-
LLMs Cite Legal Authority But Fail to Show True Reasoning
A new study has revealed that large language models (LLMs) often fail to demonstrate genuine legal reasoning, despite their ability to cite relevant statutes or precedents. Researchers found that when LLMs were prompted…
-
New methods recover evidence passages for LLM verdicts without human annotation
Researchers have developed new methods to recover evidence passages for review workflows when only the final verdict is available. Label-only post-training and rejection sampling techniques were tested on the ContractNL…
-
New HARDEN method creates harder, realistic evaluation cases for LLMs
Researchers have developed HARDEN, a novel constrained evolutionary search method designed to create more challenging evaluation cases for language models. This technique adapts existing evaluation scenarios by modifyin…