ForecastBench
PulseAugur coverage of ForecastBench — every cluster mentioning ForecastBench across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
New method improves LLM forecast consistency and accuracy
Researchers have developed a new method to improve the logical consistency of forecasts generated by large language models (LLMs). This approach focuses on refining the reasoning behind each forecast, which helps to rec…
-
New AI forecasting pipeline captures rapid field velocity
A new AI forecasting pipeline called vynderbot has been developed to capture the rapid pace of AI advancement. This system autonomously collects and structures data from over a dozen sources, including compute datasets,…
-
LLM evaluation method adapts psychometric theory for fairer benchmark comparisons
Researchers have developed a new method for evaluating large language models (LLMs) by adapting Item Response Theory (IRT) from psychometrics. This approach treats each benchmark as an "item" and models the LLM's "abili…
-
LLMs adapted for time-series forecasting using parameter-efficient methods · 2 sources tracked
Researchers are exploring parameter-efficient methods to adapt large language models (LLMs) for time-series forecasting tasks. One study projects time-series data directly into the embedding space of a GPT-2 model, achi…
-
Bayesian Linguistic Forecaster agent achieves state-of-the-art on forecasting benchmark
Researchers have developed the Bayesian Linguistic Forecaster (BLF), an agentic system designed for binary forecasting tasks. The BLF integrates numerical probability estimates with natural-language evidence summaries, …