SpreadsheetBench
PulseAugur coverage of SpreadsheetBench — every cluster mentioning SpreadsheetBench across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
New method localizes soft skill impact for AI agents
Researchers have developed a new method called Behavioral Localization to improve the efficiency of soft skills for tool-using agents. This technique identifies specific positions within an agent's successful trajectory…
-
Ant Group's Bailing launches finance-focused AI model and evaluation benchmark
Ant Group's Bailing has released Ling-3.0-flash-Fin, its first finance-enhanced open-source model designed to handle complex financial workflows beyond simple Q&A. This model aims to move AI from answering single questi…
-
Ant Group releases finance-focused LLM with 256K context, multimodal variant noted
Ant Group has released Ling-3.0-flash-Fin, a new large language model enhanced for financial tasks. This 124B parameter model, with 5.1B activated parameters and a 256K context window, excels at end-to-end financial res…
-
ChatGPT's spreadsheet accuracy questioned by independent tests
A recent analysis has revealed significant discrepancies in ChatGPT's performance when handling financial spreadsheets, despite OpenAI's claims of high accuracy. While OpenAI reported an improvement from 43.7% to 87.3% …
-
New BREW framework enables LLM agents to learn from experience
Researchers have developed BREW, a novel framework designed to enable Large Language Model (LLM)-based agents to learn from past experiences. Unlike current agents that restart learning with each session, BREW distills …
-
New ProCUA-SFT dataset boosts AI agent desktop performance
Researchers have developed ProCUA-SFT, a new dataset designed to improve the training of computer-use agents (CUAs) that interact with graphical desktop environments. Existing datasets like AgentNet have shown negative …
-
AI models benchmarked for Excel accuracy; specialized tools lead
A new benchmark called SpreadsheetBench evaluates AI models on their accuracy in handling Excel documents. The benchmark uses real-world tasks from Excel forums, requiring exact cell-by-cell accuracy and testing complex…
-
SkillOpt optimizes AI agent skills using validated parameter edits
A new paper introduces SkillOpt, a method for optimizing AI agent skills by treating markdown skill files as trainable parameters. The approach uses a frontier model to propose bounded edits, which are then validated ag…