PulseAugur
EN
LIVE 00:34:56
ENTITY CruxEval

CruxEval

PulseAugur coverage of CruxEval — every cluster mentioning CruxEval across labs, papers, and developer communities, ranked by signal.

Show in brief
Total · 30d
2
5 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
1
4 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 6 TOTAL
  1. RESEARCH · CL_347689 ·

    Autotrust releases two decision-making AI models evaluated on Decision Index

    Autotrust has released two new models, AutoTrust-JEV-27B-v1.1 and AutoTrust-Decider-Pro-Vision-27B-v1.1, which are designed for structured decision-making. These models assign probabilities to answer options and have be…

  2. TOOL · CL_289379 ·

    New benchmark evaluates AI's ability to predict program output and state

    A new benchmark, extending CruxEval, has been developed to evaluate AI models' ability to predict the final output and internal state of real-world programs. This benchmark comprises 400 cases from 371 Python and C++ pr…

  3. TOOL · CL_141553 ·

    LLMs struggle with semantic recall in long code contexts, new paper finds

    A new paper published on arXiv explores the limitations of large language models (LLMs) in understanding long code contexts. Researchers found that while LLMs excel at lexical recall (verbatim code retrieval), their sem…

  4. TOOL · CL_40817 ·

    Quantization impacts LLM performance, with larger models showing more resilience

    A new research paper explores the impact of quantization on large language model performance, examining models from 2-bit to 6-bit precision. The study found that while higher precision generally leads to better perform…

  5. TOOL · CL_29426 ·

    New framework StepCodeReasoner boosts code reasoning with execution traces

    Researchers have developed StepCodeReasoner, a new framework designed to improve code reasoning by focusing on intermediate execution states rather than just final outputs. This approach uses structured print statements…

  6. RESEARCH · CL_07050 ·

    Researchers generate verifiable code reasoning data to boost LLM performance

    Researchers have developed a new method to generate verifiable Chain-of-Thought (CoT) rationales for code reasoning by instrumenting code to capture execution traces. This pipeline narrates these traces into natural lan…