Gemini 3.1-pro-preview
PulseAugur coverage of Gemini 3.1-pro-preview — every cluster mentioning Gemini 3.1-pro-preview across labs, papers, and developer communities, ranked by signal.
- instance of Gemini 90%
- instance of Gemini 3.5 Flash 90%
- competes with GPT-5.4 70%
- competes with Claude Opus 4.7 70%
- competes with Gemini 3.5 Flash 70%
- competes with SpaceXAI 70%
- competes with Gemini 70%
- instance of arXiv 60%
- competes with DeepSeek V4-Pro 60%
- competes with arXiv 50%
- used by arXiv 50%
- 2026-06-01 product_launch Gemini 3.1 Pro Preview is highlighted for its ability to directly transcribe audio input. source
1 day(s) with sentiment data
Gemini 3.1 Pro Preview may show inconsistent performance in financial decision-making tasks
The new 1rok benchmark is designed to test LLMs on stock-picking, a task requiring decision-making under uncertainty. While Gemini 3.1 Pro Preview is included, its performance in this domain is untested. Given the benchmark's focus on practical, downstream evaluation beyond traditional benchmarks, Gemini 3.1 Pro Preview could exhibit variability in its ability to consistently select profitable stocks compared to models with more established real-world usage data.
Gemini 3.1 Pro Preview struggles with complex IT incident diagnosis
The recent ITBench-AA benchmark, which evaluates frontier AI models on enterprise IT tasks like SRE, shows that even advanced models are scoring below 50% on diagnosing Kubernetes incidents. Gemini 3.1 Pro Preview's performance in this specific area, while not explicitly detailed in the provided evidence, is likely to be impacted given the general struggles observed across frontier models with root-cause analysis and avoiding false positives in complex scenarios.
Gemini 3.1 Pro Preview passes initial safety audits for code sabotage
Recent AI safety audits utilizing environment blueprints for more realistic evaluations have tested Gemini 3.1 Pro Preview for code sabotage. The results from these 160 trials indicated no egregious scheming behavior, suggesting that the model is currently robust against this specific type of malicious action under these audited conditions.
Gemini 3.1 Pro Preview may lag in real-world adoption compared to GPT-5 models
Given that AgentTape ranks models by usage and GPT-5 models are currently dominating, and considering Gemini 3.1 Pro Preview's participation in new, specialized benchmarks (ITBench-AA, 1rok) without clear leadership, it's plausible that Gemini 3.1 Pro Preview's real-world adoption is currently lower than that of leading GPT-5 models. Future usage data from indices like AgentTape will be key to verifying this.
Gemini 3.1 Pro Preview shows mixed results in specialized benchmarks
While Gemini 3.1 Pro Preview was tested for code sabotage in AI safety audits and performed adequately, it has not yet demonstrated top-tier performance in newly released benchmarks like ITBench-AA or 1rok, which focus on enterprise IT tasks and stock-picking respectively. This suggests Gemini 3.1 Pro Preview may have specific strengths but is not universally outperforming competitors like GPT-5.5 across all emerging, practical evaluation domains.
-
AI agents forget rules after first compaction, study finds
A new preprint study titled "Benchmarks Are Surprisingly Compaction-Friendly" reveals that AI coding agents lose approximately one-third of their given rules after the first compaction process. The research, conducted b…
-
DynaWeave framework enhances AI agent adaptability to dynamic environments
Researchers have developed DynaWeave, a framework designed to create dynamic scenarios for training AI agents. This system synthesizes exogenous events that can alter task requirements or environmental states, preparing…
-
Reflection AI releases 501B parameter open-weight model Beam, targeting cost efficiency
Reflection AI has released Beam, an open-weight, sparse Mixture-of-Experts (MoE) model with 501 billion total parameters that activates only 23 billion per task. This design aims to offer the knowledge capacity of a lar…
-
Gemini 3.1-pro-preview brand mentions show durability over 20 days
A pre-registered study tested the durability of brand mentions in Gemini's answers over a 20-day period. Researchers sent identical prompts to Gemini 3.1-pro-preview in three waves and found that forecasts based on earl…
-
Gemini brand mentions show durability over 20 days in pre-registered test
A pre-registered study tested the durability of brand mentions in Gemini's responses over a 20-day period. The research found that forecasts based on historical mention rates performed well, outperforming simpler predic…
-
New MathVis benchmark tests AI's ability to visualize and reason with math diagrams
A new benchmark called MathVis has been developed to assess the capabilities of large language models in generating mathematical figures and utilizing them for reasoning. The benchmark includes 512 tasks, each with a ma…
-
Google launches Gemini 4 Argon with tiered pricing and mixed benchmark results · 8 sources tracked
Google has launched its Gemini 4 Argon model, making it available to developers via API starting October 13th. The model is priced at an introductory rate of $2 per million input tokens and $10 per million output tokens…
-
New CiteVQA benchmark exposes "Attribution Hallucination" in LLMs
A new benchmark called CiteVQA has been introduced to evaluate the evidence attribution capabilities of multimodal large language models (MLLMs). Current document question-answering (Doc-VQA) evaluations only assess the…
-
AI model lifespans skewed by vendor reporting, not model longevity
An analysis of AI model lifespans reveals that median durations are heavily influenced by vendor reporting practices rather than inherent model longevity. The author found that the median lifespan of AI models, when cal…
-
LLM safety benchmark for vehicle voice commands unveiled
A new benchmark, "From Intent to Action," has been developed to evaluate the safety of large language models (LLMs) when used in vehicle voice command systems. The benchmark assesses how well LLMs can make critical pre-…
-
Frontier LLMs fail oncology decision-making benchmark, new study finds
A new benchmark, the Oncology Decision Boundary Benchmark (ODBB), has been developed to evaluate the decision-making capabilities of frontier large language models (LLMs) in oncology. The study found that even advanced …
-
New agentic systems streamline document processing and figure generation
Researchers have developed DocClaw, a unified agentic system designed to handle diverse intelligent document processing tasks like optical character recognition and document question answering within a single framework.…
-
Gemini 3 Pro Image leads text-to-image benchmark, beating FLUX.2
A new paper benchmarks four leading text-to-image models—Hunyuan 3.0, Gemini 3 Pro Image, Black Forest Labs FLUX.2, and Ideogram 3.0—on challenging image-description prompts. The evaluation, using 48 complex prompts fro…
-
New PolyComp benchmark tests AI spatial reasoning; GPT-5.6 leads
A new benchmark called PolyComp has been introduced to test the compositional 3D spatial reasoning capabilities of multimodal AI models. The benchmark consists of 120 procedurally generated problems, each requiring a mo…
-
Google AI Studio access in Russia restricted, Pro models removed from free tier
Google AI Studio's accessibility in Russia is complicated, with users reporting intermittent access without VPNs, though creating new accounts typically still requires one. The service's official documentation does not …
-
Open AI models narrow capability gap but lag in enterprise adoption and serving stack performance
Open-weight AI models have significantly closed the capability gap with proprietary models, reaching within 6 points on the Intelligence Index by April 2026. Despite this, enterprise adoption of open models has lagged, …
-
Gemini-3.1-Pro-Preview leads audio classification benchmark, outperforming competitors
A new benchmark evaluates eleven audio classification methods, including several Gemini models and Kimi-Audio-7B-Instruct, on a sound source identification task. The best performing model, Gemini-3.1-Pro-Preview, achiev…
-
AI evaluation scores are flawed, focusing on models over graders
A recent analysis highlights a critical flaw in AI model evaluation: the focus is overwhelmingly on the model's performance, while the reliability of the evaluation instrument itself is often neglected. An anecdote illu…
-
Google's Gemini 3.5 Flash disappoints on Android benchmark; Pixel Drop features leaked
Google has inadvertently revealed upcoming features for its Pixel Drop update, including "Screen Reactions" for creating reaction videos and Gemini Omni for AI-powered multimedia content generation. Separately, the new …
-
ChatGPT market share dips below 50% as users migrate to rivals · 1 source tracked
ChatGPT's market share has fallen below 50% for the first time, with users shifting to alternatives like Google's Gemini, Anthropic's Claude, and xAI's Grok. In a separate development, Vercel has released 'eve,' an open…