A new diagnostic study on the GEPA reflective prompt optimizer reveals that its system-aware merge operator exhibits instability across different language models. While the merge operator improves performance on GPT-4.1 mini, it degrades performance on Qwen3-8B. Researchers investigated this asymmetry across five datasets and two models, finding that appropriate configuration can improve both models. The study ruled out prompt-level features as predictors for GEPA's merge decisions and introduced a behavior-based probe, GEPA-MergeProbe, which abstains on high-risk tasks to avoid large merge failures. AI
IMPACT Understanding GEPA's merge operator instability could lead to more robust prompt optimization techniques for language models.
RANK_REASON This is a research paper detailing diagnostic findings on a specific AI technique. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →