Brief

Google Research has developed a framework to evaluate the alignment of Large Language Models (LLMs) with human behavioral dispositions, using established psychological assessments adapted into situational judgment tests. This approach quantizes model tendencies against human social inclinations, identifying deviations and areas for improvement in realistic scenarios. Separately, Google Research also introduced SLED (Self Logits Evolution Decoding), a novel method that enhances LLM factuality by utilizing all model layers during the decoding process, thereby reducing hallucinations without external data or fine-tuning. AI

Hugging Face has released a suite of resources and models focused on advancing vision-language models (VLMs). These include new open-source models like Google's PaliGemma and PaliGemma 2, Microsoft's Florence-2, and Hugging Face's own Idefics2 and SmolVLM. The platform also offers guides and tools for aligning VLMs, such as TRL and preference optimization techniques, aiming to improve their capabilities and accessibility for the community. AI

Researchers are developing new methods to evaluate and enhance Large Language Models (LLMs). Apple's research proposes a benchmark to test LLMs' understanding of context, finding that quantized models and pre-trained dense models struggle with nuanced contextual features. Meanwhile, a new technique called Retrieval-Augmented Linguistic Calibration (RALC) improves how LLMs express confidence in their answers, enhancing faithfulness and calibration. Other research explores LLMs for clinical action extraction, demonstrating comparable performance to supervised models but highlighting limitations in clinical reasoning, and introduces Listwise Policy Optimization for more stable and diverse LLM training. AI

Apple's research paper explores the mechanisms behind compositional generalization in conditional diffusion models, specifically focusing on how they handle combinations of conditions not seen during training. The study validates that models exhibiting local conditional scores are better at generalizing, and that enforcing this locality can improve performance. Separately, Hugging Face has released several blog posts detailing various methods for fine-tuning and optimizing Stable Diffusion models, including techniques like DDPO, LoRA, and optimizations for Intel CPUs, as well as instruction-tuning and Japanese language support. AI

Google DeepMind has introduced the FACTS Benchmark Suite, a new set of evaluations designed to systematically assess the factuality of large language models across various use cases. This suite includes benchmarks for parametric knowledge, search-based information retrieval, and multimodal understanding, alongside an updated grounding benchmark. The initiative aims to provide a more comprehensive measure of LLM accuracy and is being launched with a public leaderboard on Kaggle to track progress across leading models. AI

OpenAI has published a series of research papers detailing advancements in reinforcement learning (RL). These include achieving superhuman performance in Dota 2 with OpenAI Five, developing benchmarks for safe exploration in RL environments, and quantifying generalization capabilities with a new CoinRun environment. The research also explores novel methods for encouraging exploration through curiosity, learning policy representations in multiagent systems, and evolving loss functions for faster training on new tasks. Additionally, OpenAI is working on variance reduction techniques for policy gradients and exploring the equivalence between policy gradients and soft Q-learning. AI