Llama 2
PulseAugur coverage of Llama 2 — every cluster mentioning Llama 2 across labs, papers, and developer communities, ranked by signal.
- developed by Meta* 100%
- developed by Microsoft 100%
- instance of large-language models 90%
- instance of Vicuña 70%
- competes with mistral:7b 70%
- instance of llama 70%
- competes with Gemma 70%
- used by Ollama 70%
- instance of Code Llama 70%
- developed by Code Llama 70%
- competes with Qwen 2.5 70%
- competes with Claude 3 60%
13 day(s) with sentiment data
-
French startup claims fastest CPU TTS model, benchmarks show strong performance
French startup Gradium claims its Phonon TTS model is the fastest on CPU and among the top three most understandable across tested languages. Benchmarks generally support these claims, though developers should be aware …
-
AI models favor similar code, risking overlooked bugs in reviews
A new study suggests that AI models tend to favor and agree with outputs from similar models, potentially leading to overlooked errors in code reviews. Researchers found that AI judges often scored models more favorably…
-
LLM agents struggle with rule compliance after context compaction, study finds
Researchers have developed ARCBench, a new benchmark built on the pi agent harness, to evaluate how well Large Language Model (LLM) agents adhere to rules after their context histories are compacted. The study found tha…
-
NVIDIA H200 GPU offers cost advantages over H100 for memory-bound AI tasks
The NVIDIA H200 GPU offers improved memory bandwidth compared to the H100, making it more efficient for memory-bound tasks like LLM inference. While the H200's compute power is similar to the H100, its higher memory thr…
-
AI tools offer stock trading insights but pose herd mentality risks
AI tools like ChatGPT and Bard are increasingly being used by everyday investors to generate stock trading ideas. While these platforms can analyze vast amounts of data to identify trends and potential opportunities, th…
-
New framework reveals human susceptibility to AI hallucinations
A new research paper introduces JudgeGPT and RogueGPT, a framework designed to investigate how humans fall prey to foundation model hallucinations and disinformation. The study analyzed 918 evaluations across five found…
-
Used PC Resale Value Skyrockets When Marketed for AI
A Reddit user discovered that by rebranding a used computer system as an "AI system," they could significantly increase its resale value. The user initially struggled to sell a system with an RX580 for €750, but after r…
-
Small Language Models Can Outperform Larger Ones When Fine-Tuned
This article explores the advantages of fine-tuning smaller language models, arguing that they can outperform larger models like GPT-3.5 and Llama 2 when tailored for specific tasks. It highlights techniques such as LoR…
-
New study finds later LLM releases often lose pretraining disclosure
A new study analyzing 41 language model releases across 17 families reveals a concerning trend: later versions do not consistently preserve or improve upon the pretraining disclosure of their predecessors. Researchers u…
-
Trailing space in LLM prompts breaks BPE tokenization, causing label errors
A single trailing space at the end of a prompt can cause significant issues with Byte Pair Encoding (BPE) tokenizers, leading to incorrect outputs from large language models. This occurs because BPE tokenizers often att…
-
70B Model Learns Without External Data, Outperforms RLHF
A new paper introduces On-Policy Self-Training (O-ST), a method where a 70-billion-parameter model learns from its own generated outputs and reasoning traces without external data. This self-training approach reportedly…
-
AI users debate LoRA training parameters for Qwen 2.1, Llama 2, and MOSS
A user on Reddit is seeking advice regarding the optimal training parameters for LoRA models, specifically for the Qwen 2.1, Llama 2, and MOSS models. They are unsure whether to use the 'shift' or 'sigmoid' parameter, n…
-
AI training flaw: Hidden offsets cause vocabulary collapse
A new research paper titled "ECHO: Emergent Common-Mode Hidden Offsets Drive Vocabulary Collapse in Preference Optimization" identifies a critical failure mode in preference optimization techniques used for AI models. T…
-
WhatsApp chatbot's hidden prompts steer LLM responses, raising transparency concerns
A recent investigation revealed that WhatsApp's customer support chatbot was using hidden instructions embedded within its knowledge base to influence its responses. These instructions, often in the form of HTML comment…
-
AI models form simulated society in Emergence World experiment
An experiment called "Emergence World" placed five AI models, including Claude, Grok, Gemini, GPT-4, Llama 2, and Mistral AI, into a simulated town for 15 days. During this period, the AI agents engaged in various behav…
-
AI operational costs include cloud, maintenance, and retraining
The operational costs of AI systems extend beyond initial development, encompassing cloud and model usage, ongoing maintenance, and the expenses associated with ownership and coordination. A significant factor in these …
-
Meta unveils Muse AI for deep code repository analysis
Meta has introduced Muse, a new AI model designed to assist developers by analyzing their code repositories. Unlike other AI models that might focus on generating code or answering questions, Muse aims to understand the…
-
Research: Static word embeddings match LLM decoding capabilities
A new research paper challenges the interpretation of findings that suggest large language models (LLMs) form internal world models. Researchers demonstrated that static word embeddings, which are context-insensitive, c…
-
AI Workflows May Create More Work Than They Save, Analysis Suggests
The use of AI tools like ChatGPT and Bard may inadvertently increase workload due to the extensive review, correction, and cleanup required after initial drafts. While AI can generate content quickly and cheaply, the su…
-
Run 100B+ MoE LLMs on RTX 4090 via Expert Offloading with llama.cpp
A technical guide details how to run large Mixture of Experts (MoE) language models, specifically over 100 billion parameters, on a single consumer-grade GPU like the RTX 4090. The method, termed 'expert offloading,' le…