small language model
PulseAugur coverage of small language model — every cluster mentioning small language model across labs, papers, and developer communities, ranked by signal.
10 day(s) with sentiment data
-
New single-token scoring method improves LLM candidate ranking
Researchers have developed a new method called single-token expected-value scoring for ranking job candidates, particularly useful for platforms with limited interaction data. This technique casts candidate-job relevanc…
-
Geospatial metadata boosts dataset discoverability and cross-disciplinary connections
A new study published on arXiv proposes that geospatial metadata can significantly enhance the discoverability and interoperability of research datasets. The research, which analyzed data from Harvard Dataverse, found t…
-
New context segmentation boosts SLMs for cybersecurity CTF tasks
Researchers have introduced a novel context segmentation framework designed to improve the performance of small language models (SLMs) on complex, long-horizon tasks like cybersecurity Capture The Flag (CTF) challenges.…
-
AI predicts optimal build orientation for 3D-printed dental parts
Researchers have developed a machine learning approach to predict the optimal build orientation for dental parts manufactured using selective laser melting (SLM). By training models on approximately 2400 patient-specifi…
-
New methods enhance LLM inference speed via speculative decoding
Researchers are developing advanced techniques for speculative decoding to accelerate large language model (LLM) inference. One approach, X-CoSD, focuses on efficient communication between small on-device models and lar…
-
Small Language Models Still Carry High Inference Costs
The cost of running inference for small language models (SLMs) can still be surprisingly high due to factors like partial loading and KV caching. Understanding the underlying Transformer architecture is key to optimizin…
-
Fine-tuning Small Language Models to Combat Prompt Injection
This article details the process of fine-tuning a small language model (SLM) to defend against prompt injection attacks. The author outlines the challenges and steps involved in creating a more robust model capable of i…
-
DeepAffinity uses SLMs for long-term e-commerce preference prediction
Researchers have developed DeepAffinity, a novel approach for predicting long-term user preferences in e-commerce. This method utilizes Small Language Models (SLMs) with specialized prompts and prediction heads to forec…
-
User seeks small language model for code snippet summarization
A user on Reddit is seeking recommendations for a small language model (SLM) capable of summarizing code snippets. They are experimenting with a personal assistant agent and want to deploy lightweight models on local cl…
-
EGT-KG framework boosts small language models for scientific QA
Researchers have developed a new retrieval framework called EGT-KG to enhance the performance of small language models (SLMs) in scientific question-answering tasks. This framework aims to address limitations such as sm…
-
Article explores local AI stack for productive Small Language Models
This cluster contains two identical posts from Mastodon, linking to a KDnuggets article titled "How to use Small Language Model # AI". The article discusses the local AI stack for productive SLMs, indicating a focus on …
-
New framework audits and mitigates privacy leakage in cloud-edge LLM collaboration
Researchers have developed a new framework to audit and mitigate privacy leakage in cloud-edge collaborative decoding systems. These systems use a small language model on edge devices to process private data and fuse it…
-
New CRAFT method enhances AI explainability in 6G networks
Researchers have developed a new method called CRAFT (Cold-start Reasoning Alignment via Fine-Tuning) to improve the explainability of AI models used in next-generation 6G mobile networks. Current methods often generate…
-
Wired guide details running local LLMs on personal computers
A guide from Wired explains how individuals can set up and operate their own local large language models (LLMs) on personal computers. The article details the process of running these models, often referred to as small …
-
Guide to Building Productive Local AI Stacks for SLMs
This article presents a practical framework for building a local AI stack, focusing on selecting appropriate tools for various layers of the setup. It covers aspects from model serving to context retrieval, aiming to en…
-
VIDRAFT launches small AI model evaluation framework, hits Hugging Face top 10
VIDRAFT (지니젠AI), a Korean AI startup, has launched a specialized evaluation framework for small language models (SLMs). This framework, along with its associated dataset, has simultaneously achieved a top-10 ranking on …
-
New architecture integrates small language models into graph neural networks
Researchers have developed a novel architecture called SLM-Conditioned Hierarchical Relation Routing that integrates a small language model (SLM) into graph neural networks for learning on labeled property graphs. This …
-
Research: Larger models outperform increased inference compute for text-to-SQL
A new research paper explores the trade-offs between model size and inference compute for grammar-constrained text-to-SQL tasks. The study found that increasing model size generally yields better accuracy than increasin…
-
Small Language Model controls cognitive radar system
Researchers have developed a novel framework for a cognitive radar system controlled by a small language model (SLM) agent. This agent can interpret natural language commands to select, configure, and execute a sequence…
-
Open-source small language model Yachay released for standard hardware
A new small language model named Yachay has been released, developed by unimauro. The model is open-source, with its documentation available in Spanish and its code written in Python and Rust. Yachay is designed to func…