small language model
PulseAugur coverage of small language model — every cluster mentioning small language model across labs, papers, and developer communities, ranked by signal.
11 day(s) with sentiment data
-
Small language models improve tax code prediction accuracy
Researchers have developed a domain-adaptive small language model (SLM) with an encoder-decoder architecture specifically for predicting structured tax codes. This approach aims to improve the accuracy of tax code deter…
-
New TGR method enhances small language models for shell output simulation
Researchers have developed a new method called Template Gap Reconstruction (TGR) to improve the accuracy and efficiency of small language models in simulating shell outputs. TGR works by using reusable output templates …
-
Run powerful LLMs locally on 4GB RAM using quantization
This tutorial details how to run capable small language models (SLMs) locally on systems with as little as 4GB of RAM. It addresses the common challenge of high memory requirements for LLMs by suggesting the use of opti…
-
LLMs enhance knowledge entity relation extraction in academic papers · 3 sources tracked
A new research paper explores various strategies for improving knowledge entity relation extraction (KERE) in academic articles using large language models (LLMs). The study evaluates multiple approaches, including clos…
-
Small language models achieve advanced grammar control with new SMC technique
Researchers have developed a method using Sequential Monte Carlo (SMC) to improve grammar control in small language models for language learning applications. This approach steers the models towards specific grammatical…
-
LLM Serving Economics Revolutionized by KV Cache Innovations and Rust Rewrites · 1 source tracked
Recent research and engineering advancements are significantly improving LLM serving economics. Innovations include optimizing KV cache management through compaction and quantization, with new methods like role-aware qu…
-
Small language models boosted for AI call screening with new training data
Researchers have developed a method to improve small language models (SLMs) for AI call-screening agents by creating a quality-controlled dataset. This dataset, comprising 3,395 synthetic calls, focuses on generating re…
-
New SLM Architecture Improves Behavioral Prediction Accuracy
Researchers have developed a novel architecture called Evidence-Grounded Local Behavioral Prediction (ELBP) designed for Small Language Models (SLMs) to predict user assistance needs. This four-layer system processes in…
-
Local-first apps and on-device SLMs offer privacy and lower latency
Rachel Lee Nabors discussed the benefits of local-first applications and on-device small language models (SLMs) in a recent InfoQ podcast. These approaches can enhance user privacy, decrease latency, and reduce operatio…
-
VocabX cuts SLM inference costs by 77% via specialized tokenizers
Researchers have developed a method called VocabX to specialize the vocabulary of Small Language Models (SLMs), potentially reducing inference costs. By focusing the tokenizer on domain-specific terms rather than genera…
-
Edge-deployable AI structures radiology reports with small language model
Researchers have developed MedPAO-Assist, an agentic AI framework designed for structuring radiology reports directly from radiologist dictation. This system is notable for its edge-deployability, requiring minimal reso…
-
Progress-Aware Distillation tackles stagnation in small language model agents
Researchers have developed a new technique called Progress-Aware Distillation (ProD) to address stagnation issues in small language model (SLM) agents. This method detects and penalizes repetitive, unproductive loops in…
-
Decision models enhance edge SLMs for enterprise use, cutting costs
A new approach called pre-generation decision routing, developed at Logic42 Lab, aims to make small language models (SLMs) suitable for enterprise use. This method involves evaluating semantic intent, urgency, and outpu…
-
New architecture boosts small language model accuracy in sensitive data analysis
Researchers have developed CARE-SD, a novel architecture designed to improve the accuracy and reliability of small language models (SLMs) in analyzing self-disclosures within textual data, particularly in cybersecurity …
-
New method distills LLM behaviors into cost-effective SLMs
Researchers have proposed a new method for developing and deploying AI models, focusing on the efficient use of small language models (SLMs). The approach involves first iterating on desired behaviors using a powerful f…
-
TinyForge enables fine-tuning of small language models on personal GPUs
Rajratan Gulabmore has developed TinyForge, an open-source tool designed to enable users to fine-tune small language models on their personal GPUs. The tool also includes functionalities for evaluating and serving these…
-
Small Language Models Framework for SUD Patient Dialogue Generation
Researchers have developed a framework using Small Language Models (SLMs) to generate dialogue for patients with substance use disorder (SUD). This approach addresses the limitations of larger models in clinical setting…
-
Research probes language models' knowledge of different scripts
A new research paper explores whether language models possess knowledge of different scripts, a dimension of understanding that has been understudied compared to language selection. The study tested both small and large…
-
Turnslide framework synthesizes multi-turn data for small language models
Researchers have developed Turnslide, a novel framework for synthesizing multi-turn conversational data to improve small language models' (SLMs) tool-calling capabilities. This automated system models APIs as finite-sta…
-
UC Santa Cruz professor discusses local SLMs and open-source AI
Adam Smith from UC Santa Cruz discussed the nuances of local Small Language Models (SLMs) and open-source AI workflows. The conversation explored the practical applications and development surrounding these smaller, mor…