Indic Languages
PulseAugur coverage of Indic Languages — every cluster mentioning Indic Languages across labs, papers, and developer communities, ranked by signal.
3 day(s) with sentiment data
-
New research quantifies multilingual tokenization tax, finding it largely removable
A new research paper proposes a "token-cost ledger" to quantify the extra cost associated with processing non-English text in large language models. The study, which analyzes eight languages on the FLORES-200 dataset, f…
-
New benchmarks reveal LLM struggles with Indic languages and translation mechanics · 3 sources tracked
Researchers have developed VakyArth, a new benchmark designed to evaluate the pragmatic competence of large language models (LLMs) specifically within Indic languages like Hindi, Punjabi, Tamil, and Malayalam. Initial f…
-
Hugging Face unveils efficient multimodal encoder NeoMME, study favors encoders for Indic NER
Hugging Face has introduced NeoMME, a new family of multilingual multimodal encoders designed for efficiency. Unlike many generative models, NeoMME uses a single bidirectional Transformer to process both text and image …
-
UniLipi OCR model unifies 13 Indic scripts for historical manuscripts
Researchers have developed UniLipi, a novel unified multi-script Optical Character Recognition (OCR) model designed for historical Indic manuscripts. This single framework can process 13 different Indic scripts, address…
-
New research explores advanced tokenization for LLMs, improving efficiency and performance · 4 sources tracked
Researchers are developing new methods for tokenizing text in large language models to improve efficiency and performance. One approach, SuTRA, focuses on morphological structure for morphologically rich languages like …
-
DonorRank framework improves donor language selection for low-resource speech recognition
Researchers have developed DonorRank, a novel learning-to-rank framework designed to improve the selection of effective donor languages for low-resource cross-lingual speech recognition. This method addresses the challe…
-
Researchers pinpoint cross-lingual refusal circuit in multilingual MoE model
Researchers have identified a specific circuit within a multilingual Mixture-of-Experts (MoE) model, named sarvam, that is responsible for refusing harmful requests. This circuit's ability to refuse is language-invarian…
-
New IndicTalk Corpus Boosts Multilingual Conversational AI for Indic Languages
Researchers have introduced IndicTalk, a substantial new corpus of multilingual, code-mixed conversations designed to advance conversational AI for Indic languages. The dataset features over 1.3 million multi-turn dialo…
-
New benchmark reveals LLMs struggle with Romanized Indic-English code-mixing
A new benchmark called Indi-RomCoM has been developed to evaluate Large Language Models (LLMs) on their ability to understand and process Romanized Code Mixing (RCM), a communication style blending Indic languages with …
-
Pāninian grammar offers unified framework for Indic language NLP
A new research paper proposes a unified computational framework for Indic languages, drawing inspiration from Pāninian grammar. The authors argue that the shared morphosyntactic architecture across these languages, form…
-
New IndicGuard model enhances LLM safety for Indic languages
Researchers have developed IndicGuard, a new multilingual safety guard model and dataset specifically designed for Indic languages. This model addresses the limitations of existing English-centric safety mechanisms by c…
-
AI Frameworks Enhance Multimodal Reasoning in Healthcare
Researchers are developing advanced multi-agent frameworks to enhance AI's capabilities in specialized domains like healthcare. These systems aim to improve reasoning accuracy and address limitations in multilingual and…
-
New ASR methods tackle compute scaling and multilingual evaluation
Researchers are developing new methods to improve automatic speech recognition (ASR) systems. One approach, LARM, uses a depth-conditioned looped Transformer to allow for adjustable test-time computation, achieving perf…
-
New pipeline targets abusive comments in Indic languages
Researchers have developed a multi-stage training pipeline for detecting abusive comments in Indic languages. The proposed system utilizes language-based preprocessing and an ensemble of models to identify harmful conte…
-
SCRIBE framework improves ASR for Indic languages with new error analysis
Researchers have introduced SCRIBE, a new diagnostic framework designed to improve automatic speech recognition (ASR) for Indic languages. Unlike traditional metrics like Word Error Rate (WER), SCRIBE categorizes errors…
-
New benchmark FinVQA and FIND framework tackle multilingual financial reasoning
Researchers have introduced FinVQA, a new benchmark designed to evaluate financial reasoning and question answering capabilities across multiple Indic languages. This benchmark includes 18,900 samples in English, Hindi,…
-
New dataset and model boost medical dialogue for Indic languages
Researchers have developed IndicMedDialog, a new dataset designed to improve medical dialogue systems for Indic languages. This dataset includes parallel multi-turn conversations in English and nine Indic languages, cre…
-
Movie subtitle translation enhanced by visual cues for Indic languages
Researchers have developed a method for visually-guided movie subtitle translation, focusing on low-resource Indic languages. Their study compares two lightweight visual grounding strategies, finding that temporal misal…
-
New benchmark evaluates Indic TTS accent fidelity across six dimensions
Researchers have introduced PSP, a new benchmark designed to evaluate the accent accuracy of text-to-speech (TTS) systems for Indic languages. Unlike existing metrics that focus on intelligibility and naturalness, PSP s…
-
New study evaluates 7 TTS systems for 10 Indian languages
Researchers have developed a new framework for evaluating Text-to-Speech (TTS) systems in Indian languages, addressing the high variance typically seen in crowdsourced evaluations. This framework uses controlled, multid…