PulseAugur
中
实时 16:58:34

新模型表明停用词偏离齐夫定律

作者 PulseAugur 编辑部 · [1 个来源] ·

一篇新的研究论文提出，语言中停用词和功能词的分布偏离了齐夫定律，而是符合Beta Rank Function (BRF)。研究表明，非停用词和非功能词也偏离了齐夫定律，但用对数词数与对数词秩的二次函数可以更好地描述。研究人员基于词秩开发了一个停用词/功能词/子集选择模型，并使用独立的文本集合进行了验证，并通过分析证明了该模型可以解释观察到的词秩-词频分布。 AI

排序理由 该集群包含一篇详细介绍新语言分布模型的学术论文。[lever_c_demoted from research: ic=1 ai=0.4]

在 arXiv cs.CL 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

新模型表明停用词偏离齐夫定律

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
该集群包含一篇详细介绍新语言分布模型的学术论文。[lever_c_demoted from research: ic=1 ai=0.4]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
Standard
On-topic for AI-industry coverage; kept in the public index.
Story freshness
56 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [1]

  1. arXiv cs.CL TIER_1 English(EN) · Wentian Li, Oscar Fontanelli ·

    非齐夫分布的停用词或功能词及子集选择模型

    arXiv:2603.04691v2 Announce Type: replace Abstract: Stopwords and function words are relatively less informative for the content of a language and more often play a structural role in a sentence. Stopwords are ubiquitous words and may contain verbs, adjectives and adverbs. On the…

相关实体

相关话题