Bert
PulseAugur coverage of Bert — every cluster mentioning Bert across labs, papers, and developer communities, ranked by signal.
- instance of ScienceCast 90%
- instance of Gotit.pub 90%
- used by alphaXiv 90%
- used by Gotit.pub 90%
- used by ScienceCast 90%
- used by CatalyzeX 90%
- instance of ModernBERT 90%
- instance of XLM-RoBERTa 90%
- instance of BERT based Web Mining of Concerns and Reviews for TV Drama Audience 90%
- used by WordPiece 90%
- instance of DagsHub 90%
- instance of Albert 90%
22 day(s) with sentiment data
-
MOAI framework boosts secure transformer inference with optimized HE
Researchers have developed MOAI, a novel framework designed to enhance the efficiency of non-interactive secure transformer inference using homomorphic encryption (HE). MOAI addresses the computational overhead of HE by…
-
Energy-Based Models Unify Diverse Machine Learning Approaches
A new tutorial paper published on arXiv explores machine learning through the lens of energy-based models (EBMs). It proposes that EBMs, which define distributions via a scalar energy function, can unify various machine…
-
New framework aids attribution of early Chinese Buddhist texts
Researchers have developed a new framework to analyze the stylistic features of early Chinese Buddhist translations, aiming to improve attribution accuracy. This framework utilizes linguistic elements such as function c…
-
New LLM benchmark boosts IFRS compliance verification accuracy · 2 sources tracked
Researchers have developed a new framework and benchmark to improve the accuracy of large language models (LLMs) in verifying corporate financial disclosures against International Financial Reporting Standards (IFRS). T…
-
LogCDM: Compact AI for Anomaly Detection on CPUs
Researchers have developed LogCDM, a compact anomaly detection system designed for efficient deployment on monitoring nodes without requiring GPUs. LogCDM utilizes three signals: the next-event surprise from a small Tra…
-
Open-weight LLMs show promise for Danish offensive language detection
A new arXiv paper investigates the performance of open-weight large language models (LLMs) like Llama, Mistral, Gemma, and Qwen for detecting offensive language in Danish, a low-resource task. The study found that even …
-
Embedding model all-MiniLM-L6-v2 silently truncates text, impacting RAG pipelines
The embedding model all-MiniLM-L6-v2 silently truncates text at 256 tokens, meaning that any content beyond this limit is ignored without any warning or error. This issue is compounded by LangChain's RecursiveCharacterT…
-
New GenVer system verifies knowledge graph accuracy using text generation
Researchers have developed GenVer, a novel generative verifier designed to assess the semantic accuracy of knowledge graphs. This system leverages both the structural information of triples and natural language represen…
-
VenusGenome model advances microbial genome representation learning
Researchers have developed VenusGenome, a novel gene-resolution masked autoencoder designed for microbial genome representation learning. This model incorporates genome-aware attention mechanisms to distinguish biologic…
-
Embedding model upgrades can silently break AI retrieval systems
Upgrading embedding models can silently break retrieval systems without throwing errors. This occurs when new query vectors are generated by a different model than the one used for existing document vectors, causing the…
-
LLM-generated annotations show promise for training smaller literary sentiment models
Researchers have explored using large language models (LLMs) to generate annotations for literary sentiment analysis, addressing the scarcity of human-annotated data. They fine-tuned five BERT models using annotations f…
-
New scaling law for data-constrained dense retrieval models unveiled
Researchers have developed a new scaling law to describe the performance of dense retrieval models under data-constrained fine-tuning conditions. This law, based on the minimum achievable evaluation loss (MAEL), accurat…
-
Japanese nanochat fork integrates AI pipeline, boosts BERT tokenization speed
A Japanese AI project has developed a fork of nanochat that integrates the entire AI pipeline into a single repository. This project reportedly includes a BERT tokenization step that operates 50 times faster than previo…
-
EffComp framework offers efficient prompt compression for RAG systems
Researchers have developed EffComp, a novel framework for efficient prompt compression in retrieval-augmented generation (RAG) systems. This method utilizes BERT-style models for sentence-level extraction, which prevent…
-
New Multi-Modal Multi-Agent System Enhances Bridge Operations
Researchers have developed a novel Multi-Modal Multi-Agent System (BOMMA) designed to enhance the operation and maintenance of bridges. This system integrates diverse diagnostic actions, physics-informed representations…
-
New SAR-TS-BERT framework boosts crop classification using physics-guided AI
Researchers have developed SAR-TS-BERT, a novel self-supervised pre-training framework designed for classifying crops using synthetic aperture radar (SAR) time-series data. This physics-guided approach integrates backsc…
-
Data augmentation boosts sentiment classification on small datasets
A new arXiv paper explores methods to improve sentiment classification performance on small datasets. The study compares three data augmentation techniques: Easy Data Augmentation (EDA), back-translation, and contextual…
-
NLP improves emergency message routing in disaster simulations
This research paper explores the use of Natural Language Processing (NLP) to prioritize emergency messages during disasters, using the 2015 Nepal earthquake as a case study. The study employed TF-IDF with Logistic Regre…
-
BERT cross-encoders in information retrieval: understanding relevance prediction
This paper investigates the internal workings of BERT-based cross-encoder models used in information retrieval. Researchers aim to understand how these models predict relevance between queries and documents, and how the…
-
BERT neural network used for text classification
The BERT neural network is a tool for text classification that can be trained with minimal data. It can be used to distinguish between commands like "temperature should be greater than 20" and aesthetic requests such as…