half-precision floating-point format
PulseAugur coverage of half-precision floating-point format — every cluster mentioning half-precision floating-point format across labs, papers, and developer communities, ranked by signal.
No coverage in the last 90 days.
-
INT8 quantization can slow down AI inference, study finds
A recent analysis explored the performance of INT8 quantization versus FP16 precision on NVIDIA's Ada Lovelace architecture, specifically using an L40S datacenter GPU and an RTX 4090 consumer card. The findings indicate…
-
EdgeLPR paper explores neural network precision vs performance trade-offs for LiDAR place recognition
Researchers have developed EdgeLPR, a method for efficient LiDAR-based place recognition on edge devices. The approach utilizes Bird's Eye View representations to enable lightweight image-based networks for autonomous n…
-
Object detection models show mixed robustness to quantization and input degradations
A new study investigates how post-training quantization (PTQ) affects the robustness of YOLO object detection models when faced with real-world input degradations like noise and blur. Researchers evaluated various preci…
-
New methods QFlash and ELSA boost Vision Transformer attention efficiency
Researchers have developed two new methods to improve the efficiency of attention mechanisms in vision transformers. QFlash focuses on enabling integer-only operations for FlashAttention, achieving significant speedups …
-
AI safety research proposes formal framework for computational substrates
This series of posts explores the concept of 'substrates' in AI, which refers to the computational context layers necessary for implementing AI systems. The authors argue that current AI safety research lacks a clear fr…
-
Apple's SeedLM compresses LLM weights using pseudo-random generators
Researchers have developed SeedLM, a novel post-training compression technique for large language models that utilizes pseudo-random generator seeds to encode model weights. This method aims to reduce the high runtime c…
-
Optimizing Transformer Inference: Techniques for Faster, Cheaper Large Models
Large transformer models present significant inference challenges due to their substantial memory footprint and computation costs, which scale quadratically with input length. Researchers and practitioners are exploring…