Johnson–Lindenstrauss lemma
PulseAugur coverage of Johnson–Lindenstrauss lemma — every cluster mentioning Johnson–Lindenstrauss lemma across labs, papers, and developer communities, ranked by signal.
-
New research explains why Zeroth-Order Optimization scales to LLMs
Two new papers explore zeroth-order (ZO) optimization for fine-tuning large language models (LLMs). The first paper introduces a kernel perspective, showing that the approximation error depends on output size rather tha…
-
New research explores limitations of structured Hadamard rotations for AI
Researchers have analyzed the effectiveness of using two-block structured Hadamard rotations as an approximation for computationally expensive uniform random rotations in high-dimensional applications. While the study s…
-
AI researchers explore neural network complexity and representational superposition
A recent writeup on the paper "On the Complexity of Neural Computation in Superposition" explains that neural networks are more complex than initially thought. Early theories suggested individual neurons represented spe…