Ngau Tau Kok
PulseAugur coverage of Ngau Tau Kok — every cluster mentioning Ngau Tau Kok across labs, papers, and developer communities, ranked by signal.
-
Paper explores preconditioned gradient descent's impact on neural network learning regimes
This paper investigates how preconditioned gradient descent (PGD) methods, like Gauss-Newton, influence spectral bias and the phenomenon of grokking in neural networks. Researchers propose that PGD can mitigate spectral…
-
An adaptive wavelet-based PINN for problems with localized high-magnitude source
Researchers have developed an adaptive wavelet-based physics-informed neural network (AW-PINN) to address limitations in solving differential equations, particularly those with localized high-magnitude source terms. Thi…
-
New research explores activation functions beyond ReLU in neural networks
A new paper explores the theoretical underpinnings of neural network kernels, specifically focusing on activation functions beyond the standard ReLU. Researchers characterized the Reproducing Kernel Hilbert Spaces (RKHS…
-
LoRA fine-tuning research suggests rank 1 is sufficient, proposes data-aware initialization
Three new research papers explore methods to optimize LoRA fine-tuning for large language models. One paper proposes reducing the LoRA rank threshold to 1 for binary classification tasks, showing competitive performance…