hyperbolic tangent
PulseAugur coverage of hyperbolic tangent — every cluster mentioning hyperbolic tangent across labs, papers, and developer communities, ranked by signal.
5 day(s) with sentiment data
-
Rational Neural Networks Offer Expressivity Advantages Over Standard Activations
Researchers have introduced Rational Neural Networks (RNNs), which utilize trainable low-degree rational activation functions. These networks demonstrate superior expressivity and parameter efficiency compared to tradit…
-
Recurrent Neural Networks Exhibit Task-Specific Redundancy in Weight Space
Researchers have explored the functional redundancy within the weight space of recurrent neural networks, specifically using ordered real Schur coordinates in one-layer tanh RNNs. This method separates spectral blocks f…
-
Machine Learning in Healthcare Course Syllabus Detailed
This document outlines a comprehensive curriculum for a Machine Learning in Healthcare course. It covers fundamental concepts like the distinction between machine learning and deep learning, various neural network archi…
-
RepNet tackles spectral bias in deep neural networks
Researchers have introduced RepNet, a novel deep neural network architecture designed to address spectral bias, a common limitation in capturing high-frequency and oscillatory behaviors. By reparameterizing the weights …
-
New training strategy allows neural networks to learn per-neuron activation functions
Researchers have developed SmartMixed, a new two-phase training strategy that enables neural networks to learn optimal activation functions for individual neurons. The first phase uses a differentiable mixture mechanism…
-
Paper analyzes floating-point neural network expressivity
Researchers have published a paper exploring the expressive power of neural networks operating with floating-point arithmetic, moving beyond theoretical models that assume exact real numbers. The study introduces a fram…
-
New method secures embedded neural networks against timing attacks
Researchers have developed a new methodology for implementing activation functions in embedded neural networks that prevents information leakage through timing side channels. This approach ensures consistent execution t…
-
LSTM networks overcome RNN memory limitations with gating mechanisms
The Long Short-Term Memory (LSTM) network was developed to address the limitations of traditional Recurrent Neural Networks (RNNs) in handling sequential data. Vanilla RNNs struggle with remembering information over lon…
-
LightCROWN improves neural control barrier function verification
Researchers have developed LightCROWN, a new method for efficiently verifying neural control barrier functions (NCBFs), particularly those with nonlinear activations like tanh. This approach improves upon existing CROWN…
-
Neural networks achieve super-fast convergence and represent complex functions with floating-point arithmetic
Two new arXiv papers explore theoretical aspects of neural network convergence and representation capabilities. The first paper demonstrates that neural network classifiers can achieve super-fast convergence rates under…
-
Contrast-Enhanced Gating in GRUs for Robust Low-Data Sequence Learning
Researchers have developed a new activation function called squared sigmoid-tanh (SST) designed to improve the performance of Gated Recurrent Units (GRUs) in sequence learning tasks, particularly when training data is l…