Swish: Booting ReLU from the Activation Function Throne | by Andre Ye | Towards Data Science
Rectifier (neural networks) - Wikipedia
What makes ReLU so much better than Linear Activation? As half of them are exactly the same. - Quora
Flatten-T Swish: A Thresholded ReLU-Swish-like Activation Function for Deep Learning | by Joshua Chieng | Medium
Why Relu? Tips for using Relu. Comparison between Relu, Leaky Relu, and Relu-6. | by Chinesh Doshi | Medium
Activation Functions in Neural Networks (Sigmoid, ReLU, tanh, softmax) - YouTube
LiSHT (linear scaled Hyperbolic Tangent) - better than ReLU? - testing it out - Part 2 (2019) - Deep Learning Course Forums
ReLU activation function vs. LeakyReLU activation function. | Download Scientific Diagram
tensorflow - Can relu be used at the last layer of a neural network? - Stack Overflow
Activation Functions Explained - GELU, SELU, ELU, ReLU and more
What makes ReLU so much better than Linear Activation? As half of them are exactly the same. - Quora
Attention mechanism + relu activation function: adaptive parameterized relu activation function | Develop Paper
Swish Vs Mish: Latest Activation Functions – Krutika Bapat – Engineering at IIIT-Naya Raipur | 2016-2020
Rectifier (neural networks) - Wikipedia
Which activation function suits better to your Deep Learning scenario? - Datascience.aero
Advantages of ReLU vs Tanh vs Sigmoid activation function in deep neural networks. - Knowledge Transfer
Different Activation Functions for Deep Neural Networks You Should Know | by Renu Khandelwal | Geek Culture | Medium
Empirical Evaluation of Rectified Activations in Convolution Network
How to Choose the Right Activation Function for Neural Networks | by Rukshan Pramoditha | Towards Data Science
Deep Learning Networks: Advantages of ReLU over Sigmoid Function - DataScienceCentral.com
Swish Vs Mish: Latest Activation Functions – Krutika Bapat – Engineering at IIIT-Naya Raipur | 2016-2020
Why is relu better than tanh and sigmoid function in artificial neural network? - 文章整合
Meet Mish: New Activation function, possible successor to ReLU? - fastai users - Deep Learning Course Forums
Advantages of ReLU vs Tanh vs Sigmoid activation function in deep neural networks. - Knowledge Transfer
A Comprehensive Survey and Performance Analysis of Activation Functions in Deep Learning
What makes ReLU so much better than Linear Activation? As half of them are exactly the same. - Quora
FReLU: Flexible Rectified Linear Units for Improving Convolutional Neural Networks
