[Machine Learning] Introduction of Tanh function
Last Updated on 2021-06-06 by Clay
Tanh
Tanh function, the formula is:
Read More »[Machine Learning] Introduction of Tanh functionFebruary 2020
[Machine Learning] Introduction of Softmax function
Last Updated on 2021-06-03 by Clay
Softmax
Softmax function, mapping the vector between (0, 1), also represents the probability distribution of each element (classification class) in the vector.
Read More »[Machine Learning] Introduction of Softmax function[Machine Learning] Introduction of ReLU
Last Updated on 2021-06-03 by Clay
What is ReLU
Rectified Linear Unit (ReLU), is a famous activation function in neural network layer, it is believed to have sine degree if biological principle, although I don't know what it is. =)
Read More »[Machine Learning] Introduction of ReLU[Machine Learning] Sigmoid function introduction
Last Updated on 2021-06-03 by Clay
Introduction
Sigmoid() function is a mapping function, it will map any variable (In the following content we write the the symbol x) to [0, 1]. And it is often used to be a activation function in neural network layer of Machine Learning.
Read More »[Machine Learning] Sigmoid function introduction