Questions and Answers
What is the purpose of an activation function in a neuron?
To ensure the neuron's response is bounded
What does the logistic activation function $\varphi(z) = \frac{1}{1 + e^{-\alpha z}}$ do?
Maps the input to a value between 0 and 1
What do the connection strengths or weights represent in a neural system?
Knowledge in the system
What is the purpose of the hyperbolic tangent activation function $\varphi(u) = \tanh(\gamma u) = \frac{1 - e^{-2\gamma u}}{1 + e^{-2\gamma u}}$?
Signup and view all the answers
What does the threshold activation function $\varphi(z) = \text{sign}(z)$ do?
Signup and view all the answers
