Podcast
Questions and Answers
What is the purpose of an activation function in a neuron?
What is the purpose of an activation function in a neuron?
- To increase the randomness of the neuron's response
- To decrease the interaction among neuron units
- To ensure the neuron's response is bounded (correct)
- To amplify the neuron's response to activating stimuli
What does the logistic activation function $\varphi(z) = \frac{1}{1 + e^{-\alpha z}}$ do?
What does the logistic activation function $\varphi(z) = \frac{1}{1 + e^{-\alpha z}}$ do?
- Maps the input to a value between 0 and 1 (correct)
- Maps the input to a value between -1 and 1
- Maps the input to a value between 1 and 2
- Maps the input to a value between 0 and 2
What do the connection strengths or weights represent in a neural system?
What do the connection strengths or weights represent in a neural system?
- Knowledge in the system (correct)
- Speed of information processing
- Activation levels of the neurons
- Random noise in the system
What is the purpose of the hyperbolic tangent activation function $\varphi(u) = \tanh(\gamma u) = \frac{1 - e^{-2\gamma u}}{1 + e^{-2\gamma u}}$?
What is the purpose of the hyperbolic tangent activation function $\varphi(u) = \tanh(\gamma u) = \frac{1 - e^{-2\gamma u}}{1 + e^{-2\gamma u}}$?
What does the threshold activation function $\varphi(z) = \text{sign}(z)$ do?
What does the threshold activation function $\varphi(z) = \text{sign}(z)$ do?