All 7 Activation Functions questions
More in Activation Functions
Why is Activation Functions important in Deep Learning How does Activation Functions work What are the key parts or types of Activation Functions What are common mistakes to avoid with Activation Functions What is a real world example of Activation Functions What are best practices for Activation Functions
Advertisement
Back to results for “Deep Learning topics: Introduction to Deep Learning”
Deep Learning › Activation Functions

What is Activation Functions

Beginner

Answer

An activation function is a mathematical function inside a neural network that decides whether and how strongly a neuron should pass its signal forward.
Real-world example The ReLU activation function is widely used because it is simple and helps a network trained on image data learn faster than older functions.

Common follow-ups: What is Deep Learning, How is Activation Functions evaluated in practice, What tools are commonly used for Activation Functions

Deep Learning topics: Introduction to Deep Learning Perceptrons & Multilayer Networks Activation Functions
All 7 Activation Functions questions