Activation Functions in Neural Networks
![Image](https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgnFn3epfsjjI_pOyTkC8MhXCOBM-D-DQaD0PGYakYK3KcWvdCTZ27j3T6CKmGNoX6xRXtK5JI4DBjxAh90ksNZsPNI7AzR2f6SD3I_5FjBph_gDFY314hQBVjyPS2wpQHWXO9GIZkxIZk/s400/arc-neurons-memory.jpg)
What are Activation Functions ? Activation Function of a neuron defines the output of that neuron given a sets of inputs. They are biologically similar to the activities in our brain, where different neurons are activated by different stimuli. For example: A cake will activate some set of neurons (something pleasant) in the brain whereas, a garbage can will activate some other set of neurons (something unpleasant). Activation Functions are really important for a Artificial Neural Network to learn and make sense of something really complicated and Non-linear complex functional mappings between the inputs and response variable. They introduce non-linear properties to our Network . Their main purpose is to convert a input signal of a node in a A-NN to an output signal. That output signal now is used as a input in the next layer in the stack. Is it necessary to have an Activation function? The answer is YES! If we do not apply a Activation function then the outp