Activation functionIt takes the output of a neuron and decide whether this neuron is going to fire or not, in other words, "should this neuron 'fire' or not?"Activation function Step functionHardly used. Sigmoid functionUsed in Binary Classification.Used in output layer usually.When calculating the slope of the orange part, a very small value close to zero comes out. Therefore, if a very small s..
