¡Hola, Mundo!

Activation functionIt takes the output of a neuron and decide whether this neuron is going to fire or not, in other words, "should this neuron 'fire' or not?"Activation function Step functionHardly used. Sigmoid functionUsed in Binary Classification.Used in output layer usually.When calculating the slope of the orange part, a very small value close to zero comes out. Therefore, if a very small s..

Logistic Regression The problem that determines one of the two is called binary classification. And there is logistic regression for solving binary classification. It has a single layer of weights. To represent these problems, we need functions that can be represented in the S-shape rather than a straight-line function such as Wx + b(2021.03.16 - [Machine Learning] - Linear Regression, Simple Li..