¡Hola, Mundo!

Activation function It takes the output of a neuron and decide whether this neuron is going to fire or not, in other words, "should this neuron 'fire' or not?" Activation function Step function Hardly used. Sigmoid function Used in Binary Classification. Used in output layer usually. Vanishing Gradient possible. ↓ Hyperbolic tangent function ReLU(Rectified Linear Unit) function f(x) = max(0,x) I..

Perceptron It is a linear classifier, an algorithm for supervised learning of binary classifiers. Input(multiple x)-->Output(one y) x : input W : Weight y : output Each x has each weights. Larger w, more important x. Step function ∑W * x >=threshold(θ)-->output(y) : 1 ∑W * x output(y) : 0 Threshold(θ) can be expressed b(bias) such as Single-Layer Perceptron It can learn only linearly separable p..