激活函数汇总

on Machine Learning, Theano

1. Sigmoid activation function

sigmoid(x)

softmax(x)

tanh(x) T

ScaledTanH([scale_in, scale_out])

rectify(x)

LeakyRectify([leakiness])

leaky_rectify(x)

very_leaky_rectify(x) I

elu(x)

softplus(x)

linear(x)

identity(x)

☰