LSTM cell (current standard)
Red: linear unit, self-weight 1.0 - the error carousel
Green: sigmoid gates open / protect access to error flow; forget gate (left) resets
Blue: multiplications
Previous slide
Next slide
Back to first slide
View graphic version
Back to
J. Schmidhuber
's
Recurrent neural network page