Step 1: can LSTM learn precise timing?
Yes, can learn to make sharp nonlinear spikes every n steps (Gers, 2001)
For instance: n = 1,…,50,…. nonvariable
Or: n = 1…30... variable, depending on a special stationary input
Can also extract info from time delays: Target = 1.0 if delay between spikes in input sequence = 20, else target = 0.0
Compare HMMs which ignore delays
Back to J. Schmidhuber's Recurrent neural network page