عجفت الغور

recurrent neural networks (rnn)

Tags: ml

  • good for tasks that require sequential input
  • processes and input sequence one element at a time, maintaining a hidden “state vector”
  • has a vanishing problem since backpropagated gardients grow or shrink at each time step
  • very good at predicting the next character in the text or the next word in a sequence