Photo by Katie Montgomery on Unsplash

Understanding the basics of RNNs

A recurrent neural network (RNN) is recurrent in the way it processes the sequences of data. This means that the same operation a is performed on all the data of the sequence input x, returning output ˆy of the specific unit for the specific point in the sequence t.

The figure below shows a simplified RNN, with one hidden layer, folded (left) and unfolded (right) through the dimension of time, where x_t is…