A Briefly Introduction to RNN First, let’s break down a RNN module. Here’s the structure of a RNN node, which has two inputs, where $X_t$ represent current time’s input, $H_{t-1}$ represent previous hidden state. After go through $\phi$ which is a FC layer with active function(by default it’s a $tanh$ function), it has two outputs…