I wrote some nice beginner-friendly examples of RNNs and LSTMs in CT5133/CT5145. I should add these here as a Jupyter Notebook.