Tag Archives: RNNs

Recurrent Neural Networks II — LSTM

In my previous post, I introduced the basic ideas of Recurrent Neural Networks, as the 2nd post of RNNs, we’ll focus on long short-term memory method. LONG SHORT TERM MEMORY One of the very famous problems of RNNs is the vanishing gradient, the problem is that the influence of a given input on the hidden layer, […]

Posted in Machine Learning, NLP, OpenCV | Also tagged , , , , , , , | 6 Responses

Recurrent Neural Networks I

RNNs Recurrent neural networks are very famous recently, they play as important roles as convolutional neural networks. RNNs can use their internal memory to process arbitrary sequences of inputs, so not only images, they work well on speech recognition and natural language processing tasks. There are several type of RNNs, as the beginning, we focus our attention on […]

Posted in Machine Learning, NLP | Also tagged , , | 6 Responses