Tag Archives: Sparse Autoencoder

Denoising Autoencoder

I chose “Dropped out auto-encoder” as my final project topic in the last semester deep learning course, it was simply dropping out units in regular sparse auto-encoder, and furthermore, in stacked sparse auto-encoder, both in visible layer and hidden layer. It does not work well on auto-encoders, except can be used in fine-tune process of stacked sparse […]

Posted in Algorithm, Machine Learning, OpenCV | Also tagged , , , , | 1 Response

A Simple Deep Network

During this spring break, I worked on building a simple deep network, which has two parts, sparse autoencoder and softmax regression. The method is exactly the same as the “Building Deep Networks for Classification” part in UFLDL tutorial. For better understanding it, I re-implemented it using C++ and OpenCV.  GENERAL OUTLINE Read dataset (including training data […]

Posted in Algorithm, Machine Learning, OpenCV | Also tagged , , , , , , , | 37 Responses

[UFLDL Exercise] Implement deep networks for digit classification

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is the 6th exercise, which is a combination of Sparse Autoencoder and Softmax regression algorithm, and fine-tuning algorithm. It builds a 2-hidden layers sparse autoencoder net and one layer Softmax regression, we first train this network layer by layer, from left to right, then […]

Posted in Algorithm, Machine Learning | Also tagged , , , , , , | 3 Responses

[UFLDL Exercise] Self-Taught Learning

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is the 5th exercise, which is a combination of Sparse Autoencoder and Softmax regression algorithm. It uses the features trained by sparse autoencoder as training input of Softmax regression, and builds a classifier which have more accuracy than regular softmax regression. I’ll not go through […]

Posted in Algorithm, Machine Learning | Also tagged , , , | 2 Responses

[UFLDL Exercise] Sparse Autoencoder

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, I finished the first exercise, the tutorial is very professional and easy to learn. I don’t think I need to go through the detail of what Sparse Autoencoder is, I’ll put my code of the exercise here, if you have any question about it, feel […]

Posted in Algorithm, Machine Learning | Also tagged , , , , , | 6 Responses