Tag Archives: Machine Learning

[UFLDL Exercise] Convolution and Pooling

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is the 8th exercise, which is a simple ConvNet with Pooling process. I’ll not go through the detail of the material. More details about this exercise can be found HERE. I’ll try to implement it using C++ and OpenCV if I have time next week.

Posted in Algorithm, Machine Learning | Also tagged , , , , | 1 Response

Softmax Regression (with OpenCV)

This is the same algorithm with the previous SOFTMAX REGRESSION post. Because I’m going to try to build deeper neural networks for images, so as a review of OpenCV programming, I rewrote the Softmax regression code using OpenCV mat, instead of Armadillo. I used Matlab, Octave, Armadillo a lot these days, it is kind of […]

Posted in Algorithm, Machine Learning, OpenCV | Also tagged , , , | 3 Responses

[UFLDL Exercise] Implement deep networks for digit classification

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is the 6th exercise, which is a combination of Sparse Autoencoder and Softmax regression algorithm, and fine-tuning algorithm. It builds a 2-hidden layers sparse autoencoder net and one layer Softmax regression, we first train this network layer by layer, from left to right, then […]

Posted in Algorithm, Machine Learning | Also tagged , , , , , , | 3 Responses

C++ code for reading MNIST dataset

Here’s a code for reading MNIST dataset in C++, the dataset can be found HERE, and the file format is as well. Using this code, you can read MNIST dataset into a double vector, or an OpenCV Mat, or Armadillo mat. Feel free to use it for any purpose. (part of this code is stolen from […]

Posted in Machine Learning, OpenCV | Also tagged , , , | 5 Responses

[UFLDL Exercise] Self-Taught Learning

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is the 5th exercise, which is a combination of Sparse Autoencoder and Softmax regression algorithm. It uses the features trained by sparse autoencoder as training input of Softmax regression, and builds a classifier which have more accuracy than regular softmax regression. I’ll not go through […]

Posted in Algorithm, Machine Learning | Also tagged , , , | 2 Responses

Softmax Regression

WHAT IS SOFTMAX Softmax regression always as one module in a deep learning network, and most likely to be the last module, the output module. What is it? It is a generalized version of logistic regression. Just like logistic regression, it belongs to supervised learning, and the superiority is, the class label y can be more than […]

Posted in Algorithm, Machine Learning | Also tagged , , , | 1 Response

[UFLDL Exercise] Softmax Regression

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is the 4th exercise, which is using Softmax regression to build a classifier and classify MNIST handwritten digits. Just like my other UFLDL exercise posts, I’ll not go through the detail of the material. More details about this exercise can be found HERE. I’ll re-implement Softmax […]

Posted in Algorithm, Machine Learning | Also tagged , , , | 4 Responses

[UFLDL Exercise] PCA and Whitening

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is part 2 of the 3rd exercise, which is use PCA algorithm in a natural image dataset. Just like my other UFLDL exercise posts, I’ll not go through the detail of the material. More details about this exercise can be found HERE.

Posted in Algorithm, Machine Learning | Also tagged , , , , | 2 Responses

[UFLDL Exercise] PCA in 2D

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is part 1 of the 3rd exercise, which is use PCA algorithm in a simple 2D dataset. Just like my other UFLDL exercise posts, I’ll not go through the detail of the material. More details about this exercise can be found HERE.

Posted in Algorithm, Machine Learning, Uncategorized | Also tagged , , , | Leave a comment

[UFLDL Exercise] Sparse Autoencoder

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, I finished the first exercise, the tutorial is very professional and easy to learn. I don’t think I need to go through the detail of what Sparse Autoencoder is, I’ll put my code of the exercise here, if you have any question about it, feel […]

Posted in Algorithm, Machine Learning | Also tagged , , , , , | 6 Responses