Tag Archives: Matlab

[UFLDL Exercise] Implement deep networks for digit classification

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is the 6th exercise, which is a combination of Sparse Autoencoder and Softmax regression algorithm, and fine-tuning algorithm. It builds a 2-hidden layers sparse autoencoder net and one layer Softmax regression, we first train this network layer by layer, from left to right, then […]

Posted in Algorithm, Machine Learning | Also tagged , , , , , , | 3 Responses

[UFLDL Exercise] Self-Taught Learning

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is the 5th exercise, which is a combination of Sparse Autoencoder and Softmax regression algorithm. It uses the features trained by sparse autoencoder as training input of Softmax regression, and builds a classifier which have more accuracy than regular softmax regression. I’ll not go through […]

Posted in Algorithm, Machine Learning | Also tagged , , , | 2 Responses

[UFLDL Exercise] Softmax Regression

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is the 4th exercise, which is using Softmax regression to build a classifier and classify MNIST handwritten digits. Just like my other UFLDL exercise posts, I’ll not go through the detail of the material. More details about this exercise can be found HERE. I’ll re-implement Softmax […]

Posted in Algorithm, Machine Learning | Also tagged , , , | 4 Responses

[UFLDL Exercise] PCA and Whitening

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is part 2 of the 3rd exercise, which is use PCA algorithm in a natural image dataset. Just like my other UFLDL exercise posts, I’ll not go through the detail of the material. More details about this exercise can be found HERE.

Posted in Algorithm, Machine Learning | Also tagged , , , , | 2 Responses

[UFLDL Exercise] PCA in 2D

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is part 1 of the 3rd exercise, which is use PCA algorithm in a simple 2D dataset. Just like my other UFLDL exercise posts, I’ll not go through the detail of the material. More details about this exercise can be found HERE.

Posted in Algorithm, Machine Learning, Uncategorized | Also tagged , , , | Leave a comment

[UFLDL Exercise] Sparse Autoencoder

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, I finished the first exercise, the tutorial is very professional and easy to learn. I don’t think I need to go through the detail of what Sparse Autoencoder is, I’ll put my code of the exercise here, if you have any question about it, feel […]

Posted in Algorithm, Machine Learning | Also tagged , , , , , | 6 Responses

Something About Convolution

I was in Communications Engineering major during my undergraduate years, I learnt Signals and Systems and Digital Signal Processing before, so I thought I was quite familiar with things like convolution, Fourier transform. However, recently I realized that what I knew is only sort of superficial things. I’m attending Prof. Eero Simoncelli‘s “Representation and Analysis of […]

Posted in Algorithm, Maths | Also tagged , , , , | Leave a comment

Logistic Regression

With the background of Linear Regression, it is super easy to understand Logistic Regression. What we do in a linear regression problem, is to guess a hyperplane, that can represent the relationship between X and Y; however in logistic regression problem, we do nothing but guess a hyperplane, which can classify X1 and X2, that […]

Posted in Algorithm, Machine Learning | Also tagged , , , | 8 Responses