Category Archives: Algorithm

A Simple Deep Network

By Eric | Published: March 21, 2014

During this spring break, I worked on building a simple deep network, which has two parts, sparse autoencoder and softmax regression. The method is exactly the same as the “Building Deep Networks for Classification” part in UFLDL tutorial. For better understanding it, I re-implemented it using C++ and OpenCV. GENERAL OUTLINE Read dataset (including training data […]

Also posted in Machine Learning, OpenCV | Tagged C++, Deep Learning, fine-tune, Machine Learning, MNIST, OpenCV, Softmax, Sparse Autoencoder, UFLDL | 37 Responses

[UFLDL Exercise] Convolution and Pooling

By Eric | Published: March 18, 2014

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is the 8th exercise, which is a simple ConvNet with Pooling process. I’ll not go through the detail of the material. More details about this exercise can be found HERE. I’ll try to implement it using C++ and OpenCV if I have time next week.

Also posted in Machine Learning | Tagged ConvNet, Deep Learning, Machine Learning, Pooling, STL-10, UFLDL | 1 Response

Poisson Blending II

By Eric | Published: March 17, 2014

I re-wrote the Poisson Blending code using C++ and OpenCV. About the Algorithm, see my Previous Poisson Blending post. This time, I just used the most stupid way, just solving the Poisson Equation. You can improve it by using advanced methods. About solving discrete Poisson Equation using Jacobi, SOR, Conjugate Gradients, and FFT, read THIS. In […]

Also posted in Maths, OpenCV | Tagged C++, Conjugate Gradients, OpenCV, Poisson blending, Poisson Equation | 16 Responses

Softmax Regression (with OpenCV)

By Eric | Published: March 7, 2014

This is the same algorithm with the previous SOFTMAX REGRESSION post. Because I’m going to try to build deeper neural networks for images, so as a review of OpenCV programming, I rewrote the Softmax regression code using OpenCV mat, instead of Armadillo. I used Matlab, Octave, Armadillo a lot these days, it is kind of […]

Also posted in Machine Learning, OpenCV | Tagged C++, Deep Learning, Machine Learning, OpenCV, Softmax | 3 Responses

[UFLDL Exercise] Implement deep networks for digit classification

By Eric | Published: March 5, 2014

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is the 6th exercise, which is a combination of Sparse Autoencoder and Softmax regression algorithm, and fine-tuning algorithm. It builds a 2-hidden layers sparse autoencoder net and one layer Softmax regression, we first train this network layer by layer, from left to right, then […]

Also posted in Machine Learning | Tagged Deep Learning, deep network, Machine Learning, Matlab, MNIST, Softmax, Sparse Autoencoder, UFLDL | 3 Responses

[UFLDL Exercise] Self-Taught Learning

By Eric | Published: March 1, 2014

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is the 5th exercise, which is a combination of Sparse Autoencoder and Softmax regression algorithm. It uses the features trained by sparse autoencoder as training input of Softmax regression, and builds a classifier which have more accuracy than regular softmax regression. I’ll not go through […]

Also posted in Machine Learning | Tagged Machine Learning, Matlab, Softmax, Sparse Autoencoder, UFLDL | 2 Responses

Softmax Regression

By Eric | Published: February 28, 2014

WHAT IS SOFTMAX Softmax regression always as one module in a deep learning network, and most likely to be the last module, the output module. What is it? It is a generalized version of logistic regression. Just like logistic regression, it belongs to supervised learning, and the superiority is, the class label y can be more than […]

Also posted in Machine Learning | Tagged Armadillo, C++, Machine Learning, Softmax, Vectorization | 1 Response

[UFLDL Exercise] Softmax Regression

By Eric | Published: February 27, 2014

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is the 4th exercise, which is using Softmax regression to build a classifier and classify MNIST handwritten digits. Just like my other UFLDL exercise posts, I’ll not go through the detail of the material. More details about this exercise can be found HERE. I’ll re-implement Softmax […]

Also posted in Machine Learning | Tagged Deep Learning, Machine Learning, Matlab, MNIST, UFLDL | 4 Responses

[UFLDL Exercise] PCA and Whitening

By Eric | Published: February 26, 2014

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is part 2 of the 3rd exercise, which is use PCA algorithm in a natural image dataset. Just like my other UFLDL exercise posts, I’ll not go through the detail of the material. More details about this exercise can be found HERE.

Also posted in Machine Learning | Tagged Machine Learning, Matlab, PCA, UFLDL, Whitening, ZCA | 2 Responses

[UFLDL Exercise] PCA in 2D

By Eric | Published: February 26, 2014

I’m learning Prof. Andrew Ng’s Unsupervised Feature Learning and Deep Learning tutorial, This is part 1 of the 3rd exercise, which is use PCA algorithm in a simple 2D dataset. Just like my other UFLDL exercise posts, I’ll not go through the detail of the material. More details about this exercise can be found HERE.

Also posted in Machine Learning, Uncategorized | Tagged Machine Learning, Matlab, PCA, UFLDL, ZCA | Leave a comment

Search
Tag Cloud

active contour Algorithm alpha beta pruning Armadillo Bilateral Filter Blur C++ camShift Cluster CNN Computer Vision Convolutional Neural Networks Deep Learning deep network Dynamic Programming Gradient Descent image blending Image Processing image pyramid LeetCode Machine Learning Matlab meanShift MNIST neural networks NLP Octave OpenCV Panorama PCA Poisson blending Pooling pyramid blending RANSAC Recurrent Neural Networks RNNs seam carving SIFT snake Softmax Sparse Autoencoder track UFLDL Unsupervised Learning ZCA
Pages
- About Me
Categories
Archives

Friends
- Jeky Cui's blog
- Qi Cai's Blog

Category Archives: Algorithm

Search

Tag Cloud

Pages

Categories

Archives

Friends