DeepLearningTutorials – Deep Learning Tutorial notes and code. See the wiki for more info.
 Deep Learning is a new area of Machine Learning research, which has been introduced with the objective of moving Machine Learning closer to one of …
 The easiest way to follow the tutorials is to browse them online.
 To build the html version of the tutorials, install sphinx and run doc/Makefile
Deep Learning Tutorials
Deep Learning is a new area of Machine Learning research, which has been introduced with the objective of moving Machine Learning closer to one of its original goals: Artificial Intelligence. See these course notes for a brief introduction to Machine Learning for AI and an introduction to Deep Learning algorithms.
Deep Learning is about learning multiple levels of representation and abstraction that help to make sense of data such as images, sound, and text. For more about deep learning algorithms, see for example:
 The monograph or review paper Learning Deep Architectures for AI (Foundations & Trends in Machine Learning, 2009).
 The ICML 2009 Workshop on Learning Feature Hierarchies webpage has a list of references.
 The LISA public wiki has a reading list and a bibliography.
 Geoff Hinton has readings from last year’s NIPS tutorial.
The tutorials presented here will introduce you to some of the most important deep learning algorithms and will also show you how to run them using Theano. Theano is a python library that makes writing deep learning models easy, and gives the option of training them on a GPU.
The algorithm tutorials have some prerequisites. You should know some python, and be familiar with numpy. Since this tutorial is about using Theano, you should read over the Theano basic tutorial first. Once you’ve done that, read through our Getting Started chapter – it introduces the notation, and [downloadable] datasets used in the algorithm tutorials, and the way we do optimization by stochastic gradient descent.
The purely supervised learning algorithms are meant to be read in order:
 Logistic Regression – using Theano for something simple
 Multilayer perceptron – introduction to layers
 Deep Convolutional Network – a simplified version of LeNet5
The unsupervised and semisupervised learning algorithms can be read in any order (the autoencoders can be read independently of the RBM/DBN thread):
 Auto Encoders, Denoising Autoencoders – description of autoencoders
 Stacked Denoising AutoEncoders – easy steps into unsupervised pretraining for deep nets
 Restricted Boltzmann Machines – single layer generative RBM model
 Deep Belief Networks – unsupervised generative pretraining of stacked RBMs followed by supervised finetuning
Building towards including the mcRBM model, we have a new tutorial on sampling from energy models:
 HMC Sampling – hybrid (aka Hamiltonian) MonteCarlo sampling with scan()
 Building towards including the Contractive autoencoders tutorial, we have the code for now:

 Contractive autoencoders code – There is some basic doc in the code.
 Energybased recurrent neural network (RNNRBM):

Run command on pcDuino Ubuntu Terminal:
$ sudo aptget install git $ git clone https://github.com/lisalab/DeepLearningTutorials
Leave a Reply
You must be logged in to post a comment.