User profiles for Salah Rifai
Salah Rifaiuniversité de Montréal Verified email at iro.umontreal.ca Cited by 4604 |
[HTML][HTML] Contractive auto-encoders: Explicit invariance during feature extraction
S Rifai - 2011 - academia.edu
We present in this paper a novel approach for training deterministic auto-encoders. We show
that by adding a well chosen penalty term to the classical reconstruction cost function, we …
that by adding a well chosen penalty term to the classical reconstruction cost function, we …
The manifold tangent classifier
We combine three important ideas present in previous work for building classifiers: the semi-supervised
hypothesis (the input distribution contains information about the classifier), the …
hypothesis (the input distribution contains information about the classifier), the …
Higher order contractive auto-encoder
We propose a novel regularizer when training an auto-encoder for unsupervised feature
extraction. We explicitly encourage the latent representation to contract the input space by …
extraction. We explicitly encourage the latent representation to contract the input space by …
Better mixing via deep representations
It has been hypothesized, and supported with experimental evidence, that deeper representations,
when well trained, tend to do a better job at disentangling the underlying factors of …
when well trained, tend to do a better job at disentangling the underlying factors of …
Disentangling factors of variation for facial expression recognition
We propose a semi-supervised approach to solve the task of emotion recognition in 2D face
images using recent ideas in deep learning for handling the factors of variation present in …
images using recent ideas in deep learning for handling the factors of variation present in …
Unsupervised and transfer learning challenge: a deep learning approach
Learning good representations from a large set of unlabeled data is a particularly challenging
task. Recent work (see Bengio (2009) for a review) shows that training deep architectures …
task. Recent work (see Bengio (2009) for a review) shows that training deep architectures …
Deep learners benefit more from out-of-distribution examples
Recent theoretical and empirical work in statistical machine learning has demonstrated the
potential of learning algorithms for deep architectures, ie, function classes obtained by …
potential of learning algorithms for deep architectures, ie, function classes obtained by …
A generative process for sampling contractive auto-encoders
The contractive auto-encoder learns a representation of the input data that captures the
local manifold structure around each data point, through the leading singular vectors of the …
local manifold structure around each data point, through the leading singular vectors of the …
Adding noise to the input of a model trained with a regularized objective
Regularization is a well studied problem in the context of neural networks. It is usually used
to improve the generalization performance when the number of input samples is relatively …
to improve the generalization performance when the number of input samples is relatively …
Unsupervised learning of semantics of object detections for scene categorization
Classifying scenes (eg into “street”, “home” or “leisure”) is an important but complicated task
nowadays, because images come with variability, ambiguity, and a wide range of …
nowadays, because images come with variability, ambiguity, and a wide range of …