User profiles for Salah Rifai

Salah Rifai

université de Montréal
Verified email at iro.umontreal.ca
Cited by 4604

[HTML][HTML] Contractive auto-encoders: Explicit invariance during feature extraction

S Rifai - 2011 - academia.edu
We present in this paper a novel approach for training deterministic auto-encoders. We show
that by adding a well chosen penalty term to the classical reconstruction cost function, we …

The manifold tangent classifier

S Rifai, YN Dauphin, P Vincent… - Advances in neural …, 2011 - proceedings.neurips.cc
We combine three important ideas present in previous work for building classifiers: the semi-supervised
hypothesis (the input distribution contains information about the classifier), the …

Higher order contractive auto-encoder

S Rifai, G Mesnil, P Vincent, X Muller, Y Bengio… - … European conference on …, 2011 - Springer
We propose a novel regularizer when training an auto-encoder for unsupervised feature
extraction. We explicitly encourage the latent representation to contract the input space by …

Better mixing via deep representations

…, G Mesnil, Y Dauphin, S Rifai - … conference on machine …, 2013 - proceedings.mlr.press
It has been hypothesized, and supported with experimental evidence, that deeper representations,
when well trained, tend to do a better job at disentangling the underlying factors of …

Disentangling factors of variation for facial expression recognition

S Rifai, Y Bengio, A Courville, P Vincent… - European Conference on …, 2012 - Springer
We propose a semi-supervised approach to solve the task of emotion recognition in 2D face
images using recent ideas in deep learning for handling the factors of variation present in …

Unsupervised and transfer learning challenge: a deep learning approach

G Mesnil, Y Dauphin, X Glorot, S Rifai… - … of ICML Workshop …, 2012 - proceedings.mlr.press
Learning good representations from a large set of unlabeled data is a particularly challenging
task. Recent work (see Bengio (2009) for a review) shows that training deep architectures …

Deep learners benefit more from out-of-distribution examples

…, SP Lebeuf, R Pascanu, S Rifai… - Proceedings of the …, 2011 - proceedings.mlr.press
Recent theoretical and empirical work in statistical machine learning has demonstrated the
potential of learning algorithms for deep architectures, ie, function classes obtained by …

A generative process for sampling contractive auto-encoders

S Rifai, Y Bengio, Y Dauphin, P Vincent - arXiv preprint arXiv:1206.6434, 2012 - arxiv.org
The contractive auto-encoder learns a representation of the input data that captures the
local manifold structure around each data point, through the leading singular vectors of the …

Adding noise to the input of a model trained with a regularized objective

S Rifai, X Glorot, Y Bengio, P Vincent - arXiv preprint arXiv:1104.3250, 2011 - arxiv.org
Regularization is a well studied problem in the context of neural networks. It is usually used
to improve the generalization performance when the number of input samples is relatively …

Unsupervised learning of semantics of object detections for scene categorization

G Mesnil, S Rifai, A Bordes, X Glorot, Y Bengio… - … 2013 Barcelona, Spain …, 2014 - Springer
Classifying scenes (eg into “street”, “home” or “leisure”) is an important but complicated task
nowadays, because images come with variability, ambiguity, and a wide range of …