next up previous
Next: INTRODUCTION

SEMILINEAR PREDICTABILITY MINIMIZATION PRODUCES WELL-KNOWN FEATURE DETECTORS
NEURAL COMPUTATION 8(4):773-786, 1996

Jürgen Schmidhuber1
IDSIA, Switzerland
Martin Eldracher
IDSIA, Switzerland
Bernhard Foltin
TUM, Germany

Abstract:

Predictability minimization (PM -- Schmidhuber, 1992) exhibits various intuitive and theoretical advantages over many other methods for unsupervised redundancy reduction. So far, however, there were only toy applications of PM. In this paper, we apply semilinear PM to static real world images and find: without a teacher and without any significant pre-processing, the system automatically learns to generate distributed representations based on well-known feature detectors, such as orientation sensitive edge detectors and off-center-on-surround-like structures, thus extracting simple features related to those considered useful for image pre-processing and compression.





Juergen Schmidhuber 2003-02-17


Back to Independent Component Analysis page.