Next: AN ERROR FUNCTION FOR
Up: OBJECTIVE FUNCTIONS FOR THE
Previous: AN ERROR FUNCTION FOR
A well-known objective function for enforcing binary codes is given by
Maximizing this term
encourages each unit to take on binary values. The
contribution of each unit is maximized if
is as close to 0.5 as possible. This implies maximal
entropy for unit under the binary constraint, i.e.,
wants to become a binary unit that conveys maximal information
about its input.
Juergen Schmidhuber
2003-02-13
Back to Independent Component Analysis page.