Maximizing this term encourages each unit to take on binary values. The contribution of each unit is maximized if is as close to 0.5 as possible. This implies maximal entropy for unit under the binary constraint, i.e., wants to become a binary unit that conveys maximal information about its input.

Juergen Schmidhuber 2003-02-13

Back to Independent Component Analysis page.