COMBINING ERROR TERMS

A straight forward way of combining $V$, $I$, and $H$ is to maximize the total objective function

$$T = \alpha V - \beta I - \gamma H,$$ (4)

where $\alpha, \beta, \gamma$ are positive constants determining the relative weighting of the opposing error terms. Maximization of (4) tends to force the representational units to take on binary values that maximize independence in addition to minimizing the reconstruction error³.

Back to Independent Component Analysis page.