In this section, we go
back to the general definition of redundancy in the
introduction.
There it was mentioned that the ideal of
a low-redundancy code is a factorial code
(e.g. [1]).
Recall that with a factorial code, the pattern components
of the code vectors
(representing input patterns )
are statistically independent:
(1) |