The recruited
hidden unit is then installed into the network. Its freshly trained input
weights are frozen (indicated by solid large arrow) so that it will always be
able to track those aspects of network error that it was trained to track.
The new hidden unit is provided with random, trainable connection weights (of
sign opposite to that of its correlation with network error), and output
training resumes. |