|Perhaps the most significant
limitation of current neural-network modeling is the failure to use old
knowledge in new learning. Neural networks start each problem from scratch
with random connection weights. Compared to humans, networks have the
advantage of concentrating on one task, but have the disadvantage of starting
to learn every problem from scratch.