The Stability Plasticity Dilemma
- A simple version of the dilemma is, how can a system retain old
memories but learn new ones.
- Carpenter and Grossberg at Boston University proposed it and
have a partial solution in ART.
- A more sophisticated version is how do you build a system that
can learn memories, retain the old ones that people retain, yet
lose (or lose access to) those that people lose.
- Synaptic change provides support for forgetting.
- Reverberation provides support for synaptic stability and thus
concept stability.
- Spontaneous activation (at least with the learning rules we use)
eliminates stability, but it occurs in the brain.
- ART provides a solution, but it involves adding new "neurons",
and doesn't allow forgetting.
- I expect there is something to do with attractor dynamics
that can be used to resolve this problem, but I don't have
an answer.