mirror of
https://github.com/2martens/uni.git
synced 2026-05-06 11:26:25 +02:00
[NN] Added short descriptions of the work of Shmelkov, Velez and Kirkpatrick
Signed-off-by: Jim Martens <github@2martens.de>
This commit is contained in:
@ -294,10 +294,11 @@ would then serve as teacher for the second network which models the neocortex
|
||||
and is responsible for generalizing.
|
||||
|
||||
In the time between 1999 and 2018 more work was done with regards to catastrophic
|
||||
forgetting. Most recently the work of Kirkpatrick\cite{Kirkpatrick2017},
|
||||
Velez\cite{Velez2017} and Shmelkov\cite{Shmelkov2017} has to be named. The main
|
||||
focus here was a brief introduction of catastrophic forgetting and therefore
|
||||
these newest approaches will not be described here.
|
||||
forgetting. Most recently the work of Kirkpatrick\cite{Kirkpatrick2017}, who
|
||||
slows down the learning for weights of older tasks,
|
||||
Velez\cite{Velez2017}, whose work will be showcased later, and
|
||||
Shmelkov\cite{Shmelkov2017}, who introduces a loss function that intends to keep
|
||||
catastrophic forgetting at bay, has to be named.
|
||||
|
||||
\section{Plasticity}
|
||||
\label{sec:plasticity}
|
||||
|
||||
Reference in New Issue
Block a user