1
0
mirror of https://github.com/2martens/uni.git synced 2026-05-06 11:26:25 +02:00

[NN] Added short descriptions of the work of Shmelkov, Velez and Kirkpatrick

Signed-off-by: Jim Martens <github@2martens.de>
This commit is contained in:
2018-05-23 15:43:46 +02:00
parent 8698da1277
commit f42ffae7f5

View File

@ -294,10 +294,11 @@ would then serve as teacher for the second network which models the neocortex
and is responsible for generalizing.
In the time between 1999 and 2018 more work was done with regards to catastrophic
forgetting. Most recently the work of Kirkpatrick\cite{Kirkpatrick2017},
Velez\cite{Velez2017} and Shmelkov\cite{Shmelkov2017} has to be named. The main
focus here was a brief introduction of catastrophic forgetting and therefore
these newest approaches will not be described here.
forgetting. Most recently the work of Kirkpatrick\cite{Kirkpatrick2017}, who
slows down the learning for weights of older tasks,
Velez\cite{Velez2017}, whose work will be showcased later, and
Shmelkov\cite{Shmelkov2017}, who introduces a loss function that intends to keep
catastrophic forgetting at bay, has to be named.
\section{Plasticity}
\label{sec:plasticity}