1
0
mirror of https://github.com/2martens/uni.git synced 2026-05-06 11:26:25 +02:00

[NN] Added short descriptions of the work of Shmelkov, Velez and Kirkpatrick

Signed-off-by: Jim Martens <github@2martens.de>
This commit is contained in:
2018-05-23 15:43:46 +02:00
parent 8698da1277
commit f42ffae7f5

View File

@ -294,10 +294,11 @@ would then serve as teacher for the second network which models the neocortex
and is responsible for generalizing. and is responsible for generalizing.
In the time between 1999 and 2018 more work was done with regards to catastrophic In the time between 1999 and 2018 more work was done with regards to catastrophic
forgetting. Most recently the work of Kirkpatrick\cite{Kirkpatrick2017}, forgetting. Most recently the work of Kirkpatrick\cite{Kirkpatrick2017}, who
Velez\cite{Velez2017} and Shmelkov\cite{Shmelkov2017} has to be named. The main slows down the learning for weights of older tasks,
focus here was a brief introduction of catastrophic forgetting and therefore Velez\cite{Velez2017}, whose work will be showcased later, and
these newest approaches will not be described here. Shmelkov\cite{Shmelkov2017}, who introduces a loss function that intends to keep
catastrophic forgetting at bay, has to be named.
\section{Plasticity} \section{Plasticity}
\label{sec:plasticity} \label{sec:plasticity}