TASK 1
— Data distribution shifted
Loss of Plasticity - Trap Simulator
Train
Pause
Reset
Continual
every:
Shift:
Rotate 45°
Rotate 15°
Rotate random
Translate
Brownian
Re-initialize
Step:
0.1
0.25
0.5
1
2
4
⚡ Inject Noise (CBP)
Preset:
Default config
Weight decay
Dist:
GMM
Circle
XOR
K:
Sep:
0
0.25
0.5
1
2
3
4
Seed:
Act:
ReLU
Tanh
Norm:
None
Layer Norm
LR:
0.001
0.003
0.01
0.03
0.1
Width:
Depth:
Frozen:
f'(z)
δ
ε:
1e-6
1e-5
1e-4
1e-3
1e-2
p:
0.999
0.99
0.95
0.90
0.80
Clone τ:
0.999
0.995
0.99
0.95
0.90
0.85
0.80
EMA α:
1.0
0.5
0.3
0.1
0.05
0.01
WD:
0
1e-4
1e-3
1e-2
0.1
Bias
0
Task:
1
|
Step:
0
|
Loss:
-
Hide ▲
1.0
-1.0