Post
2426
Uggghhh what a busy week.
Been up all night fixing Intellite and I got some progress I wanted to share.
ALL errors we experienced (there’s a lot):
Gradient vanishing (AI dies)
Gradient explosion (AI barely learns and destabilizes)
Activation Explosion (AI dies)
Layer Scale Crushing Signal (AI dies)
Activation Explosion (again) (AI dies)
All fixed, but now it keeps overfitting on datasets due to a dataset handler error 😩
Been up all night fixing Intellite and I got some progress I wanted to share.
ALL errors we experienced (there’s a lot):
Gradient vanishing (AI dies)
Gradient explosion (AI barely learns and destabilizes)
Activation Explosion (AI dies)
Layer Scale Crushing Signal (AI dies)
Activation Explosion (again) (AI dies)
All fixed, but now it keeps overfitting on datasets due to a dataset handler error 😩