You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I found delta6=1-delta5,but there are equation:
f(zt)=1-zt, delta6 to delata5 will be delta5*(1-zt)' and will be equal to -zt, that means : delta6=-delta5, not 1-delta5, is it right?
thanks.
Activity
mratsim commentedon May 12, 2018
The equation for delta 6 is indeed wrong.
For manually implemented backprop, tests should include numerical gradient check to catch those issues.