∂zL∂WL=(aL−y)⊙σ′(zL)(aL−1)T(4) ∂ J ( W , b , x , y ) ∂ W L = ∂ J ( W , b , x , y ) ∂ z L ∂ z L ∂ W L...∂zL∂bL=(aL−y)⊙σ′(zL)(5) ∂ J ( W , b , x , y ) ∂ b L = ∂ J ( W , b , x , y ) ∂ z L ∂ z L ∂ b L = ( a...继续使用链式求导法可以得出:
δl=∂J(W,b,x,y)∂zl=∂J(W,b,x,y)∂zl+1∂zl+1∂zl=δl+1∂zl+1∂zl(9) δ l = ∂ J ( W , b , x...+1∂zl ∂ z l + 1 ∂ z l
\frac{\partial z^{l+1}}{\partial z^{l}},好,我们再来看
zl+1 z l + 1
z^{l+1}和
zl...公式(7),(8),(9)同样适用于卷积层,但是
zl
z
l
z^l和
zl−1 z l − 1
z^{l-1}的关系变了:
zl=al−1∗Wl+