Pytorch can't optimize a non-leaf Tensor

为为为什么

发布于 2022-08-05 13:41:57

1K0

发布于 2022-08-05 13:41:57

文章被收录于专栏：又见苍岚又见苍岚

本文记录 pytorch: can’t optimize a non-leaf Tensor 解决方案。

错误

运行优化时报错

from torch import optim
 
weights = torch.rand(2,1,128,416)
weights.requires_grad = True
weights = weights.cuda()
optimizer = optim.Adam([weights], lr=0.01)

报错： can’t optimize a non-leaf Tensor

解决方案

需要先把Tensor放入到GPU中，然后再设置Tensor.requires_grad=True。

from torch import optim
 
weights = torch.rand(2,1,128,416)
weights = weights.cuda()
weights.requires_grad = True
optimizer = optim.Adam([weights], lr=0.01)