Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

0 vote165 views1 answer
Get n largest values from 2D numpy array matrix
Python
0 vote152 views1 answer
You are trying to add a non-nullable field without a default
Python
-1 vote189 views9 answers
Django for Beginners
Python Django
1 vote148 views1 answer
Debug flask powershel
Python
9 votes148 views2 answers
Tar unpack to folder
Python
4 votes143 views3 answers
How to program
Python
0 vote145 views1 answer
How draw shell in python
Python
0 vote185 views1 answer
Unzipping the value using zip() python
Python
0 vote173 views1 answer
Python vergleichsoperatoren
Python
0 vote135 views1 answer
Python min function time complexity
Python