Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

4 votes231 views2 answers
How to count range in django template
Python Django
5 votes175 views2 answers
Convert every element in list to string python
Python
2 votes158 views1 answer
How to split and keep delimiter at the same line in python
Python
1 vote173 views1 answer
Parse youtube video id from youtube link python
Python
0 vote213 views1 answer
Python logging basicConfig+time
Python
1 vote173 views1 answer
Swapping of two numbers in python
Python
2 votes176 views1 answer
Tensorflow math python
Python
3 votes162 views1 answer
Update windows wallpaper python
Python
0 vote205 views1 answer
How to use import command in python
Python
1 vote192 views1 answer
Panda Series Function
Python