Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

2 votes101 views1 answer
Python how to obfuscate code
Python
1 vote114 views1 answer
Django reverse queryset
Python
0 vote122 views1 answer
Adding bootstrap grid dynamically django
Python
0 vote112 views1 answer
Python password with special characters
Python
2 votes139 views1 answer
Not x axis labels python
Python
0 vote114 views1 answer
Z-score
Python
1 vote113 views1 answer
How to save an image with the same name after editing in python pillow module
Python
0 vote108 views1 answer
Pandas apply pass in arguments
Python
1 vote111 views2 answers
How to download python freegames
Python
0 vote103 views1 answer
Get center position of countries geopandas
Python