Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

9 votes145 views1 answer
Make tkinter btn disable
Python
0 vote150 views1 answer
How to use annoy python
Python
8 votes150 views4 answers
Count unique values numpy
Python
24 votes135 views5 answers
Load static
Python
0 vote157 views1 answer
Python get timestamp of today
Python
21 votes144 views4 answers
Convert radians to degrees python
Python
0 vote149 views1 answer
How to count the appearance of number or string in a list python
Python
1 vote149 views1 answer
Assigning values in python
Python
0 vote172 views1 answer
Sklearn cheat sheet
Python
0 vote147 views1 answer
Bs4 python delete element
Python