Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

0 vote165 views1 answer
Pandas automatic allignment of columns
Python
0 vote183 views1 answer
Sumif in python on a column and create new column
Python
1 vote173 views2 answers
How to print without space in python 3
Python
12 votes238 views6 answers
Model in django
Python Django
0 vote179 views1 answer
Check all true python
Python
0 vote184 views2 answers
Add key value in each dictonary in the list
Python
6 votes153 views1 answer
Complex num in python
Python
0 vote347 views1 answer
Deep copy a dataframe
Python
1 vote161 views1 answer
Set threshold resnet18 pytorch
Python
21 votes179 views1 answer
How to plot a graph using matplotlib
Python