Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

16 votes138 views3 answers
Update tensorflow pip
Python
0 vote139 views1 answer
Start virtualenv with python version
Python
0 vote126 views2 answers
Pydrive upload file to folder
Python
11 votes144 views2 answers
Set os environment variable python
Python
1 vote173 views3 answers
Python venv flask
Python Flask
-1 vote146 views2 answers
How to measure how much your of cpu your program is using in python
Python
0 vote136 views1 answer
From string to flaot python numpy
Python
0 vote136 views1 answer
Is cobol obsolete
Python
0 vote128 views1 answer
How to get a list of all values in a column df
Python
0 vote135 views2 answers
Cronometer python
Python