Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

0 vote113 views1 answer
Python cv2 read image grayscale
Python
0 vote126 views1 answer
Kmpm]pomfyukruk6nfgngnzgnzggngnxfgnfgxfgfgxfggnxfggngnggngngngngngngngn. ';';';';'; ; ; ; ;; ; ; ; ; ; ; ; ;
Python
0 vote125 views1 answer
Python pow
Python
0 vote126 views1 answer
From random input python
Python
1 vote193 views2 answers
Run flask app windows
Python Flask
0 vote146 views1 answer
How to deploy to heroku djangorest framework app
Python Django
-2 votes109 views2 answers
Extract directory python
Python
0 vote131 views1 answer
Resize qpushbutton pyqt
Python
0 vote123 views1 answer
If a list has a string remove
Python
85 votes130 views6 answers
Python sort dataframe by one column
Python