Answers for "pytorch sgd l2 regularization"

1

pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)
Posted by: Guest on January-05-2021

Python Answers by Framework

Browse Popular Code Answers by Language