A survey of first order stochastic optimization methods and algorithms based adaptive learning rate from a machine learning perspective
Stochastic optimization in machine learning adjusts hyperparameters to reduce cost, which shows difference between actual value of estimated parameter and things predicted by machine learning model. Learning rate regulates the amount of alteration to a model in terms of the predicted error. Tuning l...
| Published in: | AIP Conference Proceedings |
|---|---|
| Main Author: | |
| Format: | Conference paper |
| Language: | English |
| Published: |
American Institute of Physics Inc.
2023
|
| Online Access: | https://www.scopus.com/inward/record.uri?eid=2-s2.0-85179818310&doi=10.1063%2f5.0177172&partnerID=40&md5=49e5b9ade56c278e53086eec423de955 |